Software Developer/ Engineer/ Architect
Cloud Big Data Software Engineer - REMOTE
About the role:
- Design & develop a big data platform supporting ingestion of datasets that will enable insights to analyze and measure the efficacy of the ML models.
- Participate in the design and development of ETL platform and framework to acquire and integrate data from diverse sources such as Spark.
- Investigate and resolve technical and non-technical issues, resolving critical incidents in a timely manner and with a thorough root cause analysis.
- Recognize and adopt best engineering practices in reporting and analysis: data integrity, test design, analysis, validation, and documentation.
- Assist in defining software requirements for key technical solutions.
About you:
- Bachelor's degree in computer science, information technology, engineering, or related fields preferred.
- 2-5 Years’ Experience developing with cloud-based technologies like web services, relational databases, data warehouse, big data (i.e. Hadoop, Spark), and orchestration/data pipeline tools.
- Proficient in Data engineering techniques for Data Lake, big data, including data automation frameworks, metadata management, and data flow process management strategies.
- Programming experience with proficiency in at least one language such as Nodejs/Python/Java/Go/C.
- Experience with one of the Cloud Platforms such as AWS or GCP or Azure.
- Understanding of scalable computing systems, software architecture, data structures, and algorithms.
- Experience with data science, data analysis, and data visualization is an advantage.
- Sharp analytical abilities and proven design skills.
