The Data Engine Team is developing and operating an efficient Data Engineering Platform for autonomous driving development. From large scale Vehicle Sensor Data Ingestion we produce the insights and datasets required to deliver the next generation of mobility at General Motors.
We’re looking to hire a Senior Data Engineer to join a high performing team of software developers to help us build out the infrastructure and solutions for optimal extraction and transformation of data at scale to support the needs of advanced ML development.
You will:
- Design, build, and maintain the core Data Engine product, services and APIs used by all of General Motors’ autonomous vehicle engineering teams.
- Work with a wide range of systems, processes and technologies to own and solve problems from end-to-end.
- Technically lead a team of software developers with collaboration and communication at the core of how we work.
- Scrutinize and communicate clearly the technology and architecture choices we make.
- Continuously improve software development processes, tools and standards in an agile setting.
International relocation assistance is not provided.
- 5+ years of software development, data engineering or technical architectural experience.
- Demonstrable technical ownership in a complex environment.
- Analytical and problem-solving experience with large-scale platforms.
- Experience leading a team of developers (not essential)
- Experience in Data Engineering or Big Data solutions.
Preferred Skills:
- Python
- Apache Airflow (or other)
- Elastic Logstash Kibana
- Parquet, Hive, Big Data
- RDBMS, Postgres (or other)
- System Monitoring & Validation, Grafana, Prometheus,
- Containerization, Kubernetes
