Data Engineer
Luxury Motor Company
Bay Area, California
This automotive company is revolutionizing the electric car industry with luxurious designs and longer mileage per charge. In this role you would have the opportunity to work alongside some of the brightest minds in the automotive industry, and lead the world towards a more sustainable future. They are looking for a Data Engineer who is experienced in creating, designing, and streaming loT data pipelines.
The Role
- $150-200k salary plus Equity
- Designing and creating loT data Pipelines
- Streaming pipeline using MQTT, Kafka, Spark Structure streaming
- Orchestrate and monitor pipelines using Promethius and Kubernetes
- Develop and implement Apache Airflow and other dependency enforcement scheduling tools
- Hands on data modeling and data warehousing
- Deploy solutions using AWS, S3, Redshift and Docker/Kubernetes
- Develop storage and retrieval systems using Presto and Parquet/ORC
Qualifications
- Bachelor or Masters degree in Software engineering or computer science
- 6-8+ years of experience in Data Engineering and Business Intelligence
- Proficient in MQTT, Kafka, Spark, AWS, S3, Redshift
- Expertise in containerization, including Docker and Kubernetes
- Extensive programming and software engineering experience, especially in Java and Python