Data Engineer
Los Angeles, CA
Metropolis
Metropolis transforms the parking experience with a computer vision platform that enables checkout-free payment.The Company
Metropolis develops advanced computer vision and machine learning technology that make mobile commerce remarkable. Our platform is already deployed in hundreds of mobility facilities and industries with billions in opportunity. We’re building the digital pipes through which the future of mobile commerce will move.
When you join Metropolis, you’ll join a team of world-class product leaders and engineers, building an ecosystem of technologies at the intersection of parking, mobility, and real estate. Our goal is to build an inclusive culture where everyone has a voice and the best idea wins. You will play a key role in building and maintaining this culture as our organization grows.
Position Overview and Responsibilities
At Metropolis, we are building the nextGen end-to-end data ecosystem including Data Ingestion, Data Warehousing, Data Integration, Analytic Data Products and Machine Learning capabilities. We are looking for talented data engineers to help design, build and deploy the data systems. If you are excited about working with Data APIs, Data Vault and Dimensional data modeling, Serverless Cloud platforms, Data Pipeline, Data Lake, ML Ops, etc. you might be interested in this opportunity. In this role, you will help define and build the data tech stack including Snowflake, AWS Redshift, SQL, Python, Scala, SparkSQL, Talend, Airflow, AWS Glue, Tableau, AWS Sagemaker. You will play a key and significant role in enabling the Metropolis business teams to leverage data to meet business goals.
Key Responsibilities
- Collaborate with Application and Engineering teams to build a strong understanding of source data systems and application data models.
- Develop and Implement ETL data pipelines to ingest data from source systems into the Data Lake, Data Warehouse and Data Marts
- Develop and implement ingestion patterns including CDC for batch, event-based, streaming, file base and unstructured data sources.
- Develop and implement data quality and error handling frameworks to ensure data integrity
- Build and maintain relational and dimensional data models
- Evaluate new tools and technologies and assist in architecting the data tech stack
- Perform data analysis for building data solutions for Analytics and ML business use cases
- Develop business data catalog and/or data dictionaries to document data lineages, data definitions and metadata for data domains..
- Optimize and maintain the Analytics tools environment
- Work in agile teams include sprint planning, backlog grooming and program increments.
- Mentor and coach data engineers on the team
Requirements and Qualifications
- Bachelor’s degree in a STEM discipline or related field
- 5-8+ years of relevant hands-on experience in data and analytics domain / teams.
- Expert level proficiency in SQL
- 5+ years experience in data ingestion (batch, streaming, API, etc.) and data integration (ETL) development using Informatica, Talend, AWS Glue or similar.
- 3+ years experience working with cloud data warehouses such as Snowflake, AWS Redshift, Azure, BigQuery or similar.
- 3+ years experience with Data Warehouse architecture including relational and dimensional data models.
- 2+ years experience on Data Visualizations/BI tools including Tableau, PowerBI, Microstrategy, etc.
- 2+ programming experience developing data solutions in Python, Java, Scala or similar
- 2+ years Agile / Scrum experience including participating in daily sprints, backlog grooming and program increments
- Demonstrated ability to adapt to new data technologies and learn quickly
- Ability to communicate across all levels of the organization and work with diverse project teams.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Airflow APIs Architecture AWS Azure BigQuery Computer Vision Data analysis Data pipelines Data quality Data warehouse Data Warehousing Engineering ETL Informatica Machine Learning Pipelines Power BI Python Redshift SageMaker Scala Scrum Snowflake SQL STEM Streaming Tableau Talend Unstructured data
Perks/benefits: Career development
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Business Intelligence Engineer jobs
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Data Manager jobs
- Open Data Analytics Engineer jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Junior Data Scientist jobs
- Open Business Intelligence Developer jobs
- Open Product Data Analyst jobs
- Open Senior Data Architect jobs
- Open Data Scientist II jobs
- Open Sr. Data Scientist jobs
- Open Manager, Data Engineering jobs
- Open Business Data Analyst jobs
- Open Big Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Data Analyst Intern jobs
- Open Principal Data Scientist jobs
- Open Data Product Manager jobs
- Open ETL Developer jobs
- Open Junior Data Engineer jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open GCP-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Java-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Kubernetes-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open Data warehouse-related jobs