Sr. data Engineer
Palo Alto, CA, United States
JPMorgan Chase & Co.
We are looking for an experienced Data Engineer to enhance our team's capabilities in managing complex data workflows and integrating machine learning operations into our systems. The successful candidate will be proficient in modern data engineering techniques and tools, particularly in managing and automating ML pipelines using MLOps practices.
Job Responsibilities:
* Design, build, and optimize data pipelines for data transformations, feature generation, and efficient data storage.
* Pererform large-scale data processing with PySpark.
* Develop and maintain scalable and robust ETL processes and data infrastructure.
* Manage workflow automation using Airflow or Control-M; ensuring all processes are aligned with business requirements.
* Collaborate with ML Engineer to implement machine learning models into production, focusing on automation, scaling, and maintaining ML models.
* Monitor, troubleshoot, and improve existing data and ML pipelines for performance and scalability.
* Ensure data integrity and continuity through robust architecture and rigorous testing.
Required qualifications:
* 3-5 years of professional experience, with at least 1-2 years focused on data engineering.
* Strong proficiency in Python and SQL, with significant experience in PySpark for big data processing.
* Experience with workflow management tools such as Airflow and Control-M.
* Demonstrated ability to build and maintain data pipelines in a production environment.
* Solid understanding of data management fundamentals and best practices.
* Proven track record of implementing automated and scalable data solutions.
Preferred qualifications:
* Understanding of MLOps pipelines including data generation, pipeline automation, model deployment, and maintenance.
* Familiarity with machine learning concepts and practices; ability to collaborate effectively with ML engineers, data science and software engineers.
* Experience with continuous integration/continuous deployment (CI/CD) processes and tools.
We offer a competitive total rewards package including base salary determined based on the role, experience, skill set, and location. For those in eligible roles, we offer discretionary incentive compensation which may be awarded in recognition of firm performance and individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.
JPMorgan Chase is an Equal Opportunity Employer, including Disability/Veterans
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Architecture Banking Big Data CI/CD Data management Data pipelines Engineering ETL Machine Learning ML models MLOps Model deployment Pipelines PySpark Python SQL Testing
Perks/benefits: Career development Competitive pay Health care Wellness
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Manager jobs
- Open Marketing Data Analyst jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open MLOps Engineer jobs
- Open Data Manager jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Sr Data Engineer jobs
- Open Business Data Analyst jobs
- Open Data Analytics Engineer jobs
- Open Data Analyst Intern jobs
- Open Product Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Big Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Data Quality Analyst jobs
- Open Manager, Data Engineering jobs
- Open Research Scientist jobs
- Open Azure Data Engineer jobs
- Open Junior Data Engineer jobs
- Open Data quality-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open APIs-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open LLMs-related jobs
- Open CI/CD-related jobs
- Open Generative AI-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs