Data Engineer - Commodities
Chicago and London
Applications have closed
DRW
DRW is a diversified trading firm innovating across both traditional and cutting-edge markets.DRW is a diversified trading firm with over 3 decades of experience bringing sophisticated technology and exceptional people together to operate in markets around the world. We value autonomy and the ability to quickly pivot to capture opportunities, so we operate using our own capital and trading at our own risk.
Headquartered in Chicago with offices throughout the U.S., Canada, Europe, and Asia, we trade a variety of asset classes including Fixed Income, ETFs, Equities, FX, Commodities and Energy across all major global markets. We have also leveraged our expertise and technology to expand into three non-traditional strategies: real estate, venture capital and cryptoassets.
We operate with respect, curiosity and open minds. The people who thrive here share our belief that it’s not just what we do that matters–it's how we do it. DRW is a place of high expectations, integrity, innovation and a willingness to challenge consensus.
DRW is looking for a Data Engineer to join its Commodities trading group to build data pipelines to manage the ingestion and transformation of data sets used by our analysts and traders to support fundamental research and trading.
You will work with trading desks in the Commodities group to understand and manage their data requirements and build ETL pipelines for data sets that they will consume. You’ll work in a group with other data engineers and have the support of software engineers to build tooling to help you get your job done.
What you will do
- Build data ETL pipelines in Python to ingest 3rd party data sets and make them accessible and useful inside our analytics and trading environments
- Work with software engineers to build tools to make the ETL process productive, scalable & robust
- Monitor ETL pipelines & data sets, ensuring availability & integrity of our data
- Work with database and storage engineers to design storage solutions for data sets across SQL, NoSQL, and distributed file systems on-prem and in the cloud
- Work with traders, analysts and researchers to capture new data requirements and work with our data program manager to organize our data engineering projects
- Understand how teams are using our data and constantly optimize to improve user experience (latency tuning, schema improvements, documentation, etc)
Projects you will be involved with
You will be working on building an efficient, scalable data warehouse for analyzing public and proprietary date feeds across a number data providers and data sets to support analytics and trading across many commodities products including:
- Crude oil & refined products balances & forecasting
- Global & regional natural gas and LNG flows
- Agriculture production, exports & forecasting
- Global shipping of commodities
- Demand data for US & European Power
What you bring to the team
- Experience building ETL pipelines for 3rd party data sets
- SQL database usage, schema design and query optimization experience
- Python development experience
- Familiarity with NoSQL databases and distributed file systems
- Experience working in a trading environment a strong plus
- An engineering mindset and experience writing software
For more information about DRW's processing activities and our use of job applicants' data, please view our Privacy Notice at https://drw.com/privacy-notice.
California residents, please review the California Privacy Notice for information about certain legal rights at https://drw.com/california-privacy-notice.
#LI-SK1
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Data pipelines Data warehouse Engineering ETL NoSQL Pipelines Privacy Python Research SQL
Perks/benefits: Team events
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Data Engineer II jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Manager jobs
- Open Power BI Developer jobs
- Open Principal Data Engineer jobs
- Open Sr Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Scientist II jobs
- Open Product Data Analyst jobs
- Open Senior Data Architect jobs
- Open Sr. Data Scientist jobs
- Open Business Data Analyst jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Data Quality Analyst jobs
- Open Junior Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open GCP-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Java-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open PhD-related jobs
- Open NLP-related jobs
- Open CI/CD-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open LLMs-related jobs
- Open Generative AI-related jobs
- Open Databricks-related jobs