Director, Data Engineering

Director, Data Engineering

1010data values: 

• Integrity: Doing the right things for the right reasons
• Agility: Adapting and thriving in a dynamic environment 
• Teamwork: Combining our strengths to do amazing things 
• Passion: Channeling enthusiasm to drive excellence
• Creativity: Unleashing curiosity to defy the norm 

The expected base salary range for this position is from $160,000-$185,000. It is not typical for offers to be made at or near the top of the range. Salary offers are based on a wide range of factors including relevant skills, training, experience, education, geography, and where applicable, certifications obtained. Market and organizational factors are also considered.  In addition to salary and a generous employee benefits package, successful candidates may also be eligible to receive discretionary annual performance bonus compensation.

About the role: 

We are seeking a Director, Data Engineering to lead teams within our Data Engineering group that builds internal and external data products to solve client-driven business problems.  We apply our curiosity and passion to create data pipelines that deliver insights and help our clients make better decisions.  We design, implement, and deploy scalable pipelines that power 1010data’s products.

Our modern tech stack builds pipelines using 1010data’s industry-leading big data platform and open-source tools such as Airflow, Spark, and Python to analyze billions of rows of data every day.  In this role, you will work closely with data scientists, product leaders, and client-facing teams as you build new capabilities.

You and your team of data engineers will build and support enterprise data solutions in production to solve key business problems.  Key focus areas for this team include: scalable design, testing, deployment, support, and operational excellence.  As a hands-on leader, you’ll develop and implement best-practices for full-lifecycle software development, deploying instrumentation, guide your team through new implementations, and contribute to the vision behind our technology development roadmap.

This role is not sponsorable

What you will take on: 

• Leading, hiring, onboarding, training, coaching, and developing a team of data engineers
• Develop and implement best-practices for full-lifecycle SDLC from design to operational support
• Ensuring operational excellence, on-time delivery, and data quality standards
• Designing pipelines using CICD tooling for development using 1010data Insight Platform and open-source tools such as Airflow and Spark
• Guiding your team through design choices including ETL/ELT, feature engineering, reusability, templating, and resource tradeoffs
• Defining planning, and execution of agile projects, prioritizing iterative development, and collaboration with stakeholders
• Serving as SME contributor to Data Engineering components of the technology roadmap
• Use your curiosity and passion for data to answer complex questions over real-world datasets comprised of many billions of rows
• Learn and become an expert in 1010data’s industry-leading big data platform
• Communicate plans, designs, tradeoffs, and KPI’s to stakeholders, clients, and non-technical audiences
• You will be based in the US and will be comfortable working remotely with the Data Science, Data Quality, Data Engineering, and Account Management teams

What you already have: 

• Master’s or bachelor's degree in a quantitative or technical field such as Computer Science, Physics, Mathematics, Econometrics, or Engineering.  PhD is a plus.

• 7+ years professional experience deploying production data pipelines that created insights from data at large scale
• 3+ years experience with a major public cloud provider (Azure/AWS preferred)

• 3+ years supervising data teams through large, impactful projects
• Deep understanding and ability to communicate the foundations of data handling methods, their strengths, and their limitations
• High technical proficiency in:

• Software engineering best practices: design patterns, code reviews, git/inflow, unit testing, and CICD pipelines
• Orchestration and CI tooling: Kubernetes, Docker, Airflow, and CI pipelines (Jenkins, GitHub Actions, BitBucket Pipelines, etc.)
• Data and software tooling: Spark, Python, Scala, and SQL

• Familiarity with MLOps principles of model registries, feature stores, retraining strategies, and experiment tracking
• Curiosity, clarifying questions, a passion for learning new things, and perseverance in the face of uncertainty
• Ability to communicate clearly in meetings and written documents, consider options presented by others, and reach a balanced technical opinion   
• Strong business acumen to relate the needs of the customer to the data engineering solutions we can build with our products

About 1010data: 

For more than 20 years, 1010data has helped financial, retail and consumer goods customers monitor shifts in consumer demand and market conditions and rapidly respond with highly targeted strategies. The 1010data Insights Platform combines market intelligence, data management, granular enterprise analytics, and collaboration capabilities to empower better business outcomes. More than 900 of the world’s foremost companies’ partner with 1010data to power smarter decisions.  

You can find this on the Company page of 1010data at https://1010data.com/company/  

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.