Lead Data Engineer

We are looking for an experienced Data Engineer to join our team. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of learning machine methods. If you are detail-oriented, with excellent organizational skills and experience in this field, we’d like to hear from you.

Requirements

• Defining, building, and integrating data processing pipelines
• Experience in CPG or Retail industry is strongly preferred
• Collaboratively working with other teams and the architect to design and develop solutions aligning with the architectural vision
• Taking ownership of tasks/components and ensuring timely and quality delivery
• Mentoring of fellow team members
• Extensive experience with large scale data processing pipelines and enabling technologies; e.g. Azure Data Factory, Databricks, Spark
• Real world experience of operationally active data ingestion and automation
• Extensive experience of programming languages: Python, SQL
• Extensive experience with at least one major cloud platform, ideally Azure
• Working knowledge of software development and associated technologies
• Broad knowledge of software development and associated technologies
• Proven problem solving ability and the ability to work independently as well as with a team
• Strong communication skills and highly effective when working with a team
• Experience of container technologies, especially Docker, and container orchestration technologies such as Kubernetes
• Experience with Machine Learning training and serving pipelines

Benefits

• Health Care Plan (Medical, Dental & Vision)
• Retirement Plan (401k, IRA)
• Life Insurance (Basic, Voluntary & AD&D)
• Paid Time Off (Vacation, Sick & Public Holidays)
• Remote - Work From Home
• Family Leave (Maternity, Paternity)
• Short Term & Long Term Disability
• Training & Development