Lead Data Engineer

Company Description

B360 is recognized as award-winning marketing and analytics consulting firm and has provided solutions to some of the world’s best known and most respected Fortune 500 and mid-sized companies. We have been recognized as one of the fastest growing companies in 6 out of last 7 years.

Job Description

As a Data Engineering Manager, your role is to spearhead the data engineering teams and elevate the team to the next level! You will be responsible for laying out the architecture of new project as well as selecting the tech stack associated with it. You will plan out the develop cycles deploying AGILE if possible as well as creating the foundations for good data stewardship with our new data products!

You will also set up a solid code framework that needs to be built to purpose, yet have enough flexibility to adapt to new business use cases—a tough but rewarding challenge!

Responsibilities:

• Collaborate with several stakeholders to deeply understand the needs of data practitioners to deliver at scale
• Lead Data Engineers to define, build and maintain Data Platform
• Work on emerging technologies, building distributed applications
• Drive development effort End-to-End for on-time delivery of high quality solutions that conform to requirements, conform to the architectural vision, and comply with all applicable standards. 
• Present technical solutions, capabilities, considerations, and features in business terms. Effectively communicate status, issues, and risks in a precise and timely manner.
• Further develop critical initiatives, such as Data Discovery, Data Lineage and Data Quality
• Lead and Mentor junior resources
• Help your team members grow in their role and achieve their career aspirations
• Build data systems, pipelines, analytical tools and programs
• Conduct complex data analysis and report on results

Qualifications

• 7+ Years of Experience
• Degree in Computer Science, Data Science, Mathematics, IT, or similar field
• 3 - 5 Years of Experience as a data engineer or similar role
• Must have experience executing projects end to end.
• Technical expertise with data models, data mining, and segmentation techniques
• Deep understanding, both conceptually and in practice of at least one object orientated library (Python, Scala)
• Strong SQL skills and a good understanding of existing SQL warehouses and relational databases. 
• Strong Spark, PySpark, Spark SQL skills and good understanding of distributed processing frameworks. 
• Build large-scale batch and real-time data pipelines. 
• Ability to work independently and mentor junior resources.
• Desire to lead and develop a team of Data Engineers across multiple levels
• Nice to have: Cloud experience (AWS, Azure, GCP), Snowflake, Databricks, Hadoop, DBT, Elastic Search, Data modeling, Airflow, CI\CD, Agile Methodologies, Docker\Kubernetes.