Lead Data Engineer
Bengaluru India - South
Huron
Businesses must be agile in their approach to understanding their customers — meeting today’s demands while also looking ahead to the future.The Opportunity
Huron is redefining what a global consulting organization can be. Advancing new ideas every day to build even stronger clients, individuals and communities. We’re helping our clients find new ways to drive growth, enhance business performance and sustain leadership in the markets they serve. And, we’re developing strategies and implementing solutions that enable the transformative change they need to own their future.
As a member of the Huron corporate team, you’ll help to evolve our business model to stay ahead of market forces, industry trends and client needs. Our accounting, finance, human resources, IT, legal, marketing and facilities management professionals work collaboratively to support Huron’s collective strategies and enable real transformation to produce sustainable business results.
Join our team and create your future
Position Summary
In the Lead Data Engineer role, you will be working with the data engineers, senior data engineers, data architect, various team leads, and practice leadership to contribute to the operational effectiveness of the software engineering function, team, and strategy. This role is based in Bengaluru, India, and will work with Software Development and Corporate IT, and practice resources based in the US and India.This individual is responsible for leading a team that designs and develops solutions that improve how Huron does business. This individual participates in the full software development life cycle including requirements development, analysis, design, implementation, and support. In this role, you will also create technical specifications based on conceptual design and business requirements and will consult with project and business teams to prototype, refine, test, and debug solutions. You will use current programming languages and technologies to build solutions and integrations between systems, develop documentation and procedures for installation, support, and maintenance. All solutions will be built based on Huron’s enterprise platforms and technologies. The lead data engineer will also be responsible for appropriately delegating work and assisting solution architects in creating development standards and training plans for the team.
Qualifications
Primary Responsibilities
+ Designs, develops, and implements Analytics solutions for Huron. This includes proprietary solution development, packaged application enhancements, and application integrations.
+ Identifies, diagnoses, debugs, and resolves issues.
+ Deletegates development tasks to identified team members.
+ Works with solution architects to create training plans and set development standards.
+ Documents and conveys problems, causes, and resolutions through company procedures, user guides, and requirements analysis.
+ Works with confidential and proprietary company and client data, ensures designs meet business compliance and security requirements.
+ Evaluates requirements, independently researches solution needs, limitations, and impacts to ensure design meets all requirements.
+ Creates proofs of concept and mock-ups to ensure requirements are captured.
+ Provides input on technology, designs, and strategies.
+ Contributes to team processes and methodology to improve delivery, quality, and effectiveness.
+ Works on other projects and tasks as deemed necessary.
+ Works in collaboration with the offshore development team.
+ Works closely with the QA team in the testing software and remediation of issues.
Qualifications
+ Bachelor's degree in Computer Science (or related field) with 6+ years relevant industry experience.
+ Experienced in leading development teams, delegating tasks, creating training plans, and ensuring quality deliverables.
+ Hands on experience with data lake, data warehouse, big data/analytics technologies
+ Experienced with ETL/ELT development and data mapping methodologies.
+ Hands on experience with AWS services (such as S3, lambda, Glue, RDS, Redshift, Athena, EC2).
+ Experienced in developing distributed data solutions using batch processing frameworks such as Hadoop and Spark.
+ Expertise in programming languages such as Python, SQL, and Bash shell scripting. Must be able to author highly efficient, reusable, and robust code.
+ Familiarity with one or more data visualization tools (e.g., Power BI, Tableau, QuickSight) is a plus.
+ Hands on experience with relational OLTP database systems (such as Oracle, MS SQL Server, PostgreSQL) and analytical database engines (such as Redshift and Snowflake). NoSQL database experience is a plus.
+ Extensive knowledge of data modelling concepts (dimensional modelling, normalization)
+ Adept in working with version control and CI/CD workflow tools (such git, Azure DevOps, Jenkins)
+ Experienced in building highly scalable, robust & fault-tolerant data pipelines.
+ Ability to create a complete solution by integrating a variety of programming languages & tools together.
+ Ability to understand complex business requirements and render them as prototype systems with quick turnaround time.
+ Strong verbal and written communications skills are a must, as well as the ability to work effectively across internal and external partners/virtual teams.
+ Self-starter ability to complete assigned tasks with without supervision.
+ Successful experience working with global teams across multiple geographies and time zones.
+ Lead efforts to evaluate and integrate new technologies and tools to enhance our data infrastructure and support evolving business needs.
+ Mentor junior team members, provide technical guidance, and promote knowledge sharing to foster a culture of continuous learning and innovation.
+ Strong technical expertise in data engineering, coupled with a strategic mindset for designing robust data architectures.
+ Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and design efficient data models and architectures.
+ Architect and optimize data storage solutions, including data lakes, data warehouses, and NoSQL databases, to ensure high performance, reliability, and scalability.
+ Develop and enforce data governance policies, standards, and best practices to ensure data quality, integrity, and security across all data assets.
+ Excellent interpersonal and teamwork skills.
+ Excellent English verbal and written communications skills.
Certifications
+ AWS Certifications – Solution Architect Associate/Professional or Data Analytics Specialty certification preferred.
Posting Category
CorporateOpportunity Type
RegularCountry
India* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Architecture Athena AWS Azure Big Data CI/CD Computer Science Consulting Data Analytics Data governance Data pipelines Data quality Data visualization Data warehouse DevOps EC2 ELT Engineering ETL Finance Git Hadoop Lambda MS SQL NoSQL Oracle Pipelines PostgreSQL Power BI Python QuickSight Redshift SDLC Security Shell scripting Snowflake Spark SQL Tableau Testing
Perks/benefits: Career development Startup environment
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Manager jobs
- Open Lead Data Analyst jobs
- Open Marketing Data Analyst jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Principal Data Engineer jobs
- Open MLOps Engineer jobs
- Open Power BI Developer jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Data Analytics Engineer jobs
- Open Business Data Analyst jobs
- Open Sr Data Engineer jobs
- Open Junior Data Scientist jobs
- Open Data Analyst Intern jobs
- Open Product Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Research Scientist jobs
- Open Big Data Engineer jobs
- Open Azure Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Principal Data Scientist jobs
- Open Data Quality Analyst jobs
- Open Data Product Manager jobs
- Open Data quality-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Deep Learning-related jobs
- Open Data visualization-related jobs
- Open Finance-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open TensorFlow-related jobs
- Open APIs-related jobs
- Open Consulting-related jobs
- Open LLMs-related jobs
- Open CI/CD-related jobs
- Open Snowflake-related jobs
- Open Generative AI-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Docker-related jobs
- Open Airflow-related jobs