Data Engineer Senior Consultant
Bengaluru, KA, IN
Capgemini
A global leader in consulting, technology services and digital transformation, we offer an array of integrated services combining technology with deep sector expertise.Short Description
Data Engineer
We are seeking a skilled and experienced Data Engineer to join our dynamic team. As a Data Engineer, candidate will play a critical role in designing, building, and maintaining our data infrastructure to support our growing data needs. Your expertise in SQL, Python, ETL, cloud technologies (Azure, AWS, GCP), and DevOps will be essential in streamlining our data operations and driving efficiency across the organization.
Qualifications
Bachelor's degree in Computer Science, Information Systems, or a related field.
Job Responsibilities
- Minimum 4 years of relevant experience in data engineering, including strong experience with SQL, Python and PySpark.
- Strong Experience in any ETL tool like Informatica, DataStage, Alteryx, Talend, etc.
- Expertise in writing complex SQL and PL SQL queries.
- Proficiency in at least one of the cloud technologies: Azure, AWS, or GCP.
- Experience in API integration- REST API would be a big plus
- Experience in any job scheduling tool e.g. Control M, Autosys, Airflow Luigi would be a big plus
- Experience in complex ETL mappings, CI CD pipelines, dev ops and deployment tools e.g. Docker, Jenkins etc. would be a big plus
- At-least 2 full life cycle implementations experience from conceptualization, design, architecture to delivery
- Strong hands-on experience on AWS or Azure (E.g. Amazon Athena, Amazon EMR, Amazon Redshift, Amazon Kinesis, Amazon Elasticsearch Service, AWS Glue, Quick sight, Azure Synapse, Azure Data Lake Storage, Azure Data Factory, Azure Databricks, Power BI)
- Solid understanding of data modeling concepts and experience with data warehousing and dimensional modeling.
- Guide architectural choices using various cloud services and solution methodologies.
- Understand existing architecture and develop plans to support the growth in the cloud adoption.
- Must understand networking, security, design principles and best practices in cloud.
- Perform POC's on tools and provide recommendations to solve specific business needs
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow APIs Architecture Athena AWS AWS Glue Azure Computer Science Databricks DataOps Data Warehousing DevOps Docker Elasticsearch Engineering ETL GCP Informatica Kinesis Pipelines Power BI PySpark Python Redshift REST API Security SQL Talend
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open MLOps Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Data Manager jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Data Scientist II jobs
- Open Junior Data Scientist jobs
- Open Business Data Analyst jobs
- Open Data Analytics Engineer jobs
- Open Sr Data Engineer jobs
- Open Product Data Analyst jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Principal Data Scientist jobs
- Open Data Quality Analyst jobs
- Open Research Scientist jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Data quality-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open APIs-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open LLMs-related jobs
- Open CI/CD-related jobs
- Open Generative AI-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs