Azure Data engineer
INMANBP Bengaluru (INMANBP) Manyatha
KyndrylAt Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day.
Who We Are
At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities.
Roles and Responsibilities:
Work as part of a team to develop Cloud Data and Analytics solutions
Strong experience as an Azure Data Engineer and must have Azure Databricks experience.
Demonstrated experience of turning business use cases and requirements into technical solutions.
Expert level understanding on Azure Data Factory, SQL/Synapse , ADLS, Azure Databricks, Pyspark, Azure DevOps, Python is required.
Experience in business processing mapping of data and analytics solutions.
Ability to conduct data profiling, cataloguing, and mapping for technical design and construction of technical data flows.
The ability to apply such methods to solve business problems using one or more Azure Data and Analytics services in combination with building data pipelines, data streams, and system integration.
Postgress DB, Azure Purview , Kusto Query, Azure Cosmos DB, ADX is a plus.
Experience preparing data for Data Science and Machine Learning.
Experience preparing data for use in Azure Machine Learning and/or Azure Databricks .
Demonstrated experience preparing data and building data pipelines for AI Use Cases (text, voice, image, etc.…).
Designing and building Data Pipelines using streams of IoT data.
Knowledge of Lambda and Kappa architecture patterns.
Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential.
Strong team collaboration and experience working with remote teams.
Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code fundamentals.
Working experience with Visual Studio, PowerShell Scripting, and ARM templates.
Experience with Git/TFS/VSTS is a must.
Who You Are
Required Professional and Technical Expertise:
7+ years experience with Azure Data Engineering
Hands-on experience in Azure Databricks – Mandatory
Experience as Data Engineer in Azure Big Data Environment
Expertise in ETL tools i.e. (SSIS, Data Stage)
Expertise in Implementing Data Warehousing Solutions
Experience with working in Agile (KANBAN, Scrumban) environment as part of a scrum team
Programming experience in Scala or Python, T-SQL
Hands-on experience in Azure stack (Azure Data Lake, Azure Data Factory - Optional
Good understanding of Azure Databricks platform and ability to build data analytics solutions to support the required performance & scale
Good understanding and experience working on Deltalake using Apache Delta in Azure Databricks
Experienced working on performance tuning and optimizing long running jobs
Demonstrated analytical and problem-solving skills, particularly those that apply to a big data environment.
Good Understanding of Modern Data Warehouse and Data Warehousing concepts
Proficient in a source code control system (e.g. CodeCloud)
Bachelor’s degree in computer science, Electrical/Electronic Engineering, Information Technology or another related field
Diversity is a whole lot more than what we look like or where we come from, it’s how we think and who we are. We welcome people of all cultures, backgrounds, and experiences. But we’re not doing it single-handily: Our Kyndryl Inclusion Networks are only one of many ways we create a workplace where all Kyndryls can find and provide support and advice. This dedication to welcoming everyone into our company means that Kyndryl gives you – and everyone next to you – the ability to bring your whole self to work, individually and collectively, and support the activation of our equitable culture. That’s the Kyndryl Way.
What You Can Expect
With state-of-the-art resources and Fortune 100 clients, every day is an opportunity to innovate, build new capabilities, new relationships, new processes, and new value. Kyndryl cares about your well-being and prides itself on offering benefits that give you choice, reflect the diversity of our employees and support you and your family through the moments that matter – wherever you are in your life journey. Our employee learning programs give you access to the best learning in the industry to receive certifications, including Microsoft, Google, Amazon, Skillsoft, and many more. Through our company-wide volunteering and giving platform, you can donate, start fundraisers, volunteer, and search over 2 million non-profit organizations. At Kyndryl, we invest heavily in you, we want you to succeed so that together, we will all succeed.
If you know someone that works at Kyndryl, when asked ‘How Did You Hear About Us’ during the application process, select ‘Employee Referral’ and enter your contacts Kyndryl email address.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Architecture Azure Big Data CI/CD Computer Science Cosmos DB Data Analytics Databricks Data pipelines Data warehouse Data Warehousing DevOps Engineering ETL Git Kanban Lambda Machine Learning Pipelines PySpark Python Scala Scrum SQL SSIS T-SQL
More jobs like this
Mumbai, MH, IN Mumbai, MH, IN Full TimeSenior Senior-levelUSD 121K - 188K * USD 121K+ *
GSSO - Data Engineering - Specialist / Sr. SpecialistAirflow Architecture Big Data Computer Science Data pipelines E-commerce +18
Career development Equity Relocation support Startup environment Team events
SG - Singapore SG - Singapore Full TimeSenior Senior-levelUSD 121K - 188K * USD 121K+ *
Principal Architect - Data Engineering Platform (On-site, Singapore)Airflow Architecture Banking Big Data BigQuery Databricks +15
Career development Competitive pay Equity Snacks / Drinks Team events
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Principal Data Engineer jobs
- Open BI Analyst jobs
- Open Business Intelligence Engineer jobs
- Open Data Analyst Intern jobs
- Open Product Data Analyst jobs
- Open Lead Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Data Manager jobs
- Open Senior Data Architect jobs
- Open Big Data Engineer jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Power BI Developer jobs
- Open Principal Data Scientist jobs
- Open Senior Manager, Data Science jobs
- Open Data Analytics Engineer jobs
- Open Business Data Analyst jobs
- Open Lead Machine Learning Engineer jobs
- Open Research Scientist jobs
- Open Data Quality Analyst jobs
- Open Data Engineering Manager jobs
- Open Business Intelligence Developer jobs
- Open Clinical Data Manager jobs
- Open Head of Data jobs
- Open Data pipelines-related jobs
- Open Privacy-related jobs
- Open ML models-related jobs
- Open GCP-related jobs
- Open Business Intelligence-related jobs
- Open Data quality-related jobs
- Open Data management-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open Snowflake-related jobs
- Open PyTorch-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open Consulting-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open NLP-related jobs
- Open Scala-related jobs
- Open Data warehouse-related jobs
- Open Databricks-related jobs
- Open Kafka-related jobs
- Open Git-related jobs
- Open Docker-related jobs