ai-jobs.net

Azure Lead: Databricks

INDIA - BENGALURU - AUTOMOTIVE, IN

Full Time Senior-level / Expert USD 45K - 84K *
Birlasoft logo

Birlasoft

At Birlasoft we combine the power of domain, enterprise, and digital technologies to reimagine business potential. Surpassing expectations, breaking convention!

View company page

Apply now Apply later

Role: Azure Lead

Experience: 8 years (3+ years in Azure)

Responsibilities:

  • Azure data engineer with experience in Azure Data Factory, Azure Synapse, Azure Databricks, Spark SQL, Azure Blob Storage, Azure Delta Lake Storage, Azure SQL Server Database.
  • Responsible for the successful ingestion of external source system datasets ensuring their integrity, accuracy, accessibility, and quality of data.
  • Responsible for ingesting data from different source systems like Oracle, SQL server, SharePoint, files.
  • Responsible for creation of metadata driven framework for relational databases ingestion (Oracle, SQL server) and SharePoint, files ingestion.
  • Responsible for creating silver views and custom views based on source queries using Synapse Analytics.
  • Responsible for managing the Ingestion team and analyzing, delegating tasks among the team, resolving issues, and setting deadlines.
  • Responsible in managing and monitoring ADF Pipelines running in production.
  • Experience in building pipeline jobs, scheduling triggers using Azure data factory.
  • Experience on Azure Databricks, Spark SQL, Dataframes, creating/managing clusters and working with Notebooks to build, test and run the code.
  • Experience in working in both SDLC and AGILE development model.
Apply now Apply later
  • Share this job via
  • or

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  1  0  0
Category: Leadership Jobs

Tags: Agile Azure Databricks Oracle Pipelines RDBMS SDLC SharePoint Spark SQL

Region: Asia/Pacific
Country: India

More jobs like this

« Back to job search To the top ↑

Explore more AI, ML, Data Science career opportunities

Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.