FHN - Senior Databricks Developer
Bengaluru, IN
Marlabs
A US-based digital transformation consulting and IT services company with 25 years of expertise. Build digital agility for your business.Job Title: Senior Data Engineer - Azure Databricks and Azure Native Services
Location: Bangalore,India
Position Overview:
We are looking for an experienced Senior Data Engineer with 6 to 8 years of hands-on experience working on Azure Databricks and its native services. The Senior Data Engineer will be responsible for designing, building, and optimizing data pipelines to support business objectives, ensuring data quality, reliability, and performance. The ideal candidate will have strong technical skills, a deep understanding of cloud technologies, and a passion for driving innovation in a fast-paced environment.
Key Responsibilities:
- Design, develop, and maintain scalable and efficient data pipelines using Azure Databricks and its native services, including Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, Azure Cosmos DB, and Azure Data Lake Storage.
- Collaborate with cross-functional teams to understand data requirements, develop technical specifications, and implement solutions that meet business needs.
- Perform data profiling, cleansing, and transformation to ensure data quality, consistency, and accuracy throughout the data lifecycle.
- Optimize data pipelines for performance, reliability, and cost-effectiveness, leveraging cloud-native technologies and best practices.
- Implement security and compliance measures to protect sensitive data and ensure regulatory compliance, including data encryption, access controls, and auditing.
- Monitor and troubleshoot data pipeline issues, proactively identifying and resolving issues to minimize downtime and ensure data availability.
- Stay current with emerging technologies and trends in data engineering and cloud computing and evaluate opportunities for innovation and optimization.
- Mentor junior team members, providing technical guidance, training, and support to foster their professional development and growth.
Qualifications:
- Bachelor's or master’s degree in computer science, Engineering, or a related field.
- 6 to 8 years of experience working as a Data Engineer or a similar role, with a focus on cloud-based data platforms and services, particularly Azure Databricks and its native services.
- Strong proficiency in SQL, Python, and Spark, with hands-on experience developing ETL processes and data pipelines.
- Experience working with Azure cloud services such as Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, Azure Cosmos DB, and Azure Data Lake Storage.
- Knowledge of data modelling techniques, dimensional modelling, and data warehousing concepts.
- Excellent analytical and problem-solving skills, with the ability to troubleshoot complex data issues and implement effective solutions.
- Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Azure Computer Science Cosmos DB Databricks Data pipelines Data quality Data Warehousing Engineering ETL Pipelines Python Security Spark SQL
Perks/benefits: Career development
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Business Intelligence Engineer jobs
- Open Data Engineer II jobs
- Open Lead Data Analyst jobs
- Open Power BI Developer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Marketing Data Analyst jobs
- Open Data Science Manager jobs
- Open Junior Data Scientist jobs
- Open MLOps Engineer jobs
- Open Business Data Analyst jobs
- Open Data Scientist II jobs
- Open Product Data Analyst jobs
- Open Data Analytics Engineer jobs
- Open Business Intelligence Developer jobs
- Open Sr Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Senior Data Architect jobs
- Open Principal Data Scientist jobs
- Open Sr. Data Scientist jobs
- Open Junior Data Engineer jobs
- Open Big Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Manager, Data Engineering jobs
- Open Research Scientist jobs
- Open Azure Data Engineer jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Data quality-related jobs
- Open ML models-related jobs
- Open Business Intelligence-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Deep Learning-related jobs
- Open Data visualization-related jobs
- Open NLP-related jobs
- Open Finance-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open APIs-related jobs
- Open LLMs-related jobs
- Open Generative AI-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Databricks-related jobs
- Open Data warehouse-related jobs