Data Architecture- Consultant/Sr. Consultant (Blr, Hyd, Pune, NCR)

Bengaluru, Karnataka, India

Applications have closed

HSO

HSO is your Business Transformation Partner with deep industry expertise and global reach, leveraging the full power of Microsoft technology.

View company page

• 10+ years of experience with data platforms, data warehouses, Data Lake, Data Mesh architectures & ETL.

• Hands on experience with ADF, Spark, Databricks, Python, Azure Synapse, ADLS and Azure Functions

• Hands on experience on performance tuning and optimization code running in databricks environment or Azure Synapse.

• Identifying best path and services for cloud cost optimization for data platform

• Hands on experience implementing Delta Lake concepts: delta tables, SCD, schema evolution.

• Good concepts and implementation knowledge in Data Mesh architecture, Azure Purview and Data Observability & Governance frameworks

• Experience with building near real time data ingestion and processing frameworks

• Building and designing efficient pipelines to get data from different source systems like D365 F&O, CE, Salesforce, Workday, SAP is a must.

• Working experience with PowerShell Scripting, and ARM templates.

• Strong knowledge on Common Data Model (CDM), Dataverse and Power BI Data Flows.

• Experience in using Azure key vault, logic apps, Azure DevOps, run books is preferred.

• Experience with Data API Gateways to extract data from 3rd party apps.

• Strong understanding of Cloud concepts – IaaS, PaaS, SaaS

• Design and build reusable data extraction, transformation, and loading processes by creating Synapse pipelines

• Design/Redesign current flows to increase throughput and streamline data for downstream Applications/Consumers.

• Uses Azure Data Factory (ADF) or Synapse to create multiple complex pipelines and activities using both Azure and On-Prem data stores for full and incremental data loads into ADLS.

• Experience using SQL, T-SQL stored procedures

• Knowledge of Git and GitHub

• Responsible for designing, building, and supporting advanced cloud automation workflows and tools used to support automated CI/CD pipelines

Requirements

Azure Data Architect to be part of HSO team and lead Cloud data enablement journeys for our customers. This includes On-Premise to Microsoft Azure transformation, D365 to Azure Data Lake and Azure Synapse implementation. As a Azure Data Architect, resource will lead team of data engineers to architect, build, and deploy cloud data solutions for highly complex distributed software systems in Microsoft Azure

Tags: APIs Azure CI/CD Databricks DevOps ETL Git GitHub Pipelines Power BI Python Spark SQL T-SQL

Perks/benefits: Team events

Region: Asia/Pacific
Country: India
Job stats:  0  0  0

More jobs like this

Explore more AI, ML, Data Science career opportunities

Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.