Data Architecture- Consultant/Sr. Consultant (Blr, Hyd, Pune, NCR)
Bengaluru, Karnataka, India
HSO
HSO is your Business Transformation Partner with deep industry expertise and global reach, leveraging the full power of Microsoft technology.• 10+ years of experience with data platforms, data warehouses, Data Lake, Data Mesh architectures & ETL.
• Hands on experience with ADF, Spark, Databricks, Python, Azure Synapse, ADLS and Azure Functions
• Hands on experience on performance tuning and optimization code running in databricks environment or Azure Synapse.
• Identifying best path and services for cloud cost optimization for data platform
• Hands on experience implementing Delta Lake concepts: delta tables, SCD, schema evolution.
• Good concepts and implementation knowledge in Data Mesh architecture, Azure Purview and Data Observability & Governance frameworks
• Experience with building near real time data ingestion and processing frameworks
• Building and designing efficient pipelines to get data from different source systems like D365 F&O, CE, Salesforce, Workday, SAP is a must.
• Working experience with PowerShell Scripting, and ARM templates.
• Strong knowledge on Common Data Model (CDM), Dataverse and Power BI Data Flows.
• Experience in using Azure key vault, logic apps, Azure DevOps, run books is preferred.
• Experience with Data API Gateways to extract data from 3rd party apps.
• Strong understanding of Cloud concepts – IaaS, PaaS, SaaS
• Design and build reusable data extraction, transformation, and loading processes by creating Synapse pipelines
• Design/Redesign current flows to increase throughput and streamline data for downstream Applications/Consumers.
• Uses Azure Data Factory (ADF) or Synapse to create multiple complex pipelines and activities using both Azure and On-Prem data stores for full and incremental data loads into ADLS.
• Experience using SQL, T-SQL stored procedures
• Knowledge of Git and GitHub
• Responsible for designing, building, and supporting advanced cloud automation workflows and tools used to support automated CI/CD pipelines
Requirements
Azure Data Architect to be part of HSO team and lead Cloud data enablement journeys for our customers. This includes On-Premise to Microsoft Azure transformation, D365 to Azure Data Lake and Azure Synapse implementation. As a Azure Data Architect, resource will lead team of data engineers to architect, build, and deploy cloud data solutions for highly complex distributed software systems in Microsoft Azure
Tags: APIs Azure CI/CD Databricks DevOps ETL Git GitHub Pipelines Power BI Python Spark SQL T-SQL
Perks/benefits: Team events
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open MLOps Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Data Manager jobs
- Open Sr Data Engineer jobs
- Open Power BI Developer jobs
- Open Principal Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Scientist II jobs
- Open Product Data Analyst jobs
- Open Senior Data Architect jobs
- Open Sr. Data Scientist jobs
- Open Business Data Analyst jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Junior Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Data Product Manager jobs
- Open Principal Data Scientist jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open GCP-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Java-related jobs
- Open Privacy-related jobs
- Open Data visualization-related jobs
- Open Finance-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Snowflake-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open LLMs-related jobs
- Open Databricks-related jobs
- Open Data warehouse-related jobs