Data Engineer - Databricks
Chennai, TN, IN
Vestas
Vestas is the renewable energy industry’s global partner on sustainable energy solutions. We design, manufacture, install, and service wind turbines across the globe.Vestas is the world leader in wind technology and a driving-force in the development of the wind power industry. Vestas’ core business comprises the development, manufacture, sale, marketing, and maintenance of Wind Turbines. Come and join us at Vestas!
Applications, Controls & Electrical > Modelling & Analytics Module > Plant Monitoring & Reliability
Plant Monitoring & Reliability Sub Module, within Modelling & Analytics Module (M&A), Part of Vestas Power Solutions, is responsible for the products and services related to Vestas Monitoring and Reliability solutions and offerings.
We have a comprehensive and diverse team that consists of everything from Health Monitoring Engineers/Specialists and Reliability Engineers/ Specialists, Data engineers, Data Analysts, and Data Scientists. The department is responsible for developing world class Plant Monitoring Products & Solutions - Health Monitoring, Condition Monitoring, Power Quality Monitoring, Reliability and VTMs. This ranges across real-time data collection from thousands of power plants with Health Monitoring systems, and data analytics on a Health Monitoring & Reliability setup supporting multiple data applications, Diagnostics, Monitoring solutions for our customers. The goal is to bring down the cost of energy by leveraging the vast amount of data that Vestas collects and stores from power plants around the globe.
Vestas Modelling & Analytics module is on a journey of transitioning into a Cloud based data platform for condition monitoring data. You will be the core Data engineer responsible for design and implementation of this transition and become the design owner of the new cloud based platform for modern data product offerings of Condition monitoring data. The primary scope of work will be sourcing of data from distributed on-premise data systems to one centralized Databricks infrastructure.
Responsibilities
- Design and support database and table schemas for new and existent data sources
- Translate business needs into technical data designs Design and implement implementation of ETL (Extract, Transform, Load) data pipelines
- Work on feasibility studies of new technologies through proof of concepts
- Work with data science and analytics development teams in Plant Monitoring & Reliability area and cross functional teams across M&A Module and IT teams (Digitalization) to ensure best practice, performance and reliability is in place
Qualifications
- Minimum of 5-7 years' Relevant experience with Masters' or PhD degree in STEM (Science, Technology, Engineering, and Mathematics)
- Work experience where data engineering and Data warehouse development was a major part of your work Experience in automating software deployments & tests, and following a continuous delivery and deployment model
- Experience with mathematical modeling
Competencies
- Must have Databricks, Spark, Pandas, Python, Azure cloud, Data factory, SQL, Data/DeltaLake, git, Azure DevOps, testing, CI/CD
- Good to have; Cloud infrastructure deployment and IaC, Azure Biceps and ARM templates, Snowflake, Snowpark, Unity Catalog, dbt, Scala/Rust/R Familiarity with: Statistics, signal processing, Jupyter notebooks, data testing, and data science best-practices
- Data warehouse data models and proficiency with ETL tools
- MS SQL, SSIS, SSAS (MDX/DAX)
- JIRA or similar tools
- Experience with Cloud platform (SNOWFLAKE)
- Knowledge of Kafka, C#
- DevOps process and associated tools, e.g. Azure DevOps
What We Offer
We offer you the opportunity to make a difference and to work in a multicultural and international company, where you have the possibility to improve your skills and develop professionally.
Additional Information:
Your primary location will be in Chennai.
Please note: We do amend or withdraw our jobs and reserve the right to do so at any time, including prior to the advertised closing date. Please be advised to apply on or before 18th May 2024.
BEWARE – RECRUITMENT FRAUD
It has come to our attention that there are a number of fraudulent emails from people pretending to work for Vestas. Read more via this link, https://www.vestas.com/en/careers/our-recruitment-process
DEIB Statement
At Vestas, we recognize the value of diversity, equity, and inclusion in driving innovation and success. We strongly encourage individuals from all backgrounds to apply, particularly those who may hesitate due to their identity or feel they do not meet every criterion. As our CEO states, "Expertise and talent come in many forms, and a diverse workforce enhances our ability to think differently and solve the complex challenges of our industry". Your unique perspective is what will help us powering the solution for a sustainable, green energy future.
About Vestas
Vestas is the energy industry’s global partner on sustainable energy solutions. We are specialised in designing, manufacturing, installing, and servicing wind turbines, both onshore and offshore.
Across the globe, we have installed more wind power than anyone else. We consider ourselves pioneers within the industry, as we continuously aim to design new solutions and technologies to create a more sustainable future for all of us. With more than 173 GW of wind power installed worldwide and 40+ years of experience in wind energy, we have an unmatched track record demonstrating our expertise within the field.
With 29,000 employees globally, we are a diverse team united by a common goal: to power the solution – today, tomorrow, and far into the future.
Vestas promotes a diverse workforce which embraces all social identities and is free of any discrimination. We commit to create and sustain an environment that acknowledges and harvests different experiences, skills, and perspectives. We also aim to give everyone equal access to opportunity.
To learn more about our company and life at Vestas, we invite you to visit our website at www.vestas.com and follow us on our social media channels. We also encourage you to join our Talent Universe to receive notifications on new and relevant postings.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Azure CI/CD Data Analytics Databricks Data pipelines Data warehouse dbt DevOps Engineering ETL Git Jira Jupyter Kafka Mathematics MS SQL Pandas PhD Pipelines Python R Rust Scala Snowflake Spark SQL SSIS Statistics STEM Testing
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open MLOps Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Data Manager jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Data Scientist II jobs
- Open Junior Data Scientist jobs
- Open Business Data Analyst jobs
- Open Data Analytics Engineer jobs
- Open Sr Data Engineer jobs
- Open Product Data Analyst jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Principal Data Scientist jobs
- Open Data Quality Analyst jobs
- Open Research Scientist jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Data quality-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open APIs-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open LLMs-related jobs
- Open Generative AI-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs