Data Engineer II
Hyderabad, Telangana, India
Microsoft
Come join the Distribution & Delivery Data Insights Team! We are part of the Edge Device Services team, within the Windows Experiences and Devices organization.
We are looking for a passionate Data Engineer II who is self-driven, innovative, and motivated who can help us build the next generation federated Big Data service and modernize our platform. This job offers great growth opportunities for skilled and motivated engineers to work on big scale data and bring valuable insights, shaping our complex OTA (over the air) update domain.If you are passionate about processing billions of events, churning Petabytes of data daily, learning innovative public cloud technologies like Spark, Synapse, then EDS would love to apply your data expertise to some of the most exciting data problems in the industry.
As a Data Engineer in the team, you will work closely with our software engineers, program managers, and data scientists across different teams within Windows.You will also collaborate with a variety of internal partner teams across Azure and Microsoft.
You will build reliable, secure, compliant, highly scalable, performant and real-time data pipelines to enhance our publishing and updating platform.The value of your work will be reflected in improvements to the delivery and distribution pipeline of Windows Update platform, bringing efficiency/observability to our updating services, driving insights into our customers, including COGS reduction.You will have opportunities for mentorship, accelerating your career growth, learning new areas and working on truly high-business impact areas.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Responsibilities
- Requirements and Modeling: Collaborate with stakeholders, document data requirements, evaluates feasibility, negotiate data agreements, and proposes data metrics for project-relevant features.
- Data Model Design and Specification: Contribute to the data model design, draft design specification documents, improve data schemas, and balance analytical requirements and compute/storage consumption for data.
- Data Extraction and Validation: With guidance, implement code to extract raw data from upstream sources, perform code reviews, implement orchestration techniques, validate data quality and reliability, and record data source control and versioning.
- Data Transformation and Merging: Apply standard operations to transform raw data into compatible forms, use software and tools to wrangle and analyze data, and merge data into distributed systems or products.
- Data Tool Design and Maintenance: Design and maintain data tools/platforms that are used to transform, manage, and access data, write efficient code to test and validate data platforms, and implement sustainable design patterns.
- Data Monitoring and Troubleshooting: Follow performance monitoring protocols, build visualizations and aggregations to monitor data quality and pipeline/report health, troubleshoot and fix problems or anomalies, and document and share insights.
- Data Compliance and Governance: Follow data modeling and handling procedures to comply with laws and policies, tag and classify data, govern data accessibility and traceability, and contribute to the data glossary.
Qualifications
Required Qualifications
- Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, data modeling or data engineering work
- OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field
- OR equivalent experience.
Other Requirements
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
Preferred Qualifications
- Bachelor's Degree in Computer Science , Math, Software Engineering, Computer Engineering,
- OR related field AND 5+ years experience in business analytics, data science, software development, data modeling
- OR data engineering work
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.
Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Azure Big Data Business Analytics Computer Science Data pipelines Data quality Distributed Systems Engineering Mathematics Model design Pipelines Security Spark
Perks/benefits: Career development Health care Medical leave Team events
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Research Scientist jobs
- Open Data Science Manager jobs
- Open Data Engineer II jobs
- Open Principal Data Scientist jobs
- Open Business Data Analyst jobs
- Open BI Analyst jobs
- Open Sr Data Engineer jobs
- Open Data Scientist II jobs
- Open Business Intelligence Engineer jobs
- Open Data Science Intern jobs
- Open Sr. Data Scientist jobs
- Open Senior Business Intelligence Analyst jobs
- Open Software Engineer, Machine Learning jobs
- Open Lead Data Analyst jobs
- Open Azure Data Engineer jobs
- Open Junior Data Scientist jobs
- Open MLOps Engineer jobs
- Open Data Analytics Engineer jobs
- Open Manager, Data Engineering jobs
- Open Marketing Data Analyst jobs
- Open Data Engineer III jobs
- Open Junior Data Engineer jobs
- Open Data Engineering Manager jobs
- Open Data Analyst II jobs
- Open ETL Developer jobs
- Open Data quality-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Excel-related jobs
- Open ML models-related jobs
- Open Data pipelines-related jobs
- Open APIs-related jobs
- Open PhD-related jobs
- Open PyTorch-related jobs
- Open LLMs-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open Deep Learning-related jobs
- Open Business Intelligence-related jobs
- Open Generative AI-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open DevOps-related jobs
- Open Kubernetes-related jobs
- Open Git-related jobs
- Open Hadoop-related jobs
- Open Docker-related jobs