Software Engineer II

Bengaluru, Karnataka, India

Apply now Apply later

Microsoft’s bold vision of Azure Machine Learning (ML) is to democratize ML and make it available to every enterprise, developer and data scientist. Do you want to join a team entrusted with serving all internal and external ML workloads? We are already serving billions of requests per day on the most cutting-edge scenarios and models across the company. You will be joining the Inference team that is working on the next generation of model serving that includes hosting OAI models like ChatGPT, hosting models at Bing and Office scale and many exciting problems on the intersection of AI and Cloud. We are looking for a strong Software Engineer who is passionate about designing and building highly reliable, available platform to support model inferencing at scale. You will also be expected to work on high throughput/low latency scenarios and drive performance optimization capabilities.


As a developer in the team, you will be responsible for designing, coding and testing components of the product, working closely with senior engineers and leaders. You would own the end-to-end life cycle of your features, from inception to managing it live on production.


Required Qualifications:

  • B Tech or M Tech in computer science, engineering, mathematics or a related field, or equivalent industry experience.
  • 6+ years of software development experience.

Preferred Qualifications:

  • Platform and capability development experience in Azure/Cloud strong plus.
  • Knowledge and experience in OSS, Docker, .NET, C#, java, Go, python or equivalent programming languages
  • Experience with ML platforms and frameworks.
  • Experience in distributed computing.
  • Good communication, collaboration skills and a great team player


Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.


Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.

Apply now Apply later
  • Share this job via
  • or

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  2  0  0
Category: Engineering Jobs

Tags: Azure ChatGPT Computer Science Docker Engineering GPT Java Machine Learning Mathematics Python Testing

Perks/benefits: Career development Medical leave

Region: Asia/Pacific
Country: India

More jobs like this

Explore more AI, ML, Data Science career opportunities

Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.