Senior Software Engineer, AI Infrastructure
Redmond, Washington, United States
Full Time Senior-level / Expert USD 112K - 238K
Microsoft
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.
Microsoft’s Bing Platform Engineering team is seeking a Senior Software Engineer, AI Infrastructure to join us in blazing the trail for developing the world-leading artificial intelligence (AI) infrastructure at datacenter scale. By leveraging the massive parallelism delivered by current and future computing hardware (e.g., GPUs and Brainwave FPGAs), the team accelerates many types of deep neural network (DNN) workloads, including large-scale inference and training. We are applying the accelerated computing to challenging applications important to Microsoft and our customers, including but not limited to Bing search. Our work includes developing, optimizing, deploying, and maintaining our machine learning (ML) accelerator software, infrastructure, and tools. Working with Microsoft model developers and data scientists to deploy their models gives us the unusual opportunity of working across the whole DNN stack, from cutting-edge DNN models, techniques, and frameworks to accelerator architecture. This cutting-edge development takes place in the context of a live, global-scale distributed system that touches millions of users daily.
Responsibilities
- Understand different DNN workloads (e.g., Transformers and LLMs) and map them efficiently to the underlying system and hardware architecture.
- Apply state-of-the-art AI and machine learning techniques to build and optimize the system to continuously achieve improved performance and user experience.
- Participate in/lead designs, and write production-level, quality code.
- Deploy and maintain software to meet significant reliability and service level requirements.
- Work in a team of software and hardware engineers to deploy working systems to a very large user base.
Qualifications
Required Qualifications:
- Bachelor's Degree in Computer Science, or related technical discipline AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
Preferred Qualifications:
- Familiarity with neural networks, ML frameworks (e.g., PyTorch and Tensorflow), and inference/training optimization techniques.
- Experience developing ML algorithms or system infrastructure in C/C++ and
- Software development experience, particularly in distributed and/or fault-tolerant systems.
- Previous software development experience in all stages of a release cycle (design, implement, and test) with ability to cover multiple job roles.
- Experience in LLM finetuning is preferred.
- Proficiency in GPU programming (e.g., CUDA) and familiarity with CUDA libraries, OR in FPGA hardware and application development, is preferred.
- Experience with container and orchestration technologies (e.g., Kubernetes, Docker) is a plus.
Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $112,000 - $218,400 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $145,800 - $238,600 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay
Microsoft will accept applications for the role until May 3, 2024.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.
Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
#WWE
Tags: Architecture Computer Science CUDA Docker Engineering FPGA GPU Java JavaScript Kubernetes LLMs Machine Learning ML infrastructure Python PyTorch TensorFlow Transformers
Perks/benefits: Career development Medical leave
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Manager jobs
- Open Marketing Data Analyst jobs
- Open Lead Data Analyst jobs
- Open Data Engineer II jobs
- Open Senior Business Intelligence Analyst jobs
- Open MLOps Engineer jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Data Analytics Engineer jobs
- Open Junior Data Scientist jobs
- Open Business Data Analyst jobs
- Open Sr Data Engineer jobs
- Open Product Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Research Scientist jobs
- Open Big Data Engineer jobs
- Open Azure Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Data Quality Analyst jobs
- Open Manager, Data Engineering jobs
- Open Data Product Manager jobs
- Open Data quality-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open APIs-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open LLMs-related jobs
- Open CI/CD-related jobs
- Open Snowflake-related jobs
- Open Generative AI-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Databricks-related jobs