About the Role

Senior Software Engineer role in CoreAI building the AI data-plane for LLM inferencing across Microsoft and Azure. Responsible for designing and delivering scalable, high-performance AI services that power Microsoft's AI strategy. Focus on innovation, reliability, and ultra-low latency serving of models.

Key Responsibilities

• Drive innovation on critical Azure service underpinning Microsoft's AI vision
• Design, implement and deliver AI services for large-scale LLM serving
• Innovate on technical solutions to improve availability, reliability, efficiency, and performance
• Ship new product features and improvements at high velocity
• Engage with customers to gather feedback and resolve complex issues

Required Skills & Qualifications

Must Have:

• Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including C, C++, C#, Java OR equivalent experience
• 4+ years of design and problem-solving experience with deep understanding of system performance, scalability, and engineering best practices
• Ability to meet Microsoft, customer and/or government security screening requirements including Microsoft Cloud Background Check

Nice to Have:

• Understanding of distributed systems specifically in request serving at scale, including high-performance storage, distributed databases, and networking across global-scale infrastructures
• Experience shipping with a high velocity and iterative approach
• Demonstrated experience in building high-quality, reliable systems at scale
• Proven ability to lead complex technical initiatives that span multiple teams and disciplines
• Customer-obsessed approach to problem solving with empathy and drive to deliver impactful solutions

Benefits & Perks

• Industry leading healthcare