About the Role

Senior Software Engineer building evaluation pipelines for Microsoft Copilot's AI models and features. Focuses on metrics, scorecards, and experimentation systems to measure and improve AI quality. Works at the intersection of science and engineering to deliver impactful AI-driven experiences.

Key Responsibilities

• Collaborates with stakeholders to determine user requirements
• Drives identification of dependencies and development of design documents
• Creates, implements, optimizes, debugs, and reuses code for performance and maintainability
• Leverages expertise to drive project plans and work items
• Acts as Designated Responsible Individual (DRI) to monitor and restore systems

Required Skills & Qualifications

Must Have:

• Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python OR equivalent experience
• 4+ years of experience building AI-powered products, data processing frameworks, or evaluation systems
• Ability to meet Microsoft, customer and/or government security screening requirements
• Pass Microsoft Cloud background check upon hire/transfer and every two years thereafter

Nice to Have:

• Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience OR Bachelor's Degree AND 8+ years technical engineering experience
• 4+ years of experience in evaluation systems

Benefits & Perks

• Industry leading healthcare