About the Role

This role involves building AI Agent platforms and agentic experiences for Dynamics 365, focusing on evals and experimentation. The engineer will work across the stack to deliver scalable agent platform features and own evaluation pipelines for continuous improvement.

Key Responsibilities

• Develop features with a focus on quality, usability & performance
• Participate in livesite operations with emphasis on timely response and stakeholder satisfaction
• Work across the stack to lead delivery of end-to-end agent platform features
• Own evaluations and experimentation pipelines for A/B testing and product decisions
• Build and maintain evaluation suites for agents and integrate into CI/CD

Required Skills & Qualifications

Must Have:

• Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python OR equivalent experience
• 1+ year of experience building cloud-based SaaS applications
• 1+ year of experience with coding, debugging, design, testing, and problem-solving
• Ability to pass Microsoft Cloud background check upon hire/transfer and every two years

Nice to Have:

• Experience with Dynamics 365 Finance & Operations or other ERP/CRM software
• Experience in building cloud-based SaaS applications
• Experience with microservices principles
• Experience with X++, C#, Java, Python, JavaScript, TypeScript, and SQL
• Experience with MCP servers, analytics, or agent evaluation frameworks

Benefits & Perks

• Industry leading healthcare