About the Role

This AI Software Engineer II role involves developing and deploying AI-powered applications and services, focusing on large language models and deep learning. The engineer will work on Agent Cloud, an enterprise solution for managing AI agents within the M365 ecosystem, requiring collaboration across teams and full-stack development skills.

Key Responsibilities

• Implement, evaluate, and deploy AI-powered applications and services
• Develop and fine-tune large language models (LLMs) and other deep learning models
• Write clean, maintainable, and scalable code for model training, evaluation, and inference pipelines
• Optimize AI models for performance, latency, and cost efficiency in production environments
• Apply prompt engineering to enhance model outputs and performance

Required Skills & Qualifications

Must Have:

• Bachelors degree in computer science or related technical discipline
• Experience coding in one or more high level languages including Python, C#, Java
• Proven experience in developing and deploying large language models (LLMs)
• Practical experience in prompt engineering and evaluation

Nice to Have:

• Experience with Agent based architectures, frameworks and technologies (such as MCP, A2A protocol, Langchain, Azure AI Foundry)
• Proficiency in Python for data science workflows with libraries like NumPy, Pandas, scikit-learn
• Exposure to Deep Neural Network training and inference and experience in deep learning frameworks (PyTorch, TensorFlow)

Benefits & Perks

• Industry leading healthcare