About the Role

Principal Data Platform Architect role at Microsoft AI, focusing on architecting and implementing a highly scalable data platform processing 50TB+ daily from AI systems. Requires deep expertise in big data technologies, cloud platforms, and distributed systems to build resilient, extensible platforms.

Key Responsibilities

• Thought leader and owner of the architecture blueprint of data platform
• Superior coding skills in SPARK using Scala, Python and Java
• Work collaboratively with other engineers and AI Researchers to build next generation data platform services
• Ship high-quality, well-tested, secure, and maintainable code
• Find a path to get things done despite roadblocks to get work into users' hands quickly

Required Skills & Qualifications

Must Have:

• Bachelor's Degree in Computer Science or related field AND 8+ years' experience in software development/data engineering (or equivalent)
• 5+ years building large-scale data processing platforms with 100+ data pipelines
• 5+ years building data pipelines using Scala, Python (PySpark), SQL, and big data technologies (Hadoop, Spark, Kafka, databases)
• 5+ years designing and deploying scalable services on public cloud platforms (Azure, AWS, GCP)
• 2+ years architecting distributed systems at scale across infrastructure, containerization, and networking

Nice to Have:

• 10+ years technical engineering experience building data platforms handling large volumes of data in batch and real time
• Ability to identify, analyze, and resolve complex technical issues for performance and scalability
• Dedication to writing clean, maintainable, well-documented code with focus on quality and security
• Demonstrated interpersonal skills and ability to work with cross-functional teams
• Ability to clearly communicate complex technical concepts to technical and non-technical stakeholders

Benefits & Perks

• Industry leading healthcare