About the Role

This role is for a Machine Learning Compiler Engineer on the AWS Neuron team, focusing on building the next-generation compiler to optimize ML models for AWS Inferentia and Trainium chips. You will solve complex compiler optimization problems for large-scale models like LLMs and vision transformers, working with internal and external stakeholders to enhance performance and usability.

Key Responsibilities

• Design, implement, test, deploy, and maintain software solutions to improve Neuron compiler performance, stability, and user-interface.
• Solve hard compiler optimization problems to achieve optimum performance for various ML model families, including large language models and vision transformers.
• Work with chip architects, runtime/OS engineers, scientists, and ML Apps teams to deploy state-of-the-art ML models on AWS accelerators.
• Participate in design discussions, code reviews, and communicate with internal and external stakeholders, including open-source communities.
• Build innovative features to deliver the best possible experiences for developers using AWS Neuron.

Required Skills & Qualifications

Must Have:

• 3+ years of non-internship professional software development experience.
• 2+ years of non-internship design or architecture experience for new and existing systems.
• Experience programming with at least one software programming language.
• Experience in object-oriented languages like C++/Java.

Nice to Have:

• Master's degree or PhD in Computer Science or a related technical field.
• Experience in compiler design for CPU/GPU/Vector engines/ML-accelerators.
• Experience with OpenSource compiler toolset like LLVM/MLIR.
• Experience with technologies: PyTorch, OpenXLA, StableHLO, JAX, TVM, deep learning models, and algorithms.
• Experience with modern build systems like Bazel/CMake.

Benefits & Perks

• Inclusive team culture with employee-led affinity groups and learning experiences.
• Work-life balance with flexibility as part of the working culture.
• Mentorship and career growth opportunities with knowledge-sharing and development projects.
• Total compensation package including equity, sign-on payments, medical, financial, and other benefits.