ML Compiler Engineer , AWS Neuron, Annapurna Labs

About the Role

The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon’s custom machine learning accelerators, Inferentia and Trainium. The Neuron Compiler team constructs a deep learning compiler stack that allows state‑of‑the‑art large language, vision, and multi‑modal models created in TensorFlow, PyTorch, and JAX to run efficiently on the accelerators.

Responsibilities

Our performance engineers collaborate across compiler, runtime, and framework teams to optimize machine learning workloads for our global customer base. They:

• Analyze and optimize system‑level performance of machine learning models across the entire technology stack, from frameworks to runtime.
• Conduct detailed performance analysis and profiling of ML workloads, identifying and resolving bottlenecks in large‑scale ML systems.