Software Development Manager - NKI, AWS Neuron, Annapurna Labs
A
Amazon
📍 Cupertino, CA, United States
Job Description
Description
The Product: AWS Machine Learning accelerators are at the forefront of AWS innovation. Trainium delivers best-in-class ML training performance with the most teraflops (TFLOPS) of compute power for ML in the cloud. This is all enabled by the AWS Neuron Software Development Kit (SDK), which includes an ML compiler, the Neuron Kernel Interface (NKI) compiler, and a runtime that natively integrates into popular ML frameworks such as PyTorch and JAX.
Neuron Kernel Interface (NKI) is a bare-metal language and compiler for directly programming NeuronDevices available on AWS Trainium instances. You can use NKI to develop, optimize, and run new operators directly on NeuronCores while making full use of available compute and memory resources.
Explore NKI:
- https://awsdocs-neuron.readthedocs-hosted.com/en/latest/nki/index.html
AWS Neuron is used at scale by customers such as Epic Games, Snap, Airbnb, Autodesk, Amazon Alexa, and Amazon Rekognition, alo...
The Product: AWS Machine Learning accelerators are at the forefront of AWS innovation. Trainium delivers best-in-class ML training performance with the most teraflops (TFLOPS) of compute power for ML in the cloud. This is all enabled by the AWS Neuron Software Development Kit (SDK), which includes an ML compiler, the Neuron Kernel Interface (NKI) compiler, and a runtime that natively integrates into popular ML frameworks such as PyTorch and JAX.
Neuron Kernel Interface (NKI) is a bare-metal language and compiler for directly programming NeuronDevices available on AWS Trainium instances. You can use NKI to develop, optimize, and run new operators directly on NeuronCores while making full use of available compute and memory resources.
Explore NKI:
- https://awsdocs-neuron.readthedocs-hosted.com/en/latest/nki/index.html
AWS Neuron is used at scale by customers such as Epic Games, Snap, Airbnb, Autodesk, Amazon Alexa, and Amazon Rekognition, alo...