Amazon launches TorchNeuron to run PyTorch code on Trainium chips without code changes

Amazon announced TorchNeuron, a free open‑source tool that lets developers run PyTorch models on its AWS Trainium AI chips with a single configuration change and no code rewrite. The software will be released at the PyTorch Conference on October 20 and is already being used by more than 30 early‑customer companies. Amazon says the tool lowers engineering effort and cost, positioning Trainium as a viable alternative to Nvidia’s CUDA‑based ecosystem.

Amazon says TorchNeuron will cut weeks of engineering time and reduce AI compute costs, helping customers adopt Trainium more easily. The move is intended to erode Nvidia’s software advantage in the AI chip market.

  • 1TorchNeuron runs existing PyTorch code on Trainium chips with no rewrite required.
  • 2TorchNeuron will be open‑sourced at the PyTorch Conference on October 20.
  • 3More than 30 early customers are using TorchNeuron, spanning robotics, world models and voice AI.
  • 4Amazon’s chip business, including Trainium, reported over $20 billion in annual revenue.
  • 5Colin Brace, vice president of software for Annapurna Labs, said the tool lets developers switch to Trainium with a basic configuration change.

Sources