Trainium3 UltraServers Now Available: Enabling Customers to Train and Deploy AI Models Faster at Lower Cost

Trainium3 UltraServers Now Available: Enabling Customers to Train and Deploy AI Models Faster at Lower Cost

Amazon EC2 Trn3 UltraServers powered by AWS's first 3nm AI chip help organizations of all sizes run their most ambitious AI training and inference workloads

At AWS re:Invent, Amazon Web Services, Inc. (AWS), an Amazon.com, Inc. company (NASDAQ: AMZN), today announced the general availability of Trainium3 UltraServers powered by the new Trainium3 chip.

Key takeaways

  • Trainium3 UltraServers deliver high performance for AI workloads with up to 4.4x more compute performance, 4x greater energy efficiency, and almost 4x more memory bandwidth than Trainium2 UltraServers—enabling faster AI development with lower operational costs.
  • Trn3 UltraServers scale up to 144 Trainium3 chips, delivering up to 362 FP8 PFLOPs with 4x lower latency to train larger models faster and serve inference at scale.
  • Customers including Anthropic, Karakuri, Metagenomi, NetoAI, Ricoh, and Splash Music are reducing training and inference costs by up to 50% with Trainium, while Decart is achieving 4x faster inference for real-time generative video at half the cost of GPUs, and Amazon Bedrock is already serving production workloads on Trainium3.

To get the full story on AWS Trainium3 UltraServers, visit About Amazon .

About AWS

Amazon Web Services (AWS) is guided by customer obsession, pace of innovation, commitment to operational excellence, and long-term thinking. By democratizing technology for nearly two decades and making cloud computing and generative AI accessible to organizations of every size and industry, AWS has built one of the fastest-growing enterprise technology businesses in history . Millions of customers trust AWS to accelerate innovation, transform their businesses, and shape the future. With the most comprehensive AI capabilities and global infrastructure footprint, AWS empowers builders to turn big ideas into reality. Learn more at aws.amazon.com and follow @AWSNewsroom .

Amazon.com, Inc.
Media Hotline
Amazon-pr@amazon.com
www.amazon.com/pr

News Provided by Business Wire via QuoteMedia

AMZN
The Conversation (0)
National Safety Council Releases New Report on Diversity, Equity and Inclusion and Workplace Injury Prevention

National Safety Council Releases New Report on Diversity, Equity and Inclusion and Workplace Injury Prevention

Research paper examines why diversity, equity and inclusion should be a foundational element of musculoskeletal disorder prevention and provides equitable solutions to minimize worker risks While efforts have been made in recent years to increase workplace safety through regulations, innovative... Keep Reading...
Swift Navigation Runs Its ISO 26262 Certified Skylark Precise Positioning Service on AWS

Swift Navigation Runs Its ISO 26262 Certified Skylark Precise Positioning Service on AWS

Swift Navigation a leader in precise positioning technologies for automotive, IoT, and mobile applications, today announced its use of Amazon Web Services, Inc. (AWS), an Amazon.com, Inc. company (NASDAQ: AMZN), to help support running Swift's Skylark® Precise Positioning Service workloads.... Keep Reading...
Amazon Announces Grubhub+ as Ongoing Prime Member Offer; Customers Can Now Order Grubhub Directly from Amazon.com and the Amazon Shopping App

Amazon Announces Grubhub+ as Ongoing Prime Member Offer; Customers Can Now Order Grubhub Directly from Amazon.com and the Amazon Shopping App

Prime members enjoy $0 delivery fees on eligible orders, lower service fees, 5% credit back on pick-up orders, and exclusive Grubhub offers with Grubhub+—a $120 annual value For a limited time, Prime members can also save $5 on a Grubhub order over $25 from now through June 2 Amazon (NASDAQ:... Keep Reading...
AWS and SAP Unlock New Innovation with Generative AI

AWS and SAP Unlock New Innovation with Generative AI

Generative AI hub in SAP AI Core integrates with foundation models in Amazon Bedrock to deliver generative AI-driven insights and streamline manual processes for enterprise customers Amazon Web Services (AWS), an Amazon.com company (NASDAQ: AMZN), and SAP SE (NYSE: SAP) today announced an... Keep Reading...
Amazon Opens New Robotics Fulfilment Centre in Calgary, Alberta

Amazon Opens New Robotics Fulfilment Centre in Calgary, Alberta

New 2.8 million square foot facility offers unique career development opportunities for employees, with innovative technology that increases delivery speeds Amazon is proud to announce the grand opening of its newest robotics fulfilment centre, YYC4, in Calgary, Alberta . Measuring 2.8 million... Keep Reading...

Latest Press Releases

Related News