NVIDIA Enterprise Reference Architectures Power AI factories
原文快照
展开 / 收起快照
Enterprise Reference Architectures
Build AI Factories That Scale
Turn your data center into a high-performance AI factory with NVIDIA Enterprise Reference Architectures.
Overview
The Building Blocks for AI Success
NVIDIA Enterprise Reference Architectures (Enterprise RAs) enable organizations to design, deploy, and scale high-performance AI factories using validated, repeatable infrastructure. These designs combine certified compute, high-speed east-west and north-south networking, observability tools, and software to ensure scalable performance, from four-node clusters to enterprise-scale environments.
Enterprise Reference Architectures
Your Guide to the Complete Family
A comprehensive suite of instructions for setting up clusters in the data center is now available.
Use Cases
Designed for Every Use Case
Accelerate agentic AI, physical AI, high-performance computing (HPC), and AI simulation workloads with proven NVIDIA Enterprise Reference Architectures and NVIDIA-Certified Systems from global partners. The primary infrastructure cluster configurations for deploying enterprise AI factories are outlined below.
-
NVIDIA RTX PRO AI Factory
-
NVIDIA HGX AI Factory
-
NVIDIA NVL72 AI Factory
NVIDIA RTX PRO AI Factory
The NVIDIA RTX PRO™ AI Factory configuration is designed for a broad spectrum of enterprise workloads, including generative and agentic AI, data analytics, visual computing, and engineering simulation. Deployments are optimized around 16- and 32-node design points, providing an ideal balance of performance, scalability, and deployment efficiency. Designed for universal workload acceleration across enterprise AI, simulation, and visual computing, NVIDIA RTX PRO Servers are optimized for PCIe environments, making them ideal for space-, power-, and cooling-constrained data centers. Purpose-built for modern AI workloads, they deliver efficient performance for agentic AI and large language model (LLM) inference.
NVIDIA HGX AI Factory
The high-performance NVIDIA HGX™ AI Factory configuration is purpose-built for multi-node AI training and inference at scale, leveraging NVIDIA HGX systems. Available in 32-, 64-, and 128-node design points and supported by NVIDIA Spectrum-X™ networking, the architecture features a flexible, rail-optimized design that enables efficient integration across diverse rack layouts while delivering high-throughput, low-latency performance. It provides breakthrough performance for AI power users running the most demanding workloads, enables large-scale model training and fine-tuning, and dramatically accelerates inference. With next-generation precision and ultra-fast interconnects, the solution achieves up to 15x higher token throughput.
NVIDIA NVL72 AI Factory
The NVIDIA NVL72 AI Factory configuration is designed to train and deploy trillion-parameter models, delivering exascale computing power within a single rack. Built for massive model throughput, multi-user inference, and real-time inference at scale, it enables the next generation of AI-driven innovation. Deployment design points center on four- and eight-rack configurations. Built on a flexible, rail-optimized network, the architecture adapts to diverse rack layouts and system designs while delivering high-bandwidth, low-latency performance. The platform delivers exceptional AI factory output with industry-leading energy efficiency and is powered by fifth-generation NVIDIA NVLink™, FP4 Tensor Cores, and advanced thermal innovations.
Benefits
The Strategic Value of Enterprise RAs
Unlock scalable, high-performance AI infrastructure with proven, partner-ready configurations.
Peak Performance for AI Workloads
Meet the intensive demands of AI inference, fine-tuning, and training with architectures that ensure full GPU utilization and performance consistency across multi-node clusters.
Flexible Scaling, Simplified Operations
Easily expand your infrastructure and ensure scalable, streamlined deployment for up to 128 nodes. Build the foundation for full-stack solutions with the NVIDIA Enterprise AI Factory validated design, which leverages our software ecosystem.
Reduce Complexity and TCO
Simplify deployment processes and efficient designs, reduce complexity and total cost of ownership (TCO), while reducing time to value.
Supportability
Follow specific, standardized design patterns to achieve consistent operation from one installation to the next, reduce the need for frequent support, and enable faster resolution times.
Partners
Partnered for Performance
We’re proud to collaborate with leading partners as they bring Enterprise Reference Architectures and AI factory solutions to market. Endorsed designs from these partners have passed our Design Review Board, offering guidance that earns our endorsement in one or more of the following categories: infrastructure, networking logic, and software.
Palantir Sovereign AI OS Reference Architecture With NVIDIA
The Palantir Sovereign AI OS Reference Architecture is based on NVIDIA Enterprise RAs, tested and qualified to run Palantir's complete software suite on NVIDIA AI infrastructure with our global system partners. This sovereign AI architecture is critical for customers with latency-sensitive workflows, data sovereignty requirements, and high geographic distribution. The architecture provides enterprises with total control over their data, AI models, and applications.
Resources
Learn More About Enterprise RAs
NVIDIA’s AI Factory Drives Enterprise Innovation at Scale
NVIDIA built a unified AI factory to scale generative AI and agentic workflows across the enterprise, ensuring security, performance, and consistency. The platform supports hundreds of AI agents that accelerate innovation, streamline software and hardware engineering, and optimize supply chain operations—reducing planning times by over 95 percent and achieving decades’ worth of engineering work in just one year.
Next Steps
Cisco is the worldwide technology leader that is revolutionizing the way organizations connect and protect in the AI era. For more than 40 years, Cisco has securely connected the world. With its industry-leading AI-powered solutions and services, Cisco enables its customers, partners, and communities to unlock innovation, enhance productivity, and strengthen digital resilience. With purpose at its core, Cisco remains committed to creating a more connected and inclusive future for all.
NVIDIA Design Review Board-endorsed solutions:
Dell Technologies helps organizations and individuals build their digital future and transform how they work, live, and play. The company provides customers with the industry’s broadest and most innovative technology and services portfolio for the AI era.
NVIDIA Design Review Board-endorsed solutions:
HPE is a leader in essential enterprise technology, bringing together the power of AI, cloud, and networking to help organizations achieve more. As pioneers of possibility, our innovation and expertise advance the way people live and work. We empower our customers across industries to optimize operational performance, transform data into foresight, and maximize their impact. Unlock your boldest ambitions with HPE.
NVIDIA Design Review Board-endorsed solutions:
Lenovo is a US$69B revenue global technology powerhouse, ranked #196 in the Fortune Global 500, and serving millions of customers every day in 180 markets. Focused on a bold vision to deliver Smarter Technology for All, our ongoing partnership with NVIDIA combines Lenovo servers with accelerated GPUs. The Lenovo Hybrid AI Advantage™ with NVIDIA boosts productivity and innovation with faster AI deployment, powered by the Lenovo AI Library and a full-stack portfolio of AI infrastructure, devices, solutions, and services.
NVIDIA Design Review Board-endorsed solutions:
Supermicro is a global leader in application-optimized total IT solutions. Founded and operating in San Jose, California, Supermicro is committed to delivering first-to-market innovation for enterprise, cloud, AI, and 5G telco/edge IT infrastructure. We are a total IT solutions provider with server, AI, storage, IoT, switch systems, software, and support services. Supermicro’s motherboard, power, and chassis design expertise further enables our development and production, enabling next-generation innovation from cloud to edge for our global customers.
NVIDIA Design Review Board-endorsed solutions: