NVIDIA Collaborates with Microsoft to Build Massive Cloud AI Computers
Tens of Thousands of NVIDIA GPUs, NVIDIA Quantum-2 InfiniBand and Full Stack of NVIDIA AI Software Now Available on Azure, Platform NVIDIA, Microsoft and Global Enterprises to Enable Rapid and Cost-Effective AI Development and Deployment exercise
(https://www.nvidia.com/en-us/data-center/products/ai-enterprise/) software suite is added to its platform.
As part of the collaboration, NVIDIA will leverage Azure’s scalable virtual machine instances to research and further accelerate the evolution of generative AI. Generative AI is a rapidly emerging field and the Megatron Turing NLG 530B
(https://developer.nvidia.com/blog/using-deepspeed-and-megatron-to-train-megatron-turing-nlg-530b-the- The worlds-largest-and-most-powerful-generative-language-model/ ) is the basis for unsupervised self-learning algorithms to generate new text, code, digital images and video/audio.
Both companies are using Microsoft’s DeepSpeed
(https://developer.nvidia.com/blog/using-deepspeed-and-megatron-to-train-megatron-turing-nlg-530b-the-worlds-largest-and-most-powerful -generative-language-model/ ) We also plan to collaborate on optimizing deep learning optimization software. NVIDIA’s full-stack AI workflows and software development kits optimized for Azure will also be available to Azure enterprise customers.
Manuvir Das, vice president of enterprise computing at NVIDIA, said: “Not only are AI technologies advancing, but their adoption in industry is also accelerating. The breakthrough in underlying models has caused a major shift in research, fostering new startups and making it available to new companies. Our collaboration with Microsoft will provide researchers and companies with cutting-edge AI
infrastructure and software to harness the transformative power of AI.”
Scott Guthrie, executive vice president of Microsoft’s Cloud + AI Group, said: “AI is powering the next wave of automation across computing in enterprises and industries, enabling organizations to do more with less as they navigate economic uncertainty. Our
collaboration will unlock the world’s most scalable supercomputer platform, delivering cutting-edge AI capabilities to all enterprises on Microsoft Azure.”
Scalable peak performance with NVIDIA compute on Azure and Quantum-2 InfiniBand AI-optimized virtual machine instances in Microsoft Azure are designed with NVIDIA’s leading data center GPUs and are the first public cloud instances to incorporate NVIDIA Quantum-2 400Gb/s InfiniBand networking. Customers can deploy thousands of GPUs in a single cluster to train massive amounts of large language models, build the most complex recommender systems at scale, and leverage generative AI at scale. increase.
Current Azure instances feature NVIDIA A100 GPUs and NVIDIA Quantum 200Gb/s InfiniBand networking. Future instances will integrate NVIDIA Quantum-2 400Gb/s InfiniBand networking and NVIDIA H100 GPUs. Combined with Azure’s advanced compute cloud infrastructure, networking, and storage, these AI-optimized instances deliver scalable peak
performance for AI training and deep learning inference workloads of any scale. Offers.
Accelerating AI development and deployment
Additionally, the platform supports a wide range of AI applications and services, including Microsoft DeepSpeed and the NVIDIA AI Enterprise software suite.
Microsoft DeepSpeed leverages the NVIDIA H100 Transformer Engine (https://blogs.nvidia.co.jp/2022/04/07/h100-transformer-engine/) to generate large-scale language models, generative AI, and computer code Accelerate Transformer-based models used for applications such as describing This technology applies 8-bit floating-point precision capabilities to DeepSpeed to dramatically speed up Transformer’s AI calculations, delivering twice the throughput of 16-bit instructions. NVIDIA AI Enterprise, the software for the world’s most deployed NVIDIA AI platform, is certified and supported on Microsoft Azure instances powered by NVIDIA A100 GPUs. Support for Azure instances with NVIDIA H100 GPUs will be added in a future software release. NVIDIA AI Enterprise, including NVIDIA Riva for speech AI and the NVIDIA Morpheus cybersecurity application framework, streamlines each step of the AI workflow, from data processing and AI model training to simulation and large-scale deployment.
For more information on NVIDIA’s AI technologies on Azure, please visit our partner page
(https://www.nvidia.com/en-us/data-center/gpu-cloud-computing/microsoft-azure/). About NVIDIA
NVIDIA’s (NASDAQ: NVDA) invention of the GPU in 1999 sparked the growth of the PC gaming market and redefined modern computer graphics, high performance computing and artificial intelligence (AI). NVIDIA’s pioneering work in accelerated computing and AI is reshaping trillion-dollar industries like transportation, healthcare, and manufacturing, as well as accelerating the expansion of many others. For more information, follow this link: https://nvidianews.nvidia.com/ Details about this release: