NVIDIA

Latest AI news, models and releases from NVIDIA. ['A100', 'AI Aerial', 'AI platform', 'Alpamayo', 'B200', 'B300', 'BioNeMo', 'BioNeMo Agent Toolkit', 'Blackwell', 'Blackwell NVL72', 'Blackwell Ultra', 'BlueField-4', 'BlueField-4 DPU', 'BlueField-4 STX', 'Boltz-2', 'Canary-Qwen-2.5B', 'CMX', 'ConnectX-9', 'ConnectX-9 SuperNIC', 'Cosmos', 'Cosmos 3 Edge', 'Cosmos 3 Edge Policy (DROID)', 'Cosmos 3 Nano', 'Cosmos 3 Super', 'Cosmos 3 Super 4-Step Distillation', 'Cosmos-Dreams', 'Cosmos-H Dreams', 'Cosmos-H-Dreams', 'Cosmos-H-Surgical-Simulator', 'Cosmos-Predict2.5-2B', 'Cosmos-Reason2-2B', 'CUDA', 'DeepSeek-R1', 'DeepSeek V4', 'DeepSeek V4 Pro', 'DGX GB300', 'DGX Spark', 'DGX SuperPOD', 'DGX Vera Rubin NVL72', 'DPU BlueField-4']

Open Source 🇺🇸

NVIDIA NeMo AutoModel Accelerates MoE Fine-Tuning 3.7x with Expert Parallelism and DeepEP

NVIDIA has introduced NeMo AutoModel, an open library that builds on Hugging Face Transformers v5, delivering 3.4-3.7x higher training throughput and 29-32% less GPU memory for MoE models via Expert Parallelism, DeepEP fused all-to-all dispatch, and TransformerEngine kernels—using the same from_pretrained() API with only an import change.

NVIDIANVIDIA Hugging FaceHugging Face Moonshot AIMoonshot AI DeepSeekDeepSeek
Hugging Face blog27.07 · 10:04
Fresh news