Baidu Baige launches 64B world model on 512 cards without NVLink
Baidu
Baidu Baige has launched a 64B parameter world model that runs on 512 GPUs without requiring NVLink interconnects. This achievement highlights advancements in distributed AI training.
Baidu Baige, a subsidiary of Baidu, announced the launch of a 64-billion parameter world model. The model was trained and is deployed on 512 graphics cards without using NVLink, which typically connects GPUs in clusters. This demonstrates Baidu's progress in large-scale distributed computing and AI model efficiency.
- Сокращения
- NVLink = NVIDIA NVLink — высокоскоростной межсоединитель NVIDIA
Source: Baidu ERNIE (GNews) —
original