Open SourceHardware & Inference 🇺🇸 27.07.2026 04:06

Hugging Face and Microsoft Foundry: Open Models on Managed GPUs

MicrosoftMicrosoft Hugging FaceHugging Face OpenAIOpenAI AnthropicAnthropic MetaMeta MistralMistral DeepSeekDeepSeek
Hugging Face and Microsoft Foundry have partnered to bring open-weight models from the Hugging Face ecosystem to the Foundry platform, providing managed GPU compute. The curated Hugging Face Collection offers security-screened models across modalities, with deployment templates and automated runtime management. This enables enterprises to deploy open models with the same ease as proprietary models on Foundry.
Hugging Face and Microsoft Foundry have launched a collaboration to host open-weight models from the Hugging Face ecosystem on the Foundry platform, which provides managed GPU compute as a service. The Hugging Face Collection is a curated subset of models refreshed weekly, covering text, vision, audio, and multimodal modalities, all security-screened and using the SafeTensors format. Models are deployed via templates that specify runtime, accelerator family, and context length, with runtimes including vLLM, SGLang, TensorRT-LLM, NIM, TEI, and llama.cpp. The curation pipeline involves identifying trending models, compliance and security screening, building and scanning runtime images, uploading weights to Azure storage, and validating API conformance and performance before publishing to the Foundry Model Catalog. Deployments are managed by Microsoft, with automatic container updates, runtime upgrades, and security patches. The service supports global and data zone deployments, and allows mixing open and frontier models within the same agent. The partnership aims to bridge the gap between open model flexibility and enterprise operational needs.
Сокращения
GPU = Graphics Processing Unit — графический процессор
SDK = Software Development Kit — набор средств разработки
API = Application Programming Interface — интерфейс программирования приложений
LLM = Large Language Model — большая языковая модель
VLM = Vision Language Model — модель, понимающая изображения и текст
ASR = Automatic Speech Recognition — автоматическое распознавание речи
RAG = Retrieval-Augmented Generation — генерация с дополнением через поиск
RBAC = Role-Based Access Control — управление доступом на основе ролей
CVE = Common Vulnerabilities and Exposures — общие уязвимости и экспозиции
REST = Representational State Transfer — передача состояния представления
CLI = Command-Line Interface — интерфейс командной строки
Source: Hugging Face blog — original
Our earlier posts on this topic ↓
Fresh news