Hugging Face

Latest AI news, models and releases from Hugging Face. ['Diffusers', 'GLM 5.2', 'LeRobot v0.6.0', 'Nunchaku Lite', 'qwen3-32b', 'Qwen/Qwen3-4B', 'Qwen/Qwen3.5-122B-A10B', 'Qwen/Qwen3.5-4B', 'SmolLM', 'SmolLM2-1.7B', 'SmolLM3', 'SmolLM3 3B', 'SmolLM3-3B', 'SmolVLM-256M', 'TinyLlama', 'tokenizers', 'Transformers v4', 'Transformers v5', 'TRL', 'Xenova/distilbert-base-uncased-finetuned-sst-2-english', 'Xenova/whisper-tiny.en']

Research 🇺🇸

Beyond Standard LLMs: Linear Attention Hybrids, Text Diffusion, Code World Models, and Small Recursive Transformers

The article by Sebastian Raschka explores alternatives to standard autoregressive transformer LLMs, including linear attention hybrids (e.g., MiniMax-M1, Qwen3-Next, DeepSeek V3.2, Kimi Linear), text diffusion models, code world models, and small recursive transformers. It discusses the revival of linear attention mechanisms and challenges, such as MiniMax reverting to standard attention in its M2 model due to poor performance on reasoning tasks.

Moonshot AIMoonshot AI MiniMaxMiniMax Alibaba/QwenAlibaba/Qwen DeepSeekDeepSeek Google/DeepMindGoogle/DeepMind MistralMistral MetaMeta Hugging FaceHugging Face Allen Institute for AIAllen Institute for AI xAIxAI OpenAIOpenAI IBMIBM NVIDIANVIDIA
Sebastian Raschka27.07 · 17:04
Regulation 🇨🇳

Nvidia, Microsoft, IBM and Dozens of Other Companies Form AI Safety Alliance

Nvidia, Microsoft, IBM, Adobe, SAP and other companies have announced the formation of the Open Alliance for AI Safety (OASIS). The alliance will focus on developing and distributing open tools for the safe and responsible use of AI.

NVIDIANVIDIA MicrosoftMicrosoft IBMIBM SAPSAP DellDell Cisco SystemsCisco Systems Cadence Design SystemsCadence Design Systems Capital OneCapital One ClouderaCloudera CloudflareCloudflare CognitionCognition CrowdStrikeCrowdStrike DatabricksDatabricks DoorDashDoorDash ElasticElastic Hugging FaceHugging Face LangChainLangChain Linux FoundationLinux Foundation NetAppNetApp Nous ResearchNous Research PalantirPalantir Palo Alto NetworksPalo Alto Networks Red HatRed Hat SalesforceSalesforce SK TelecomSK Telecom SiemensSiemens SnowflakeSnowflake Synopsys, Inc.Synopsys, Inc.
36Kr27.07 · 13:03
Fresh news