Apple

Latest AI news, models and releases from Apple. ['A19 Pro', 'Applebot-Extended', 'Apple Health', 'Apple Intelligence', 'Foundation Models framework', 'M3 Ultra', 'M5 Max', 'M5 Pro', 'M5 Ultra', 'M6', 'M7 Max', 'M7 Pro', 'Mac Studio', 'MLX', 'Qwen3-VL-8B', 'Siri']

Nativ: Running AI Models Locally on Mac

Developer Prince Canuma, creator of the MLX-VLM library, released the Nativ app for macOS that allows running AI models locally. The app provides a chat interface and an API server, and also finds already downloaded models from the Hugging Face cache.

AppleApple
Simon Willison24.07 · 06:03

Four Mac Studios combined into a cluster with 1.5 TB of memory – launched an AI that doesn't fit into a single graphics card

The author built a cluster of four Mac Studio computers with 1.5 TB of unified memory provided by Apple, using Exo 1.0 and RDMA over Thunderbolt 5. The cluster achieved 3.7 teraflops in HPL and successfully ran large AI models like Kimi K2 Thinking (600+ GB) and DeepSeek V3.1, showcasing the benefits of combined memory for heavy AI workloads.

AppleApple NVIDIANVIDIA ExoExo Moonshot AIMoonshot AI DeepSeekDeepSeek Alibaba/QwenAlibaba/Qwen
Habr — хаб ML24.07 · 04:03
Fresh news