OpenAI

Latest AI news, models and releases from OpenAI. ['Atlas', 'ChatGPT', 'ChatGPT Codex', 'ChatGPT Enterprise', 'ChatGPT-Live', 'ChatGPT-User', 'ChatGPT Work', 'Claude Fable 5', 'CLIP', 'Codex', 'Codex CLI', 'Codex Micro', 'Codex Security CLI', 'DALL-E', 'DALL-E 2', 'DALL-E 3', 'DALL·E 3', 'GPT', 'GPT-2', 'GPT2', 'GPT-3', 'GPT 3.5', 'GPT-3.5', 'gpt-3.5-turbo', 'GPT-3.5-turbo', 'GPT-3.5 Turbo', 'GPT-3-XL', 'GPT-4', 'gpt-4.1', 'GPT-4.1', 'gpt-4.1-mini', 'GPT-4 (ChatGPT)', 'GPT4-o', 'gpt-4o', 'GPT-4o', 'GPT-4o-0806', 'GPT-4o mini', 'GPT-4o-mini', 'GPT-4 Turbo', 'GPT-4V(ision)']

Official site ↗

Research 🇷🇺

Writing a Decoder-Only Transformer for LLM from Scratch in Python

The author of a series of articles describes in detail the implementation of a transformer block for a small decoder-only LLM using the PyTorch framework. Components covered include: masked Multi-Head Attention, Feed Forward Network with GELU, normalization layer, and residual connections. The article explains the difference from the original architecture: pre-normalization (Pre-LN) is used instead of post-normalization for training stability.

Google/DeepMind

OpenAI

AI Scorecard System from OpenAI's CFO

Sarah Friar, CFO of OpenAI, proposed a practical AI scorecard system for measuring return on investment. Key metrics: useful work, cost per successful task, reliability, and computational return.

OpenAI

OpenAI27.07 · 20:04

Show more ↓