Automatic Blame Attribution in LLM-Based Multi-Agent Systems: New Research
Researchers from Penn State University and Duke University, in collaboration with Google DeepMind, introduced the task of automatic fault attribution in LLM-based multi-agent systems. They developed the Who&When benchmark with 127 fault logs and three attribution methods (All-at-Once, Step-by-Step, Binary Search). Experiments showed that even the best models (GPT-4o, o1, DeepSeek R1) perform poorly: accuracy in identifying the responsible agent is about 53.5%, and the error step is only 14.2%.
Google/DeepMind
Google DeepMind
OpenAI
DeepSeek






