Same AI, Different Costs: Framework Choice Changes Price Almost Threefold

The AI tooling company Composio tested Deepseek V4 Flash in four different agent frameworks: Claude Code, Codex, OpenCode, and Oh My Pi. They ran 30 tasks using real tools like Gmail, GitHub, Slack, and Notion. The result: no framework was best in all categories. Oh My Pi achieved the highest success rate (17 out of 30) but was the slowest (272 seconds per task). OpenCode was the cheapest (0.073 dollars per successful task), Claude Code was the fastest (122 seconds) but the most expensive (0.195 dollars), despite using the fewest tool calls and output tokens. Seven tasks succeeded or failed solely depending on the framework used. Overall, success rates were close, with OpenCode slightly lower at 14 out of 30. The biggest differences were in price and speed: framework choice changed costs by almost threefold and speed by 2.2 times.