A telecom-oriented tool benchmark that measures structured tool use in domain workflows.
BenchLM mirrors the published score view for Tau2-Telecom. Step 3.7 Flash leads the public snapshot at 98.5% , followed by GLM-5V-Turbo (98.5%) and GLM-5-Turbo (98.5%). BenchLM does not use these results to rank models overall.
Step 3.7 Flash
StepFun
GLM-5V-Turbo
Z.AI
GLM-5-Turbo
Z.AI
The published Tau2-Telecom snapshot is tightly clustered at the top: Step 3.7 Flash sits at 98.5%, while the third row is only 0.0 points behind. The broader top-10 spread is 2.6 points, so many of the published scores sit in a relatively narrow band.
117 models have been evaluated on Tau2-Telecom. The benchmark falls in the Agentic category. This category carries a 22% weight in BenchLM.ai's overall scoring system. Tau2-Telecom is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
Year
2026
Tasks
Telecom tool workflows
Format
Domain-specific tool evaluation
Difficulty
Professional workflow
OpenAI reports tau2-bench as a domain-specific tool benchmark for telecom tasks, useful for measuring API-call reliability under constraints.
Version
τ²-Bench 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
A telecom-oriented tool benchmark that measures structured tool use in domain workflows.
Step 3.7 Flash by StepFun currently leads with a score of 98.5% on Tau2-Telecom.
117 AI models have been evaluated on Tau2-Telecom on BenchLM.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.