| GAIA: a benchmark for General AI Assistants. Mialon et al., arXiv:2311.12983 |
| τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains. Yao et al., arXiv:2406.12045 |
| τ²-bench: Evaluating Conversational Agents in a Dual-Control Environment. Barres et al., arXiv:2506.07982 |
| τ-Voice: Benchmarking Full-Duplex Voice Agents on Real-World Domains. Ray et al., arXiv:2603.13686 |
| TelcoAgent-Bench: A Multilingual Benchmark for Telecom AI Agents. Bariah et al., arXiv:2604.06209 |
| AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environments. Schmidgall et al., arXiv:2405.07960 |
| WebArena: A Realistic Web Environment for Building Autonomous Agents. Zhou et al., arXiv:2307.13854 |
| Mind2Web: Towards a Generalist Agent for the Web. Deng et al., arXiv:2306.06070 |
| OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments. Xie et al., arXiv:2404.07972 |
| X-WebAgentBench: A Multilingual Interactive Web Benchmark for Evaluating Global Agentic System. Wang et al., arXiv:2505.15372 |
| WebMMU: A Benchmark for Multimodal Multilingual Website Understanding and Code Generation. Awal et al., arXiv:2508.16763 |
| macOSWorld: A Multilingual Interactive Benchmark for GUI Agents. Yang et al., arXiv:2506.04135 |
| SWE-bench: Can Language Models Resolve Real-World GitHub Issues? Jimenez et al., arXiv:2310.06770 |
| Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving. Zan et al., arXiv:2504.02605 |
| MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languages. FitzGerald et al., arXiv:2204.08582 |
| Ticket-Bench: A Kickoff for Multilingual and Regionalized Agent Evaluation. Sales Almeida et al., arXiv:2509.14477 |
| AgentBench: Evaluating LLMs as Agents. Liu et al., arXiv:2308.03688 |
| MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation. Xuan et al., arXiv:2503.10497 |