camel-ai/crab
#764 of 803 by Stars among GitHub repos
426 Stars
🦀️ CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/
About
CRAB is a framework for building LLM agent benchmark environments in a Python-centric way.
All datasets and experiment code are in crab-benchmark-v0 directory. Please carefully read the benchmark tutorial before using our benchmark.
Please cite our paper if you use anything related in your work:
Join us (Discord or WeChat) in pushing the boundaries of finding the scaling laws of agents.
[slack-url]: [slack-image]: [discord-url]: [discord-image]: [wechat-url]: [wechat-image]: [twitter-url]: [twitter-image]: [arxiv-image]: [arxiv-url]:
Excerpted from github.com/camel-ai/crab
Latest metrics
| Stars | 426 | 2026-09-12 |
|---|---|---|
| Forks | 63 | 2026-09-12 |
| Commits | 85 | 2026-09-12 |
| Releases | 3 | 2026-09-12 |
| Watchers | 7 | 2026-09-12 |
| Open issues | 35 | 2026-09-12 |
| Open PRs | 4 | 2026-09-12 |