OutfitterBench evaluates agents’ ability to coordinate reservations, last-minute candidate demand, and equipment commitments under a fixed capital limit by having them operate an outdoor equipment rental business. The task runs for 200 days and involves a 46-product catalog and approximately 1,100 reservation requests; among the seven frontier LLMs, several underperform a simple rule-based baseline, with only the leading agents consistently surpassing it.
Source:Hugging Face 社区论文精选 · Read original
Leave a Reply