OutfitterBench Evaluates LLM Agents’ Long-Term Resource Allocation and Commitment Coordination

Written by

in

OutfitterBench evaluates agents’ ability to coordinate reservations, last-minute candidate demand, and equipment commitments under a fixed capital limit by having them operate an outdoor equipment rental business. The task runs for 200 days and involves a 46-product catalog and approximately 1,100 reservation requests; among the seven frontier LLMs, several underperform a simple rule-based baseline, with only the leading agents consistently surpassing it.

Source:Hugging Face 社区论文精选 · Read original

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *