Reexamining METR Time Horizons: Tasks of Equal Duration Can Be Completed Months Apart

Written by

in

After analyzing METR data, the author notes that the 80% time horizon is about eight months later than the 50% time horizon, while the median transition time for task success rates to increase from 50% to 80% is approximately four months. Different models’ time horizons correspond to tasks of comparable difficulty being solved during different periods, which also affects interpretations of risk rates and the time until workforce displacement. The article states that Claude 3.7 Sonnet had a 50% time horizon of one hour in February 2025, while it reached a one-hour time horizon about nine months later at the 80% level.

Source:LessWrong · Read the original

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *