AI Agents Succeeding Once Doesn't Mean They'll Succeed Next Time
AI News Brief: This is a news summary translation task related to an advertising service — just process the content directly. Even when an AI agent succeeds once in testing, that doesn’t mean it’ll succeed again on the same request next time. Standard benchmarks usually only report the ‘mean success rate’ (Mean@k), the average across k repeated runs of a task, but this number hides the agent’s underlying instability. Using the AppWorld test set, the research team ran GPT-4.1-powered…