The world is being quietly rearranged by people who write very long documents.


The title they went with Why Retrying Fails: Context Contamination in LLM Agent Pipelines Noisy translates that to

LLM agents get 7 times dumber if they remember their mistakes


When an AI agent tries to fix a mistake, its memory of the failed attempt makes it much worse at the next try. Researchers found that clearing the AI's memory before it retries a task makes it seven times more effective.
People building AI agents often let them retry tasks when they fail. This paper shows that this common practice actually makes the agents perform much worse. Developers now know they must clear the AI's 'mind' after a failure, which means agents can be built to be much more reliable and efficient for complex tasks.
Watch for new AI agent frameworks or libraries that include explicit context-clearing mechanisms as a default setting, rather than an optional feature.

If you insist
Read the original →