Just yesterday morning, I was writing a conference talk on best practices for maintaining the LLM context window, which was quite detailed. It contained the then best practices from the two blog posts below. autoregressive queens of failureHave you ever had your AI coding assistant suggest something so off-base that| Geoffrey Huntley
Have you ever had your AI coding assistant suggest something so off-base that you wonder if it’s trolling you? Welcome to the world of autoregressive failure. LLMs, the brains behind these assistants, are great at predicting the next word—or line of code—based on what's been fed into| Geoffrey Huntley
In a previous post, I shared about "real context window" sizes and "advertised context window sizes" Claude 3.7’s advertised context window is 200k, but I've noticed that the quality of output clips at the 147k-152k mark. Regardless of which agent is used, when clipping occurs, tool call to| Geoffrey Huntley