We have been working on various experiments related to extending the context of pretrained models. In the post we share links to a repository with code and hugging face models and datasets. The post Treating Attention Deficit Disorder in LLMs appeared first on The Abacus.AI Blog.