Login
From:
Blog on Qwen
(Uncensored)
subscribe
Generalizing an LLM from 8k to 1M Context using Qwen-Agent
https://qwenlm.github.io/blog/qwen-agent-2405/
links
backlinks
Roast topics
Find topics
Find it!
We’ve created an agent using Qwen2 models with an 8k context size to understand documents with 1M tokens, surpassing RAG and native long-context models. This agent was also used to generate data for training new long-context Qwen models.
