Roast topics
Find topics
Roast it!
Roast topics
Find topics
Find it!
Login
From:
Blog on Qwen
(Uncensored)
subscribe
Generalizing an LLM from 8k to 1M Context using Qwen-Agent
https://qwenlm.github.io/blog/qwen-agent-2405/
links
backlinks
We’ve created an agent using Qwen2 models with an 8k context size to understand documents with 1M tokens, surpassing RAG and native long-context models. This agent was also used to generate data for training new long-context Qwen models.
