What do truly long-context models look like? I want to give the model all my journals, notes, pictures, previous work, etc. so that it can make connections and tailor responses for me. I imagine this to be In-between context stuffing and fine-tuning. Every ~day, the model takes all the conversations from that day and decides which to use to update its weights. In the future, will everyone have custom models? Predictive processing? What will human-AI collaboration look like in the future? How ...
