Login
From:
lmsys.org
(Uncensored)
subscribe
Break the Sequential Dependency of LLM Inference Using Lookahead Decoding | LMSYS Org
https://lmsys.org/blog/2023-11-21-lookahead-decoding
links
backlinks
Roast topics
Find topics
Find it!
TL;DR: We introduce lookahead decoding, a new, exact, and parallel decoding algorithm to accelerate LLM inference. Look...
