Login
From:
kexue.fm
(Uncensored)
subscribe
配置不同的学习率,LoRA还能再涨一点? - 科学空间|Scientific Spaces
https://kexue.fm/archives/10001
links
backlinks
Roast topics
Find topics
Find it!
LoRA(Low-Rank Adaptation)是当前LLM的参数高效微调手段之一,此前我们在《梯度视角下的LoRA:简介、分析、猜测及推广》也有过简单讨论。这篇文章我们来学习LoRA的一个新...