Low-Rank Adaptation
RESEARCH DIARY / ADAPTATION
The low-rank journey.
Begin with the update LoRA learns. Then follow the branch where SingLoRA and DoRA question how that update should be parameterized.
Open the core first. Branch when the motivation changes.