SimplexLoRA: Dynamic Rank Updating via Alternating Minimization with Simplex Projection
Grows and shrinks LoRA adapter ranks during fine-tuning through alternating minimization on a simplex.
Explainer · on the wire
The explainer for this story is still on the wire.
The claim, the mechanism, and the figures land here once generated.
Source · arXiv wire