Leebra artificial_intel
login register

PrismML — Introducing Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint

a month ago by ☆ Yσɠƚԋσʂ ☆ to c/artificial_intel

save

share

report

Ternary Bonsai 2 27B retains 98.2% of Qwen3.8 27B benchmark performance in a 5.9GB footprint, with multimodal and agentic capabilities.
geneva_convenience 4 points a month ago

Impressively small

save

path: 0 25884795, hotness: undefined, score: 4, children: 0
ComradePedro 2 points 23 days ago

These 2 bit models are super interesting. The first Bonsai 27B was more of a proof of concept, so I’m really hoping this version is more useful. Anyone tested it yet?

save

path: 0 25967502, hotness: undefined, score: 2, children: 1
yogthos 2 points 23 days ago

I tried it locally, and it's not bad, but I found it can't handle long horizon tasks well. So, as long as you break things up into smaller pieces then it works fine.

save

path: 0 25967502 25968703, hotness: undefined, score: 2, children: 0
artificial_intel
artificial_intel

@lemmy.ml

login for more options
6611
821
296

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

go to feed...