Tiny but Mighty: Microsoft Bitnet

Tiny but Mighty: Microsoft Bitnet

Microsoft just made an unusual AI announcement.👇

For once, it's not about more power, or more parameters, or more IQ.

They introduce BitNet b1.58. And it's mainly a stride to a greener AI đŸŒŸđŸŒ±

It slashes energy consumption by 71x ... while keeping performance 🚀

💡 The trick ? Instead performing calculating using full precision, with numbers that need 32 bits to be stored, it uses just ternary values : 1.

Which require 1,58 bits to be stored, so the name.

And good news, in this strange world of ternary computation, multiplications become additions.

That would also open the door to further optimizations and speed up.

Because, as you and me, standard computers are much better at additions compared to multiplications.

So in the end... Smaller Bits, Bigger Dreams ?


Text drafted through a chat with an AI model. Visual: Stable Diffusion or DALL-E 3.
Transformation and final editing by Jean-Paul Paoli.