Microsoft introduces an AI model that runs on a regular CPU instead of a GPU chip, using much less memory/ energy
https://techxplore.com/news/2025-04-microsoft-ai-regular-cpus.html
"GPU's massive computing power for training on massive amounts of data, most energy-intensity involves storing/ processing weights in 8- or 16-bit floating point numbers... new method avoids floating point altogether, instead using 1-bit architecture using 3 value (-1, 0, 1) and allowing only addition/ subtraction during processing, easily done using CPU... does as well or better, using less memory/ energy... created runtime bitnet.cpp for it to run on local computer or phone, no need for data center or even internet"
Comments
Post a Comment