Perseus slows lighter-loaded processors reducing energy needs up to 30% in training large language models

https://www.hackster.io/news/perseus-looks-to-save-us-all-from-ai-energy-bloat-boosting-training-efficiency-through-slowdowns-22de138a8f3b

"AI models are divided into tens of thousands processors to be trained... identifies which training tasks take longest to complete, slowing down processors handling shorter tasks so everything finishes roughly same time... allows lighter-loaded processors finish at leisurely pace, enabling overall power usage to be reduced up to 30 percent.... bigger data centers"

Comments