New technique enables on-device training using less than a quarter of a megabyte of memory

https://techxplore.com/news/2022-10-technique-enables-on-device-quarter-megabyte.html

"Their optimization only required 157 kilobytes of memory to train a machine-learning model on a microcontroller, whereas other techniques designed for lightweight training would still need between 300 and 600 megabytes... training a computer vision model to detect people in images. After only 10 minutes of training, it learned to complete the task successfully. Their method was able to train a model more than 20 times faster than other approaches"