Tilelli Lab, based in Marrakech, Morocco, has developed Atome lm, an AI model designed to run on microcontrollers like the ESP32, which costs around $5. Unlike cloud-based AI, it operates completely offline, generating text at roughly one word per second.
The model uses a novel approach to store knowledge with simple values (three options per data point) instead of complex numbers, making it small enough to fit on cheap chips with limited memory and no GPU. The lab has published a public demonstration with binary code and output logs for verification.
Tilelli Lab also released an 'Honest Results' document listing where the model underperforms compared to baselines, promoting transparency in AI benchmarks. This technology targets devices in remote areas like farms or clinics with poor internet.
