STORY-TRÅD·teknik

AI developer runs 28.9-million-parameter model on $10 ESP32-S3 microcontroller — uses Google's Per-Layer Embeddings technique, stores table on 16MB Flash memory

Getting a local language model running on a sub-$10 microcontroller is impressive despite its obvious limitations.