Tinymodel Sonny [work] Jun 2026

TinyModel Sonny demonstrates that a sub-15-million-parameter decoder-only model can deliver practical, real-time natural language understanding and lightweight generation on commodity microcontrollers. While not competitive with cloud LLMs on complex reasoning, Sonny excels in .

All evaluations are zero-shot, run locally on an ARM Cortex-M7 (300 MHz) with Int8 quantized Sonny. tinymodel sonny

| Platform | RAM Usage | Storage | Inference Latency (per token) | |----------|-----------|---------|-------------------------------| | ARM Cortex-M4 (100 MHz) | 1.2 MB | 14 MB (Int8) | 48 ms | | ESP32-S3 | 2.1 MB | 11 MB (Int4) | 72 ms | | Raspberry Pi Zero 2 W | 9 MB | 15 MB (FP16) | 4 ms | | x86 CPU (no GPU) | 22 MB | 28 MB (FP32) | 2 ms | | Platform | RAM Usage | Storage |

There are several public figures with similar names that users sometimes confuse with this specific term: Sonny Tennet : A singer-songwriter and former American Idol contestant known for his debut album Panorama . Sonny Side tinymodel sonny

: "Sonny" is also a central name in the collector and creative community for Sonny Angel figurines , which are often used as "models" in photography and DIY art projects. Potentially Related Profiles