Edge AI4 min read
A Diffusion Model and a 28.9M LLM Both Now Run on Bare Microcontrollers
An RP2350 draws faces from noise, an ESP32-S3 writes stories, and AI smart glasses squeeze in a 1-bit model — all without a server.
169 views
Read Tag
Microcontrollers
9 posts
Edge AI3 min read
ESP32 Special: An $8 Chip Runs a 29-Million-Parameter LLM, and Vendors Rethink the Board Around It
A one-chip LLM, a Wi-Fi upgrade to Seeed's tiny displays, and Tuya's push to make ESP32 an AI-agent target, not just a Wi-Fi one.
79 views
Read 
Edge AI4 min read
A $1 Microcontroller Learns to Dream Faces as On-Device AI Keeps Shrinking
An RP2350 chip runs a diffusion model, an ESP32-S3 speaks Japanese, and researchers tackle mobile power and tiny-drone control at the edge.
65 views
Read 
Edge AI4 min read
A Microcontroller Learns to Retrain Itself as On-Device AI Keeps Multiplying Tasks
Fresh arXiv work tackles MCU vision drift and phone LLM memory pressure, while a solar bird feeder and a desktop WALL-E show the hobbyist edge staying busy.
65 views
Read 
Edge AI3 min read
Edge Dispatch: IBM Ships an Edge-First Granite LLM as RISC-V AI Boards Keep Fragmenting the Toolchain
IBM's Granite 4.2 targets edge devices with a 3B open model, while a new RISC-V AI pocket computer ships locked to its own OS fork.
88 views
Read 
Edge AI3 min read
Edge Dispatch: Korea's KT Ships a Boxed NPU LLM Station While the ESP32 Crowd Trims Memory Further
A Korean telecom sells an all-in-one on-prem LLM box built on a domestic NPU, while ESP32 tinkerers keep shrinking what a model needs to run.
116 views
Read 
Edge AI8 min read
The Edge AI Compute Ladder: What Actually Runs on Every Board From $5 to $600
A $5 Pico 2 writes TinyStories. A $15 Pi Zero 2 W runs SmolLM2-135M. A $299 RISC-V board claims 30B. What AI really fits at every rung of the edge hardware ladder.
244 views
Read 
Edge AI7 min read
The 180M-Parameter LLM Running on a $10 Microcontroller — and Almost Nobody Noticed
On August 5, 2026 a 180.9M-parameter mixture-of-experts LLM ran on a $6-10 ESP32-P4 — and got two Hacker News points. The undercovered microcontroller AI story of the year.
120 views
Read 
Edge AI9 min read
Running an LLM on an $8 Microcontroller: What's Real in 2026
In July 2026 a 28.9-million-parameter LLM ran fully on-device on an $8 ESP32-S3 at almost 10 tokens per second. Here's how the trick works, who built it, what's hype, and what you can actually build with a microcontroller LLM today.
234 views
Read