Skip to content

Tag

TinyML

24 posts

A 367K-Parameter LLM Fits on a Floppy as Nordic Puts an NPU in Wi-Fi Chips
Edge AI3 min read

A 367K-Parameter LLM Fits on a Floppy as Nordic Puts an NPU in Wi-Fi Chips

A DOS-era language model on a 486, an Arduino SBC pitched for agent memory, a Versal VLM paper, and Nordic's nRF71 NPU plus u-blox modules.

20 views
Read
An 8M-Parameter LLM Gets Compiled to C for a Cortex-M7 as Tiny AI Listens to Fans
Edge AI4 min read

An 8M-Parameter LLM Gets Compiled to C for a Cortex-M7 as Tiny AI Listens to Fans

A new MLIR compiler emits dependency-free C for a tiny LLM on a Cortex-M7, and a Cortex-M33 board runs an AI fan-fault detector on its own microphones.

160 views
Read
A $5 Microcontroller Finally Hears Full Sentences While AI Chips Hit a Memory Wall
Edge AI4 min read

A $5 Microcontroller Finally Hears Full Sentences While AI Chips Hit a Memory Wall

An open-vocabulary speech model gets near real-time on an ESP32-S3, a new benchmark shows why MAC counts lie, and ST overhauls its STM32 AI toolchain.

208 views
Read
An ESP32 Speaks, Chats, and Gets a New $21 Brain in Today's All-Microcontroller AI Special
Edge AI3 min read

An ESP32 Speaks, Chats, and Gets a New $21 Brain in Today's All-Microcontroller AI Special

A 3.8MB voice model, an early ChatML LLM, and a $21 board all land on the ESP32 this week.

2.6K views
Read
A $7 ESP32 Gives an AI Agent Hands on a Real iPhone While a 14M LLM Keeps a Fish Alive
Edge AI4 min read

A $7 ESP32 Gives an AI Agent Hands on a Real iPhone While a 14M LLM Keeps a Fish Alive

A cheap ESP32 becomes an AI agent's eyes and hands on a real iPhone, while a tiny distilled LLM runs an $8 virtual fish tank offline.

329 views
Read
Three ESP32 Builds Show How Far On-Device AI Has Come in a Week
Edge AI3 min read

Three ESP32 Builds Show How Far On-Device AI Has Come in a Week

An open-vocabulary speech engine, a full offline voice assistant, and a new ESP32-P4 compute module show how much now runs on one microcontroller.

451 views
Read
A $1 Microcontroller Stretches Toward a 4B LLM While Google Opens Its NPU Blueprint
Edge AI4 min read

A $1 Microcontroller Stretches Toward a 4B LLM While Google Opens Its NPU Blueprint

A $1 chip pushes an LLM toward 4B parameters, Google opens its Coral NPU compiler, and an ESP32 learns to hear offline in seven languages.

224 views
Read
Five ESP32 Builds Push Local AI From a Dev Board to a Drone's Camera
Edge AI4 min read

Five ESP32 Builds Push Local AI From a Dev Board to a Drone's Camera

A 28.9M LLM, two phone/voice agents, a new AI-ready dev board and a drone video hack all land on the same $7 chip family.

661 views
Read
Edge AI Learns to Hear Without Any Dedicated AI Silicon At All
Edge AI4 min read

Edge AI Learns to Hear Without Any Dedicated AI Silicon At All

A microcontroller runs open-vocabulary speech recognition with no neural accelerator, while NPU boards and an $8 chip push tiny-LLM throughput further.

532 views
Read
A 14M-Parameter LLM Keeps a Virtual Fish Tank Alive on an $8 Chip
Edge AI4 min read

A 14M-Parameter LLM Keeps a Virtual Fish Tank Alive on an $8 Chip

A distilled LLM runs a fish tank on an $8 ESP32-S3, four Raspberry Pi 5s share a 30B model, and a 2B decision model lands for edge agents.

266 views
Read
A 312K-Parameter LLM Learns to Flip Switches as Pi Prices Climb Again
Edge AI4 min read

A 312K-Parameter LLM Learns to Flip Switches as Pi Prices Climb Again

A tiny GPIO-control model and a Japanese TTS join the ESP32 pile-up while Raspberry Pi raises prices and a Jetson robot chases bubbles.

485 views
Read
ESP32 Special: Small LLMs Learn to Chat, Listen and Keep the Fish Alive
Edge AI4 min read

ESP32 Special: Small LLMs Learn to Chat, Listen and Keep the Fish Alive

A full day inside the ESP32 world: chatty microcontroller LLMs, a $5-chip speech model, and two new boards from Espressif's own community.

318 views
Read
A Diffusion Model and a 28.9M LLM Both Now Run on Bare Microcontrollers
Edge AI4 min read

A Diffusion Model and a 28.9M LLM Both Now Run on Bare Microcontrollers

An RP2350 draws faces from noise, an ESP32-S3 writes stories, and AI smart glasses squeeze in a 1-bit model — all without a server.

639 views
Read
The ESP32 Beat Skips the LLM Today: A Desk Companion, Drumsticks, and a JavaScript OS
Edge AI3 min read

The ESP32 Beat Skips the LLM Today: A Desk Companion, Drumsticks, and a JavaScript OS

Three ESP32 builds this week show the chip's range — a reactive desk companion, motion-sensing drumsticks, and a scripting OS — none of them running a language model.

291 views
Read
Jetson Thor Sprints Past llama.cpp While a 15M-Parameter LLM Still Fits an $8 Chip
Edge AI4 min read

Jetson Thor Sprints Past llama.cpp While a 15M-Parameter LLM Still Fits an $8 Chip

NVIDIA posts a 6.4x MLPerf edge win on Jetson AGX Thor, a dense TinyStories model skips the flash trick, and a paper splits VLA robots between cloud and a tiny local model.

463 views
Read
Split-Brain Robots: Jetson Handles the Vision, a $49 MCU Kit Handles the Milliseconds — Edge AI Keeps Dividing the Job
Edge AI3 min read

Split-Brain Robots: Jetson Handles the Vision, a $49 MCU Kit Handles the Milliseconds — Edge AI Keeps Dividing the Job

A student-built quadruped, a walking-robot policy on a Rockchip SBC, a tiny STM32N6 vision camera, and a $49 TinyML kit all landed this week.

283 views
Read
A $1 Microcontroller Learns to Dream Faces as On-Device AI Keeps Shrinking
Edge AI4 min read

A $1 Microcontroller Learns to Dream Faces as On-Device AI Keeps Shrinking

An RP2350 chip runs a diffusion model, an ESP32-S3 speaks Japanese, and researchers tackle mobile power and tiny-drone control at the edge.

188 views
Read
A 90-Million-Parameter LLM Talks From a 2004 PSP, While On-Device AI Keeps Finding Smaller Homes
Edge AI4 min read

A 90-Million-Parameter LLM Talks From a 2004 PSP, While On-Device AI Keeps Finding Smaller Homes

A modded Sony PSP runs a tiny LLM, a $3 chip learns to speak, and a 2B open model claims agentic skills for phones.

189 views
Read
A Microcontroller Learns to Retrain Itself as On-Device AI Keeps Multiplying Tasks
Edge AI4 min read

A Microcontroller Learns to Retrain Itself as On-Device AI Keeps Multiplying Tasks

Fresh arXiv work tackles MCU vision drift and phone LLM memory pressure, while a solar bird feeder and a desktop WALL-E show the hobbyist edge staying busy.

173 views
Read
A Solo Coder Brings Vision to a Local LLM as Edge Silicon and TinyML Builders Push Back the Frontier
Edge AI4 min read

A Solo Coder Brings Vision to a Local LLM as Edge Silicon and TinyML Builders Push Back the Frontier

DeepSeek V4 Flash gains on-device vision on a Mac, a $1 chip draws pictures, and Qualcomm ships new edge silicon ahead of IFA.

228 views
Read
Edge Dispatch: IBM Ships an Edge-First Granite LLM as RISC-V AI Boards Keep Fragmenting the Toolchain
Edge AI3 min read

Edge Dispatch: IBM Ships an Edge-First Granite LLM as RISC-V AI Boards Keep Fragmenting the Toolchain

IBM's Granite 4.2 targets edge devices with a 3B open model, while a new RISC-V AI pocket computer ships locked to its own OS fork.

237 views
Read
Edge Dispatch: The $8 AI Chip Grows a Coffee Habit: ESP32 Tiny-LLM Trick Gets a Second Model
Edge AI4 min read

Edge Dispatch: The $8 AI Chip Grows a Coffee Habit: ESP32 Tiny-LLM Trick Gets a Second Model

A new 'Barista' model and a closer look at Google's Per-Layer Embeddings trick show what running an LLM on a microcontroller can and can't do.

265 views
Read
The Edge AI Compute Ladder: What Actually Runs on Every Board From $5 to $600
Edge AI8 min read

The Edge AI Compute Ladder: What Actually Runs on Every Board From $5 to $600

A $5 Pico 2 writes TinyStories. A $15 Pi Zero 2 W runs SmolLM2-135M. A $299 RISC-V board claims 30B. What AI really fits at every rung of the edge hardware ladder.

739 views
Read
Running an LLM on an $8 Microcontroller: What's Real in 2026
Edge AI9 min read

Running an LLM on an $8 Microcontroller: What's Real in 2026

In July 2026 a 28.9-million-parameter LLM ran fully on-device on an $8 ESP32-S3 at almost 10 tokens per second. Here's how the trick works, who built it, what's hype, and what you can actually build with a microcontroller LLM today.

579 views
Read