Tag

TinyML

14 posts

A 312K-Parameter LLM Learns to Flip Switches as Pi Prices Climb Again
Edge AI4 min read

A 312K-Parameter LLM Learns to Flip Switches as Pi Prices Climb Again

A tiny GPIO-control model and a Japanese TTS join the ESP32 pile-up while Raspberry Pi raises prices and a Jetson robot chases bubbles.

17 views
Read
ESP32 Special: Small LLMs Learn to Chat, Listen and Keep the Fish Alive
Edge AI4 min read

ESP32 Special: Small LLMs Learn to Chat, Listen and Keep the Fish Alive

A full day inside the ESP32 world: chatty microcontroller LLMs, a $5-chip speech model, and two new boards from Espressif's own community.

24 views
Read
A Diffusion Model and a 28.9M LLM Both Now Run on Bare Microcontrollers
Edge AI4 min read

A Diffusion Model and a 28.9M LLM Both Now Run on Bare Microcontrollers

An RP2350 draws faces from noise, an ESP32-S3 writes stories, and AI smart glasses squeeze in a 1-bit model — all without a server.

169 views
Read
The ESP32 Beat Skips the LLM Today: A Desk Companion, Drumsticks, and a JavaScript OS
Edge AI3 min read

The ESP32 Beat Skips the LLM Today: A Desk Companion, Drumsticks, and a JavaScript OS

Three ESP32 builds this week show the chip's range — a reactive desk companion, motion-sensing drumsticks, and a scripting OS — none of them running a language model.

90 views
Read
Jetson Thor Sprints Past llama.cpp While a 15M-Parameter LLM Still Fits an $8 Chip
Edge AI4 min read

Jetson Thor Sprints Past llama.cpp While a 15M-Parameter LLM Still Fits an $8 Chip

NVIDIA posts a 6.4x MLPerf edge win on Jetson AGX Thor, a dense TinyStories model skips the flash trick, and a paper splits VLA robots between cloud and a tiny local model.

127 views
Read
Split-Brain Robots: Jetson Handles the Vision, a $49 MCU Kit Handles the Milliseconds — Edge AI Keeps Dividing the Job
Edge AI3 min read

Split-Brain Robots: Jetson Handles the Vision, a $49 MCU Kit Handles the Milliseconds — Edge AI Keeps Dividing the Job

A student-built quadruped, a walking-robot policy on a Rockchip SBC, a tiny STM32N6 vision camera, and a $49 TinyML kit all landed this week.

69 views
Read
A $1 Microcontroller Learns to Dream Faces as On-Device AI Keeps Shrinking
Edge AI4 min read

A $1 Microcontroller Learns to Dream Faces as On-Device AI Keeps Shrinking

An RP2350 chip runs a diffusion model, an ESP32-S3 speaks Japanese, and researchers tackle mobile power and tiny-drone control at the edge.

65 views
Read
A 90-Million-Parameter LLM Talks From a 2004 PSP, While On-Device AI Keeps Finding Smaller Homes
Edge AI4 min read

A 90-Million-Parameter LLM Talks From a 2004 PSP, While On-Device AI Keeps Finding Smaller Homes

A modded Sony PSP runs a tiny LLM, a $3 chip learns to speak, and a 2B open model claims agentic skills for phones.

74 views
Read
A Microcontroller Learns to Retrain Itself as On-Device AI Keeps Multiplying Tasks
Edge AI4 min read

A Microcontroller Learns to Retrain Itself as On-Device AI Keeps Multiplying Tasks

Fresh arXiv work tackles MCU vision drift and phone LLM memory pressure, while a solar bird feeder and a desktop WALL-E show the hobbyist edge staying busy.

65 views
Read
A Solo Coder Brings Vision to a Local LLM as Edge Silicon and TinyML Builders Push Back the Frontier
Edge AI4 min read

A Solo Coder Brings Vision to a Local LLM as Edge Silicon and TinyML Builders Push Back the Frontier

DeepSeek V4 Flash gains on-device vision on a Mac, a $1 chip draws pictures, and Qualcomm ships new edge silicon ahead of IFA.

94 views
Read
Edge Dispatch: IBM Ships an Edge-First Granite LLM as RISC-V AI Boards Keep Fragmenting the Toolchain
Edge AI3 min read

Edge Dispatch: IBM Ships an Edge-First Granite LLM as RISC-V AI Boards Keep Fragmenting the Toolchain

IBM's Granite 4.2 targets edge devices with a 3B open model, while a new RISC-V AI pocket computer ships locked to its own OS fork.

88 views
Read
Edge Dispatch: The $8 AI Chip Grows a Coffee Habit: ESP32 Tiny-LLM Trick Gets a Second Model
Edge AI4 min read

Edge Dispatch: The $8 AI Chip Grows a Coffee Habit: ESP32 Tiny-LLM Trick Gets a Second Model

A new 'Barista' model and a closer look at Google's Per-Layer Embeddings trick show what running an LLM on a microcontroller can and can't do.

100 views
Read
The Edge AI Compute Ladder: What Actually Runs on Every Board From $5 to $600
Edge AI8 min read

The Edge AI Compute Ladder: What Actually Runs on Every Board From $5 to $600

A $5 Pico 2 writes TinyStories. A $15 Pi Zero 2 W runs SmolLM2-135M. A $299 RISC-V board claims 30B. What AI really fits at every rung of the edge hardware ladder.

244 views
Read
Running an LLM on an $8 Microcontroller: What's Real in 2026
Edge AI9 min read

Running an LLM on an $8 Microcontroller: What's Real in 2026

In July 2026 a 28.9-million-parameter LLM ran fully on-device on an $8 ESP32-S3 at almost 10 tokens per second. Here's how the trick works, who built it, what's hype, and what you can actually build with a microcontroller LLM today.

234 views
Read