Skip to content

Tag

ESP32

32 posts

A 14M-Parameter LLM Tends a Fish Tank on an $8 ESP32 as Drone AI Claims a 3x Speedup
Edge AI4 min read

A 14M-Parameter LLM Tends a Fish Tank on an $8 ESP32 as Drone AI Claims a 3x Speedup

A tiny LLM on an ESP32-S3, a vendor-claimed 3x YOLO speedup on a 12 g drone board, llama.cpp v1.0, and a $62 vision module that beats a CM4 on NPU work.

112 views
Read
A $7 ESP32 Gives AI Agents a Real iPhone While Ryzen AI's NPU Learns to Swap Brains
Edge AI4 min read

A $7 ESP32 Gives AI Agents a Real iPhone While Ryzen AI's NPU Learns to Swap Brains

A viral ESP32 bridge lets AI agents control a real iPhone, AMD's NPU now hot-swaps LoRA adapters, and an NPU briefly tries to render Windows.

116 views
Read
A $5 Microcontroller Finally Hears Full Sentences While AI Chips Hit a Memory Wall
Edge AI4 min read

A $5 Microcontroller Finally Hears Full Sentences While AI Chips Hit a Memory Wall

An open-vocabulary speech model gets near real-time on an ESP32-S3, a new benchmark shows why MAC counts lie, and ST overhauls its STM32 AI toolchain.

208 views
Read
An ESP32 Speaks, Chats, and Gets a New $21 Brain in Today's All-Microcontroller AI Special
Edge AI3 min read

An ESP32 Speaks, Chats, and Gets a New $21 Brain in Today's All-Microcontroller AI Special

A 3.8MB voice model, an early ChatML LLM, and a $21 board all land on the ESP32 this week.

2.6K views
Read
A $25 ESP32 Trains Its Own Tiny LLM While an 8B MoE Model Squeezes Under 1GB of RAM
Edge AI4 min read

A $25 ESP32 Trains Its Own Tiny LLM While an 8B MoE Model Squeezes Under 1GB of RAM

From a from-scratch LLM on a $25 microcontroller to an 8B MoE model living in under a gigabyte, the edge keeps shrinking its memory budget.

361 views
Read
A $7 ESP32 Gives an AI Agent Hands on a Real iPhone While a 14M LLM Keeps a Fish Alive
Edge AI4 min read

A $7 ESP32 Gives an AI Agent Hands on a Real iPhone While a 14M LLM Keeps a Fish Alive

A cheap ESP32 becomes an AI agent's eyes and hands on a real iPhone, while a tiny distilled LLM runs an $8 virtual fish tank offline.

329 views
Read
Three ESP32 Builds Show How Far On-Device AI Has Come in a Week
Edge AI3 min read

Three ESP32 Builds Show How Far On-Device AI Has Come in a Week

An open-vocabulary speech engine, a full offline voice assistant, and a new ESP32-P4 compute module show how much now runs on one microcontroller.

451 views
Read
A Pixel Phone Speeds Up On-Device Speech AI While a $2 Chip Learns to See
Edge AI5 min read

A Pixel Phone Speeds Up On-Device Speech AI While a $2 Chip Learns to See

Arm's SME2 doubles streaming-ASR speed on a Pixel 11, a battery-sipping voice stack lands on Android, and two cheap microcontrollers go local.

317 views
Read
A $1 Microcontroller Stretches Toward a 4B LLM While Google Opens Its NPU Blueprint
Edge AI4 min read

A $1 Microcontroller Stretches Toward a 4B LLM While Google Opens Its NPU Blueprint

A $1 chip pushes an LLM toward 4B parameters, Google opens its Coral NPU compiler, and an ESP32 learns to hear offline in seven languages.

224 views
Read
Five ESP32 Builds Push Local AI From a Dev Board to a Drone's Camera
Edge AI4 min read

Five ESP32 Builds Push Local AI From a Dev Board to a Drone's Camera

A 28.9M LLM, two phone/voice agents, a new AI-ready dev board and a drone video hack all land on the same $7 chip family.

661 views
Read
A 27B AI Hits an iPhone's Neural Engine at 3 Bits While a 14M LLM Keeps a Fish Tank Alive on ESP32
Edge AI5 min read

A 27B AI Hits an iPhone's Neural Engine at 3 Bits While a 14M LLM Keeps a Fish Tank Alive on ESP32

Apple's Neural Engine runs a 27B model at low bit-width, a distilled 14M LLM animates a $8 microcontroller pet, and new research questions KV-cache quant on Raspberry Pi.

284 views
Read
Edge AI Learns to Hear Without Any Dedicated AI Silicon At All
Edge AI4 min read

Edge AI Learns to Hear Without Any Dedicated AI Silicon At All

A microcontroller runs open-vocabulary speech recognition with no neural accelerator, while NPU boards and an $8 chip push tiny-LLM throughput further.

532 views
Read
ESP32 Special: Two Offline Voice-AI Builds Debut While a New Chip Powers a Display Board
Edge AI3 min read

ESP32 Special: Two Offline Voice-AI Builds Debut While a New Chip Powers a Display Board

Two fresh ESP32 voice-AI repos go fully offline, a mystery ESP32-S31 chip shows up on a display board, and an ESP32 radio hack learns to transmit.

542 views
Read
A 35B MoE Vision AI Learns to Fit a Phone While a $7 ESP32 Hijacks an iPhone
Edge AI4 min read

A 35B MoE Vision AI Learns to Fit a Phone While a $7 ESP32 Hijacks an iPhone

OpenBMB squeezes a 35B MoE vision model onto an iPhone, Google shrinks multimodal search to 191MB, and a $7 ESP32 learns to tap a real iPhone's screen.

224 views
Read
A 1-Bit AI Trick Shrinks a 70B Model to Fit on a $200 GPU
Edge AI4 min read

A 1-Bit AI Trick Shrinks a 70B Model to Fit on a $200 GPU

Samsung's sub-1-bit quantization paper gets a reality check, plus fresh research on tiny LLMs and ESP32 voice silicon.

277 views
Read
Small AI Models Steer Robots While ESP32 Boards Do the Grunt Work
Edge AI4 min read

Small AI Models Steer Robots While ESP32 Boards Do the Grunt Work

A dual-core Arduino runs robot policies on-device, a paper argues for skill-sized models over one big brain, and two ESP32 boards ship.

283 views
Read
A 14M-Parameter LLM Keeps a Virtual Fish Tank Alive on an $8 Chip
Edge AI4 min read

A 14M-Parameter LLM Keeps a Virtual Fish Tank Alive on an $8 Chip

A distilled LLM runs a fish tank on an $8 ESP32-S3, four Raspberry Pi 5s share a 30B model, and a 2B decision model lands for edge agents.

266 views
Read
ESP32 Special: Cloud Voices and an E-Ink Reader, No New On-Device LLM Yet
Edge AI3 min read

ESP32 Special: Cloud Voices and an E-Ink Reader, No New On-Device LLM Yet

Two ESP32 voice projects lean on cloud AI while a maker's e-ink reader builds the hardware the next on-device model will need.

485 views
Read
Meta Opens Muse to ESP32 Makers as a Tiny LLM Learns to Remember a Hidden Object
Edge AI5 min read

Meta Opens Muse to ESP32 Makers as a Tiny LLM Learns to Remember a Hidden Object

Meta ships ESP32 and Linux SDKs for its Muse AI, Qualcomm's next phones get 2nm NPUs, and a 68KB brain gives a cheap robot arm memory.

292 views
Read
Seven $5 Chips Learn to Share an LLM, One Bit at a Time
Edge AI5 min read

Seven $5 Chips Learn to Share an LLM, One Bit at a Time

A BitNet cluster splits an LLM across seven ESP32-S3 boards, a 2-bit tool-calling model lands on GitHub, and a quantization paper gets llama.cpp 15x faster on an M4 Pro.

462 views
Read
A 312K-Parameter LLM Learns to Flip Switches as Pi Prices Climb Again
Edge AI4 min read

A 312K-Parameter LLM Learns to Flip Switches as Pi Prices Climb Again

A tiny GPIO-control model and a Japanese TTS join the ESP32 pile-up while Raspberry Pi raises prices and a Jetson robot chases bubbles.

485 views
Read
ESP32 Special: Small LLMs Learn to Chat, Listen and Keep the Fish Alive
Edge AI4 min read

ESP32 Special: Small LLMs Learn to Chat, Listen and Keep the Fish Alive

A full day inside the ESP32 world: chatty microcontroller LLMs, a $5-chip speech model, and two new boards from Espressif's own community.

318 views
Read
Wearable AI Chips Land as an ESP32 Board Learns to Run a Full Offline Voice Loop
Edge AI4 min read

Wearable AI Chips Land as an ESP32 Board Learns to Run a Full Offline Voice Loop

From a Qualcomm earbud chip to an ESP32-S3 that hears, thinks and speaks with no cloud, edge AI keeps shrinking into pockets and ears.

423 views
Read
A $300 GPU Streams a 177B AI Model From an SSD While llama.cpp Learns to Skip Ahead
Edge AI4 min read

A $300 GPU Streams a 177B AI Model From an SSD While llama.cpp Learns to Skip Ahead

Community builders push token throughput further this week — via SSD-streamed MoE experts, prompt-lookup drafting, and a wrapper for Apple's built-in on-device LLM.

495 views
Read
A Classifier That Only Picks, a Model That Skips Tokens, and an AI Firm Bets 2.6B Parameters Can Do Agent Work
Edge AI4 min read

A Classifier That Only Picks, a Model That Skips Tokens, and an AI Firm Bets 2.6B Parameters Can Do Agent Work

Liquid AI ships a 2.6B agentic model for edge hardware, a 144M classifier skips text generation entirely, and a new paper shows byte-level LLMs can beat tokenized ones with sc

198 views
Read
A Diffusion Model and a 28.9M LLM Both Now Run on Bare Microcontrollers
Edge AI4 min read

A Diffusion Model and a 28.9M LLM Both Now Run on Bare Microcontrollers

An RP2350 draws faces from noise, an ESP32-S3 writes stories, and AI smart glasses squeeze in a 1-bit model — all without a server.

639 views
Read
The ESP32 Beat Skips the LLM Today: A Desk Companion, Drumsticks, and a JavaScript OS
Edge AI3 min read

The ESP32 Beat Skips the LLM Today: A Desk Companion, Drumsticks, and a JavaScript OS

Three ESP32 builds this week show the chip's range — a reactive desk companion, motion-sensing drumsticks, and a scripting OS — none of them running a language model.

291 views
Read
Jetson Thor Sprints Past llama.cpp While a 15M-Parameter LLM Still Fits an $8 Chip
Edge AI4 min read

Jetson Thor Sprints Past llama.cpp While a 15M-Parameter LLM Still Fits an $8 Chip

NVIDIA posts a 6.4x MLPerf edge win on Jetson AGX Thor, a dense TinyStories model skips the flash trick, and a paper splits VLA robots between cloud and a tiny local model.

463 views
Read
ESP32 Special: An $8 Chip Runs a 29-Million-Parameter LLM, and Vendors Rethink the Board Around It
Edge AI3 min read

ESP32 Special: An $8 Chip Runs a 29-Million-Parameter LLM, and Vendors Rethink the Board Around It

A one-chip LLM, a Wi-Fi upgrade to Seeed's tiny displays, and Tuya's push to make ESP32 an AI-agent target, not just a Wi-Fi one.

284 views
Read
Edge Dispatch: The $8 AI Chip Grows a Coffee Habit: ESP32 Tiny-LLM Trick Gets a Second Model
Edge AI4 min read

Edge Dispatch: The $8 AI Chip Grows a Coffee Habit: ESP32 Tiny-LLM Trick Gets a Second Model

A new 'Barista' model and a closer look at Google's Per-Layer Embeddings trick show what running an LLM on a microcontroller can and can't do.

265 views
Read
The 180M-Parameter LLM Running on a $10 Microcontroller — and Almost Nobody Noticed
Edge AI7 min read

The 180M-Parameter LLM Running on a $10 Microcontroller — and Almost Nobody Noticed

On August 5, 2026 a 180.9M-parameter mixture-of-experts LLM ran on a $6-10 ESP32-P4 — and got two Hacker News points. The undercovered microcontroller AI story of the year.

374 views
Read
Running an LLM on an $8 Microcontroller: What's Real in 2026
Edge AI9 min read

Running an LLM on an $8 Microcontroller: What's Real in 2026

In July 2026 a 28.9-million-parameter LLM ran fully on-device on an $8 ESP32-S3 at almost 10 tokens per second. Here's how the trick works, who built it, what's hype, and what you can actually build with a microcontroller LLM today.

579 views
Read