
A 14M-Parameter LLM Tends a Fish Tank on an $8 ESP32 as Drone AI Claims a 3x Speedup
A tiny LLM on an ESP32-S3, a vendor-claimed 3x YOLO speedup on a 12 g drone board, llama.cpp v1.0, and a $62 vision module that beats a CM4 on NPU work.
Tag
32 posts

A tiny LLM on an ESP32-S3, a vendor-claimed 3x YOLO speedup on a 12 g drone board, llama.cpp v1.0, and a $62 vision module that beats a CM4 on NPU work.

A viral ESP32 bridge lets AI agents control a real iPhone, AMD's NPU now hot-swaps LoRA adapters, and an NPU briefly tries to render Windows.

An open-vocabulary speech model gets near real-time on an ESP32-S3, a new benchmark shows why MAC counts lie, and ST overhauls its STM32 AI toolchain.

A 3.8MB voice model, an early ChatML LLM, and a $21 board all land on the ESP32 this week.

From a from-scratch LLM on a $25 microcontroller to an 8B MoE model living in under a gigabyte, the edge keeps shrinking its memory budget.

A cheap ESP32 becomes an AI agent's eyes and hands on a real iPhone, while a tiny distilled LLM runs an $8 virtual fish tank offline.

An open-vocabulary speech engine, a full offline voice assistant, and a new ESP32-P4 compute module show how much now runs on one microcontroller.
Arm's SME2 doubles streaming-ASR speed on a Pixel 11, a battery-sipping voice stack lands on Android, and two cheap microcontrollers go local.

A $1 chip pushes an LLM toward 4B parameters, Google opens its Coral NPU compiler, and an ESP32 learns to hear offline in seven languages.

A 28.9M LLM, two phone/voice agents, a new AI-ready dev board and a drone video hack all land on the same $7 chip family.

Apple's Neural Engine runs a 27B model at low bit-width, a distilled 14M LLM animates a $8 microcontroller pet, and new research questions KV-cache quant on Raspberry Pi.
A microcontroller runs open-vocabulary speech recognition with no neural accelerator, while NPU boards and an $8 chip push tiny-LLM throughput further.

Two fresh ESP32 voice-AI repos go fully offline, a mystery ESP32-S31 chip shows up on a display board, and an ESP32 radio hack learns to transmit.

OpenBMB squeezes a 35B MoE vision model onto an iPhone, Google shrinks multimodal search to 191MB, and a $7 ESP32 learns to tap a real iPhone's screen.

Samsung's sub-1-bit quantization paper gets a reality check, plus fresh research on tiny LLMs and ESP32 voice silicon.

A dual-core Arduino runs robot policies on-device, a paper argues for skill-sized models over one big brain, and two ESP32 boards ship.

A distilled LLM runs a fish tank on an $8 ESP32-S3, four Raspberry Pi 5s share a 30B model, and a 2B decision model lands for edge agents.

Two ESP32 voice projects lean on cloud AI while a maker's e-ink reader builds the hardware the next on-device model will need.

Meta ships ESP32 and Linux SDKs for its Muse AI, Qualcomm's next phones get 2nm NPUs, and a 68KB brain gives a cheap robot arm memory.

A BitNet cluster splits an LLM across seven ESP32-S3 boards, a 2-bit tool-calling model lands on GitHub, and a quantization paper gets llama.cpp 15x faster on an M4 Pro.

A tiny GPIO-control model and a Japanese TTS join the ESP32 pile-up while Raspberry Pi raises prices and a Jetson robot chases bubbles.

A full day inside the ESP32 world: chatty microcontroller LLMs, a $5-chip speech model, and two new boards from Espressif's own community.

From a Qualcomm earbud chip to an ESP32-S3 that hears, thinks and speaks with no cloud, edge AI keeps shrinking into pockets and ears.

Community builders push token throughput further this week — via SSD-streamed MoE experts, prompt-lookup drafting, and a wrapper for Apple's built-in on-device LLM.

Liquid AI ships a 2.6B agentic model for edge hardware, a 144M classifier skips text generation entirely, and a new paper shows byte-level LLMs can beat tokenized ones with sc

An RP2350 draws faces from noise, an ESP32-S3 writes stories, and AI smart glasses squeeze in a 1-bit model — all without a server.

Three ESP32 builds this week show the chip's range — a reactive desk companion, motion-sensing drumsticks, and a scripting OS — none of them running a language model.

NVIDIA posts a 6.4x MLPerf edge win on Jetson AGX Thor, a dense TinyStories model skips the flash trick, and a paper splits VLA robots between cloud and a tiny local model.

A one-chip LLM, a Wi-Fi upgrade to Seeed's tiny displays, and Tuya's push to make ESP32 an AI-agent target, not just a Wi-Fi one.

A new 'Barista' model and a closer look at Google's Per-Layer Embeddings trick show what running an LLM on a microcontroller can and can't do.

On August 5, 2026 a 180.9M-parameter mixture-of-experts LLM ran on a $6-10 ESP32-P4 — and got two Hacker News points. The undercovered microcontroller AI story of the year.

In July 2026 a 28.9-million-parameter LLM ran fully on-device on an $8 ESP32-S3 at almost 10 tokens per second. Here's how the trick works, who built it, what's hype, and what you can actually build with a microcontroller LLM today.