Skip to content

Tag

NPU

24 posts

A 145B Open LLM Claims a Laptop Seat as Snapdragon's NPU Runs Gemma 4 26B
Edge AI4 min read

A 145B Open LLM Claims a Laptop Seat as Snapdragon's NPU Runs Gemma 4 26B

Edge0 open-sources a 145B model it says fits in 29GB on a laptop, Kora reports 25 tokens/sec on a Snapdragon NPU, and DeepX and Intel sign an OpenVINO deal.

87 views
Read
A $7 ESP32 Gives AI Agents a Real iPhone While Ryzen AI's NPU Learns to Swap Brains
Edge AI4 min read

A $7 ESP32 Gives AI Agents a Real iPhone While Ryzen AI's NPU Learns to Swap Brains

A viral ESP32 bridge lets AI agents control a real iPhone, AMD's NPU now hot-swaps LoRA adapters, and an NPU briefly tries to render Windows.

116 views
Read
A Game Runs Entirely on a $6 Chip While AMD Tries to Skip ROCm for Local AI
Edge AI4 min read

A Game Runs Entirely on a $6 Chip While AMD Tries to Skip ROCm for Local AI

A tiny world model plays games on a Pico 2 W, AMD ships an early NPU/GPU SDK, and a measurement study checks edge-NPU VLM hype.

183 views
Read
A 384M LLM Learns to Call Tools From Scratch While Rockchip Chases 44 TOPS at the Edge
Edge AI4 min read

A 384M LLM Learns to Call Tools From Scratch While Rockchip Chases 44 TOPS at the Edge

A from-scratch tiny LLM, a sub-1-bit quantization trick, a MoE model on a phone NPU, and two new chips round out today's edge sweep.

317 views
Read
Intel's NPU Learns to Guess Ahead While AMD and Intel Merge Their CPU AI Playbooks
Edge AI4 min read

Intel's NPU Learns to Guess Ahead While AMD and Intel Merge Their CPU AI Playbooks

Intel ships speculative decoding for NPUs and a Google bridge to them, AMD and Intel merge CPU math libraries, and two new boards push edge compute further.

188 views
Read
A $1 Microcontroller Stretches Toward a 4B LLM While Google Opens Its NPU Blueprint
Edge AI4 min read

A $1 Microcontroller Stretches Toward a 4B LLM While Google Opens Its NPU Blueprint

A $1 chip pushes an LLM toward 4B parameters, Google opens its Coral NPU compiler, and an ESP32 learns to hear offline in seven languages.

224 views
Read
AMD Opens Its NPU Stack to AI Agents While Qualcomm Puts an LLM on Your Face
Edge AI4 min read

AMD Opens Its NPU Stack to AI Agents While Qualcomm Puts an LLM on Your Face

AMD ships an official NPU SDK, hobbyists wake up an older Ryzen chip's idle silicon, and new hardware arrives already quoting on-device LLM speeds.

300 views
Read
Edge AI Learns to Hear Without Any Dedicated AI Silicon At All
Edge AI4 min read

Edge AI Learns to Hear Without Any Dedicated AI Silicon At All

A microcontroller runs open-vocabulary speech recognition with no neural accelerator, while NPU boards and an $8 chip push tiny-LLM throughput further.

532 views
Read
A Hexagon NPU Learns New AI Tricks While Edge Robots Get Lighter World Models
Edge AI4 min read

A Hexagon NPU Learns New AI Tricks While Edge Robots Get Lighter World Models

llama.cpp opens a path to Qualcomm's Hexagon NPU, a 2-bit automation model surges on GitHub, and a lighter world model targets robot arms.

405 views
Read
Windows Learns GGUF as AI Agents Design Their Own Inference Chip
Edge AI5 min read

Windows Learns GGUF as AI Agents Design Their Own Inference Chip

Microsoft wires llama.cpp into Windows ML's NPU stack while an agent-built FPGA accelerator and fresh AI PC benchmarks show where edge inference actually stands.

343 views
Read
ExecuTorch Hits 1.0 as llama.cpp Learns to Make Instant AI Decisions
Edge AI4 min read

ExecuTorch Hits 1.0 as llama.cpp Learns to Make Instant AI Decisions

PyTorch declares its on-device AI runtime production-ready while llama.cpp adds a decision-model endpoint and two new NPU modules land for edge boards.

409 views
Read
An NPU-Only Runtime Lands for Ryzen AI as a Vintage Terminal Learns to Think Offline
Edge AI4 min read

An NPU-Only Runtime Lands for Ryzen AI as a Vintage Terminal Learns to Think Offline

A 17MB runtime puts LLMs entirely on AMD's XDNA2 NPU, an old terminal gets an offline brain, and Intel's NPU gets unlocked by reverse engineering.

325 views
Read
NPUs Learn to Fuse: AMD Opens Its XDNA Compiler, Qualcomm Previews Linux, and Two New On-Device AI Models Land
Edge AI5 min read

NPUs Learn to Fuse: AMD Opens Its XDNA Compiler, Qualcomm Previews Linux, and Two New On-Device AI Models Land

AMD open-sources fused FlashAttention kernels for XDNA NPUs, Qualcomm ships a Linux preview for Snapdragon X2, and fresh research pushes tiny and trillion-scale models toward

305 views
Read
AI PCs Go Big: A 300B-Parameter Desktop, an 80-TOPS Mini PC, and Edge NPUs Redraw the Local-Inference Map
Edge AI4 min read

AI PCs Go Big: A 300B-Parameter Desktop, an 80-TOPS Mini PC, and Edge NPUs Redraw the Local-Inference Map

GMKtec, ASUS and Radxa all shipped NPU hardware this week while OpenVINO and a Qualcomm robotics runtime pushed what those chips can actually run.

356 views
Read
Qualcomm Chases 30B AI Models on a Phone as Edge Silicon Keeps Multiplying
Edge AI4 min read

Qualcomm Chases 30B AI Models on a Phone as Edge Silicon Keeps Multiplying

A phone NPU claims 30B MoE inference, a 35B model streams from storage on a Mac, and an XDNA1 NPU gets a Linux bring-up.

354 views
Read
AMD, Qualcomm and NVIDIA All Chase the Same Local-AI Bottleneck: Memory
Edge AI5 min read

AMD, Qualcomm and NVIDIA All Chase the Same Local-AI Bottleneck: Memory

Three chipmakers and a mini-PC builder all attack the same problem this week: getting AI inference closer to memory, not just closer to silicon.

335 views
Read
Edge Dispatch: Intel's Wildcat Lake Brings a Modest NPU to AI PCs, While Edge AI Claims It's Going Mainstream in IoT
Edge AI3 min read

Edge Dispatch: Intel's Wildcat Lake Brings a Modest NPU to AI PCs, While Edge AI Claims It's Going Mainstream in IoT

Intel details a 17 TOPS NPU chip built for chiplets, and an industry trend piece argues edge inference is leaving the pilot stage — both light on independent proof so far.

201 views
Read
Flipper One Wants to Be the First Hacker Tool With a Local LLM — What Its 6 TOPS NPU Can Actually Run
Edge AI7 min read

Flipper One Wants to Be the First Hacker Tool With a Local LLM — What Its 6 TOPS NPU Can Actually Run

Flipper Devices' pocket Linux box promises an LLM that runs offline and knows the device inside out. Rockchip's own numbers say what a 6 TOPS RK3576 really does — and the NPU driver isn't in the kernel Flipper chose.

444 views
Read
Edge Dispatch: AMD's Ryzen AI Halo Jumps to 192GB While Qualcomm Pushes On-Device AI Agents
Edge AI5 min read

Edge Dispatch: AMD's Ryzen AI Halo Jumps to 192GB While Qualcomm Pushes On-Device AI Agents

AMD bumps its NPU mini PC to 192GB of unified memory, Qualcomm ships five agentic apps for Snapdragon X, and Korea rethinks its NPU strategy.

356 views
Read
Edge Dispatch: A Robot Arm Joins the NPU Party: FastFlowLM Adds a Vision-Language-Action Model to Ryzen AI
Edge AI5 min read

Edge Dispatch: A Robot Arm Joins the NPU Party: FastFlowLM Adds a Vision-Language-Action Model to Ryzen AI

FastFlowLM's first stable release puts a robotics policy on Ryzen AI's NPU, while Korea ships a boxed NPU appliance and a Raspberry Pi learns to narrate what it sees.

288 views
Read
Edge Dispatch: Korea's KT Ships a Boxed NPU LLM Station While the ESP32 Crowd Trims Memory Further
Edge AI3 min read

Edge Dispatch: Korea's KT Ships a Boxed NPU LLM Station While the ESP32 Crowd Trims Memory Further

A Korean telecom sells an all-in-one on-prem LLM box built on a domestic NPU, while ESP32 tinkerers keep shrinking what a model needs to run.

280 views
Read
Edge Dispatch: Ryzen AI's NPU Runtime Goes Official While a Raspberry Pi Learns to See and Speak with a Tiny LLM
Edge AI4 min read

Edge Dispatch: Ryzen AI's NPU Runtime Goes Official While a Raspberry Pi Learns to See and Speak with a Tiny LLM

AMD folds a hobbyist NPU runtime into ROCm, Google shows Gemma driving a robot from a Raspberry Pi 5, and a 45M-parameter model books tool calls on a phone.

251 views
Read
Edge Dispatch: Raspberry Pi's GPU Joins the AI Party While a 14MB Model Learns to Call Tools
Edge AI4 min read

Edge Dispatch: Raspberry Pi's GPU Joins the AI Party While a 14MB Model Learns to Call Tools

A Raspberry Pi 5 runs Gemma and vision models split across CPU and GPU, and a 45M-parameter model fits tool-calling into 28MB of RAM.

249 views
Read
AMD Just Bought the 'Ollama of NPUs': What FastFlowLM Means for Local LLMs
Edge AI6 min read

AMD Just Bought the 'Ollama of NPUs': What FastFlowLM Means for Local LLMs

A 17MB runtime that runs LLMs on AMD's Ryzen AI NPUs — built by three academics, acquired by AMD on July 17, 2026, folded into ROCm in August. The NPU rung of the edge ladder just got real.

731 views
Read