
A 145B Open LLM Claims a Laptop Seat as Snapdragon's NPU Runs Gemma 4 26B
Edge0 open-sources a 145B model it says fits in 29GB on a laptop, Kora reports 25 tokens/sec on a Snapdragon NPU, and DeepX and Intel sign an OpenVINO deal.
Tag
24 posts

Edge0 open-sources a 145B model it says fits in 29GB on a laptop, Kora reports 25 tokens/sec on a Snapdragon NPU, and DeepX and Intel sign an OpenVINO deal.

A viral ESP32 bridge lets AI agents control a real iPhone, AMD's NPU now hot-swaps LoRA adapters, and an NPU briefly tries to render Windows.

A tiny world model plays games on a Pico 2 W, AMD ships an early NPU/GPU SDK, and a measurement study checks edge-NPU VLM hype.

A from-scratch tiny LLM, a sub-1-bit quantization trick, a MoE model on a phone NPU, and two new chips round out today's edge sweep.

Intel ships speculative decoding for NPUs and a Google bridge to them, AMD and Intel merge CPU math libraries, and two new boards push edge compute further.

A $1 chip pushes an LLM toward 4B parameters, Google opens its Coral NPU compiler, and an ESP32 learns to hear offline in seven languages.

AMD ships an official NPU SDK, hobbyists wake up an older Ryzen chip's idle silicon, and new hardware arrives already quoting on-device LLM speeds.
A microcontroller runs open-vocabulary speech recognition with no neural accelerator, while NPU boards and an $8 chip push tiny-LLM throughput further.

llama.cpp opens a path to Qualcomm's Hexagon NPU, a 2-bit automation model surges on GitHub, and a lighter world model targets robot arms.

Microsoft wires llama.cpp into Windows ML's NPU stack while an agent-built FPGA accelerator and fresh AI PC benchmarks show where edge inference actually stands.

PyTorch declares its on-device AI runtime production-ready while llama.cpp adds a decision-model endpoint and two new NPU modules land for edge boards.

A 17MB runtime puts LLMs entirely on AMD's XDNA2 NPU, an old terminal gets an offline brain, and Intel's NPU gets unlocked by reverse engineering.

AMD open-sources fused FlashAttention kernels for XDNA NPUs, Qualcomm ships a Linux preview for Snapdragon X2, and fresh research pushes tiny and trillion-scale models toward

GMKtec, ASUS and Radxa all shipped NPU hardware this week while OpenVINO and a Qualcomm robotics runtime pushed what those chips can actually run.
A phone NPU claims 30B MoE inference, a 35B model streams from storage on a Mac, and an XDNA1 NPU gets a Linux bring-up.

Three chipmakers and a mini-PC builder all attack the same problem this week: getting AI inference closer to memory, not just closer to silicon.

Intel details a 17 TOPS NPU chip built for chiplets, and an industry trend piece argues edge inference is leaving the pilot stage — both light on independent proof so far.

Flipper Devices' pocket Linux box promises an LLM that runs offline and knows the device inside out. Rockchip's own numbers say what a 6 TOPS RK3576 really does — and the NPU driver isn't in the kernel Flipper chose.

AMD bumps its NPU mini PC to 192GB of unified memory, Qualcomm ships five agentic apps for Snapdragon X, and Korea rethinks its NPU strategy.

FastFlowLM's first stable release puts a robotics policy on Ryzen AI's NPU, while Korea ships a boxed NPU appliance and a Raspberry Pi learns to narrate what it sees.

A Korean telecom sells an all-in-one on-prem LLM box built on a domestic NPU, while ESP32 tinkerers keep shrinking what a model needs to run.

AMD folds a hobbyist NPU runtime into ROCm, Google shows Gemma driving a robot from a Raspberry Pi 5, and a 45M-parameter model books tool calls on a phone.

A Raspberry Pi 5 runs Gemma and vision models split across CPU and GPU, and a 45M-parameter model fits tool-calling into 28MB of RAM.

A 17MB runtime that runs LLMs on AMD's Ryzen AI NPUs — built by three academics, acquired by AMD on July 17, 2026, folded into ROCm in August. The NPU rung of the edge ladder just got real.