
llama.cpp Splits Liquid AI's LFM3 Across Multiple NPUs While a 29MB Automation LLM Chases Microcontrollers
A new llama.cpp build spreads LFM3 over several Qualcomm NPUs, a sub-30MB model targets tiny automation, and Raspberry Pi prices climb again.
Tag
7 posts

A new llama.cpp build spreads LFM3 over several Qualcomm NPUs, a sub-30MB model targets tiny automation, and Raspberry Pi prices climb again.

NVIDIA's Nemotron Bolt talks to a Jetson-powered robot, Embedl speeds Jetson deployment, and two new boards push NPUs onto cheaper SBCs.

A distilled LLM runs a fish tank on an $8 ESP32-S3, four Raspberry Pi 5s share a 30B model, and a 2B decision model lands for edge agents.

A tool-calling model flips switches on a Pi 5, a Qualcomm NPU speeds up a robot arm sevenfold, and a $2,500 biped joins LeRobot.

A Rockchip-powered duck robot, two offline Raspberry Pi builds, and audits exposing quantization's blind spots and mislabeled GGUF files.

AMD folds a hobbyist NPU runtime into ROCm, Google shows Gemma driving a robot from a Raspberry Pi 5, and a 45M-parameter model books tool calls on a phone.

A Raspberry Pi 5 runs Gemma and vision models split across CPU and GPU, and a 45M-parameter model fits tool-calling into 28MB of RAM.