Tag

tiny LLM

2 posts

A $25 ESP32 Trains Its Own Tiny LLM While an 8B MoE Model Squeezes Under 1GB of RAM

Edge AI4 min read

A $25 ESP32 Trains Its Own Tiny LLM While an 8B MoE Model Squeezes Under 1GB of RAM

From a from-scratch LLM on a $25 microcontroller to an 8B MoE model living in under a gigabyte, the edge keeps shrinking its memory budget.

A Game Runs Entirely on a $6 Chip While AMD Tries to Skip ROCm for Local AI

Edge AI4 min read

A Game Runs Entirely on a $6 Chip While AMD Tries to Skip ROCm for Local AI

A tiny world model plays games on a Pico 2 W, AMD ships an early NPU/GPU SDK, and a measurement study checks edge-NPU VLM hype.