Tag

LiteRT

2 posts

Google Open-Sources Its On-Device AI Engine While a Ternary LLM Shrinks a 30B Model to 12GB

Edge AI4 min read

Google Open-Sources Its On-Device AI Engine While a Ternary LLM Shrinks a 30B Model to 12GB

ML Drift goes open source, ExecuTorch grows up on Cortex-M, a 1.58-bit MoE lands on a 12GB GPU, and two new boards hit the bench.

Oct 26, 2026185

Edge Runtimes Learn to Run LLMs at 2 Bits While a New Chip Takes Aim at DGX Spark

Edge AI4 min read

Edge Runtimes Learn to Run LLMs at 2 Bits While a New Chip Takes Aim at DGX Spark

Ollama, llama.cpp and PyTorch all shipped fresh runtime builds this week, and a 16-core SoC says it can match desktop AI boxes for less.

Oct 19, 2026175