Skip to content

Tag

ExecuTorch

5 posts

Google Open-Sources Its On-Device AI Engine While a Ternary LLM Shrinks a 30B Model to 12GB
Edge AI4 min read

Google Open-Sources Its On-Device AI Engine While a Ternary LLM Shrinks a 30B Model to 12GB

ML Drift goes open source, ExecuTorch grows up on Cortex-M, a 1.58-bit MoE lands on a 12GB GPU, and two new boards hit the bench.

185 views
Read
Edge Runtimes Learn to Run LLMs at 2 Bits While a New Chip Takes Aim at DGX Spark
Edge AI4 min read

Edge Runtimes Learn to Run LLMs at 2 Bits While a New Chip Takes Aim at DGX Spark

Ollama, llama.cpp and PyTorch all shipped fresh runtime builds this week, and a 16-core SoC says it can match desktop AI boxes for less.

175 views
Read
ExecuTorch Hits 1.0 as llama.cpp Learns to Make Instant AI Decisions
Edge AI4 min read

ExecuTorch Hits 1.0 as llama.cpp Learns to Make Instant AI Decisions

PyTorch declares its on-device AI runtime production-ready while llama.cpp adds a decision-model endpoint and two new NPU modules land for edge boards.

311 views
Read
Runtimes on the Move: llama.cpp, ExecuTorch and LiteRT All Update as Edge AI's Software Layer Speeds Up
Edge AI4 min read

Runtimes on the Move: llama.cpp, ExecuTorch and LiteRT All Update as Edge AI's Software Layer Speeds Up

llama.cpp shipped two builds in two days, ExecuTorch hit 1.0 with new NPU backends, and LiteRT tuned fp16 kernels for mobile CPUs.

254 views
Read
Runtimes Race Ahead: llama.cpp 0.4.0 and a 30B On-Device AI Agent Test the Edge's Limits
Edge AI4 min read

Runtimes Race Ahead: llama.cpp 0.4.0 and a 30B On-Device AI Agent Test the Edge's Limits

A new llama.cpp release, an ExecuTorch-powered 30B agent model, a cheap RK3576 vision board, and a DIY Jetson robot dog mark a busy week for edge toolchains.

185 views
Read