
Edge AI3 min read
A 2-Bit LLM Kernel Triples CPU Speed in llama.cpp as Jetson Thor Gets an Industrial Box
llama.cpp merged an x86 VNNI Q2_0 kernel on November 15, a Jetson Thor box PC appeared, and an ESP32-S3 controller launched at $69.
91 views
Read