e=mc²8 min read
Structured Output From a Small Model: Emit the Operation and Its Parameters as JSON
Lesson 08: the tiny decider learns to write the whole request as JSON, operation and parameters, and a grammar built from the catalog constrains every token. Validity goes to 100%. The number that matters is the one a grammar cannot fix: answers that are valid and wrong.
2 views
Read