TypeLLM
An open typed-generation layer built on SGLang that leaves autoregressive model architecture and weights unchanged while returning schema-constrained string, integer, number, boolean, or enum Python values.
- Stars
- 705
- Forks
- 43
- License
- Apache-2.0
- Last commit
- 2026-09-26
What Jev does here
Independent fields can run as a batch, while depends_on forms a DAG so later fields can read dependency results and reuse shared prefix caches.
Extends beyond finite choices and booleans to free strings, integers, decimals, image input, optional thinking and permutation averaging for structured-generation workflows such as receipt extraction.
Pinned README, tests and JevBench documentation reviewed on 2026-09-26. Schema constraints guarantee output shape, not semantic correctness or calibrated probabilities; benchmark results are author-reported and were not independently reproduced here.