guided-decoding

Here are 2 public repositories matching this topic...

JohnScheuer / guided-decoding-bench

Per-token latency benchmark for structured output decoding: FSM logit masking vs token healing vs free decode, with component-level overhead breakdown.

python performance-engineering benchmarking fsm pytorch structured-output constrained-decoding llm-serving llm-inference json-mode guided-decoding logit-masking token-healing

Updated Jul 18, 2026
Python

OmarFaig / Assay

Star

Confidence-gated invoice extraction: per-field scores from constrained decoding, measured for calibration on DocILE

information-extraction uncertainty-quantification human-in-the-loop pydantic document-ai docile confidence-calibration selective-prediction constrained-decoding llm vllm invoice-extraction structured-outputs guided-decoding logprobs

Updated Aug 22, 2026
Python

Improve this page

Add a description, image, and links to the guided-decoding topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the guided-decoding topic, visit your repo's landing page and select "manage topics."

Learn more