Skip to main content

5 posts tagged with "Bumblebee"

View All Tags

· 14 min read
Christoph Beck
Joel Koch
With logits processing, you can force open source LLM to comply with a schema you provide. Grammar Constrained Decoding saves you the process of resubmitting malformed LLM responses. Here we show the process with Bumblebee, and explain the background. Want a specific JSON format reliably? Read on!