Logits Processing and Constrained Sampling in Bumblebee
· 11 min read
Ever tried to get a poem from an LLM doesn't contain the letter `e`? Large
Language Models are kind of amazing and surprisingly unreliable at the same
time. Using Elixir's Bumblebee and open source LLMs, you can get much better
control over the generation. In this article, we introduce you to logits
processing, and how it can be used to achieve what ChatGPT can not accomplish.
Find out how!



