With logits processing, you can force open source LLM to comply with a schema
you provide. Grammar Constrained Decoding saves you the process of
resubmitting malformed LLM responses. Here we show the process with Bumblebee,
and explain the background. Want a specific JSON format reliably? Read on!
Ever tried to get a poem from an LLM doesn't contain the letter `e`? Large
Language Models are kind of amazing and surprisingly unreliable at the same
time. Using Elixir's Bumblebee and open source LLMs, you can get much better
control over the generation. In this article, we introduce you to logits
processing, and how it can be used to achieve what ChatGPT can not accomplish.
Find out how!
Your search works… but is it actually good? In our previous post, we showed why full-text search struggles with the long, natural-language queries common in MCP interaction. In this follow-up, we dive into dataset generation, evaluation, and search improvement. How do you know if a new embedding model is really better?"
Most text search solutions are fine tuned to serve results for keyword style queries. This is a problem in the age of MCP, as comparably long user input hits the same old pg_trgm search
This time, bitcrowd (almost) takes a break from AI and focuses on developer happiness. Discover how you can speed up your side tasks and read this before your AI sidekick notices.
We take our blog post series on RAG to the next level: Meet exmeralda.chat, an online demo for Elixir-based RAG systems. - And a quiet useful tool, too!
This is the fourth post of a series on RAG. We reveal our RAG library for the Elixir community.
Steady is evolving, and we’re excited to be part of the journey! Together, we’re redesigning the creator platform to make it more intuitive, efficient, and scalable for the future. Here’s a look at how we’re shaping the next chapter for independent media makers.
Celebrate Free Software Day with us as we share our favorite open-source projects and the passion behind building tools that empower the community!
Bitcrowdʼs custom approach on semi-automatic releases of our browser extension for Chrome and Firefox.
