With logits processing, you can force open source LLM to comply with a schema
you provide. Grammar Constrained Decoding saves you the process of
resubmitting malformed LLM responses. Here we show the process with Bumblebee,
and explain the background. Want a specific JSON format reliably? Read on!
Ever tried to get a poem from an LLM doesn't contain the letter `e`? Large
Language Models are kind of amazing and surprisingly unreliable at the same
time. Using Elixir's Bumblebee and open source LLMs, you can get much better
control over the generation. In this article, we introduce you to logits
processing, and how it can be used to achieve what ChatGPT can not accomplish.
Find out how!
Your search works… but is it actually good? In our previous post, we showed why full-text search struggles with the long, natural-language queries common in MCP interaction. In this follow-up, we dive into dataset generation, evaluation, and search improvement. How do you know if a new embedding model is really better?"
Most text search solutions are fine tuned to serve results for keyword style queries. This is a problem in the age of MCP, as comparably long user input hits the same old pg_trgm search
This time, bitcrowd (almost) takes a break from AI and focuses on developer happiness. Discover how you can speed up your side tasks and read this before your AI sidekick notices.
We take our blog post series on RAG to the next level: Meet exmeralda.chat, an online demo for Elixir-based RAG systems. - And a quiet useful tool, too!
This is the fourth post of a series on RAG. We reveal our RAG library for the Elixir community.
This is the third post of a series on using a RAG information system for your team's codebase. Find out how you can implement a local RAG system in Elixir.
This is the second post of a series on using a RAG information system for your team's codebase. Find out how the LLM can read and understand Elixir code and start a conversation about your codebase with the LLM.
This is the first part of a series of blog posts on using a RAG (Retrieval Augmented Generation) information system for source code. Find out how a simple RAG system can empower your development team.
