If you’re delving into the realm of ChatGPT, you may find yourself disappointed that it’s unable to answer questions about your own business or documentation. Don’t worry! In this easy-to-follow guide, we will show you how to utilize powerful AI models called LLMs (Large Language Models) to build your own private question-answering agent tailored to your business context. With this method, your AI will be able to understand user queries and provide accurate and helpful responses using internal document context. And best of all, this approach can be implemented 100% locally, meaning that it guarantees data privacy by design. Here’s a step-by-step guide on how to get this up and running.

LLMs in a nutshell

Before we go over the steps, let’s first find out what LLMs (Large Language Models) are. LLMs are AI models that are trained on vast amounts of text data to understand and generate human-like language. These models are designed to comprehend and generate natural language in a variety of tasks, such as text completion, translation, summarization and answering questions.

Some of the examples are:

  • GPT-3 is made by OpenAI and is one of the most powerful language models. It has been used for things like chatbots, creating content, and translating languages. It has a lot of parameters (kind of like the building blocks of the model) – 175 billion to be exact!
  • BERT is another popular language model made by Google. It’s been used for tasks like analyzing the sentiment of text, recognizing named entities (like names of people or places) and classifying text into different categories.
  • T5, also made by Google, is a versatile language model that can do many different language processing tasks. It takes an input text and turns it into an output text. It has been used successfully for tasks like translating languages, summarizing text, answering questions and generating new text.

The steps

With our step-by-step approach, you can seamlessly integrate LLM question-answering into your custom context. Curious about its applications for your business? Our team is ready to help you! We prioritize your data security by making smart architectural choices, ensuring that no confidential information ever leaves your network. Harness the full potential of AI and discover how it can take your organization to the next level!

This blog is written in collaboration with Camiel Kerkhofs – Data Scientist at Mediaan Conclusion.