Skip to main content
Version: v1.5.16

Architecture overview

List of architecture components​

UI​

Browser-based interface served from the Mux component

Mux​

Pass-through HTTP server for the UI and API to communicate with back-end services

Core​

Core algorithm service

Vex​

Embedded vector database

Crawl workers​

Ingests, parses, chunks, and indexes content

Chat workers​

Handles chat sessions from UI and API users

Redis​

Job queue and pub/sub for application internal use

Minio​

Object storage for raw content storage

Postgres​

Metadata storage about users, documents, collections, chat history, etc.

h2oGPT​

Acts as an interface to the LLM models

LLM models​

Large language models (LLMs) can be hosted on-prem using services like vLLM or in the cloud

Architecture components diagram​

Components

Feedback