Skip to main content

Add a model

  1. Click Models in the main navigation.

  2. Click the + New Model button. Creating a new connection

  3. Enter a name for the model.

  4. Enter a description of the model.

  5. Select one of the following model types. For more information, see Supported LLM hosts.

    • h2oGPTe RAG
    • OpenAI Assistant
    • h2oGPTe LLM: h2oGPTe-hosted LLM.
    • h2oGPT LLM: h2oGPT-hosted LLM.
    • OpenAI chat
    • Microsoft Azure hosted OpenAI Chat
    • OpenAI API chat
    • h2o LLMOps
    • Ollama

  6. Enter the URL address to the model.

  7. Optionally enter an API key.

  8. Click the Create button.

Supported LLM hosts​

The following section describes the LLM hosts that are currently supported by H2O Eval Studio.

Enterprise h2oGPTe LLM Host​

Enterprise h2oGPTe is RAG product that uses LLMs to generate responses. You can use H2O Eval Studio to evaluate the performance of LLMs hosted by Enterprise h2oGPTe.

h2oGPT LLM Host​

h2oGPT is a product that is used to host LLMs. You can use H2O Eval Studio to evaluate the performance of LLMs hosted by the H2O GPT.

Open AI Assistants with Retrieval Tool LLM Host​

Open AI Assistants with retrieval tool is RAG system from OpenAI which hosts LLMs to generate the answers. You can use H2O Eval Studio to evaluate the performance of LLMs hosted by Open AI Assistants with retrieval tool.

Open AI Chat LLM Host​

Open AI Chat is a product that hosts LLMs. You can use H2O Eval Studio to evaluate the performance of LLMs hosted by the Open AI Chat.

Microsoft Azure Open AI Chat LLM Host​

Microsoft Azure hosted Open AI Chat is a product that hosts LLMs. You can use H2O Eval Studio to evaluate the performance of LLMs hosted by the Open AI Chat.

Open AI Chat API Compatible LLM Host​

H2O Eval Studio can be used to evaluate the performance of LLMs hosted by any OpenAI API compatible LLM host.

ollama LLM Host​

H2O Eval Studio can be used to evaluate the performance of LLMs hosted by ollama LLM hosts.

Before you can create a leaderboard, you need to add a model. This page describes how to add a new model in H2O Eval Studio.

Feedback