Skip to main content
Version: v0.16.0

Define a large language model (LLM) source

Overview​

H2O Model Validation lets you obtain large language model (LLM) insights into models, datasets, and validation tests. To receive insights, select and define one of the supported LLM sources. See Supported large language model (LLM) sources.

caution

Insights generated heavily depend on the LLM source. With the ongoing advancements in research and the emergence of new models, this functionality is more akin to an experimental feature we continuously enhance. Depending on the specific LLM source, there is a significant possibility of encountering hallucinations or inaccurate judgments within the generated insights.

Instructions​

To define an LLM source, consider the following instructions:

  1. In the H2O Model Validation navigation menu, click Settings.
  2. In the Active LLM source list, select one of the supported LLM sources.
  3. Depending on the selected LLM source, consider the following instructions:
  1. In the URL box, enter the URL for one of the supported h2oGPT-GM models.
    • This setting refers to the URL of one of the supported h2oGPT-GM models
  2. Select/clear the Enable prompt special tokens checkbox.
    • A few model endpoints expect special tokens to be placed in prompts to generate successful (better) answers. H2O Model Validation adds certain special tokens to the prompt if the checkbox is checked
  3. Click Save.

Supported large language model (LLM) sources​

Below, observe the supported LLMs in H2O Model Validation.

h2oGPT-GM​

H2O Generative Pre-trained Transformer Grandmaster (h2oGPT-GM) is a Kaggle grandmaster platform where H2OAI provides multiple large language models (LLM).

h2oGPT​

H2O Generative Pre-trained Transformer (h2oGPT) is an H2OAI large language model (LLM) fine-tuning framework and chatbot UI with document(s) question-answer capabilities.

H2O MLOps​

H2O MLOps is an open, interoperable platform for model deployment, management, governance, monitoring, and alerting that features integration with H2O Driverless AI, H2O-3 open source, and third-party models.

GPT-4​

Generative Pre-trained Transformer 4 (GPT-4) is a large language model (LLM) created by OpenAI.

  • To learn more, see GPT-4.
Feedback