Skip to main content
Version: v0.17.0

Define a large language model (LLM) source

Overview​

H2O Model Validation lets you utilize large language models (LLMs) to obtain insights about models, datasets, and validation tests. To obtain insights, select and define one of the supported LLM sources. See Supported large language model (LLM) sources.

caution

Insights generated heavily depend on the LLM source. With the ongoing advancements in research and the emergence of new models, this functionality is more akin to an experimental feature we continuously enhance. Depending on the specific LLM source, there is a significant possibility of encountering hallucinations or inaccurate judgments within the generated insights.

Instructions​

To define an LLM source, consider the following instructions:

  1. In the H2O Model Validation navigation menu, click Settings.
  2. In the Active LLM source list, select one of the supported LLM sources.
  3. Depending on the selected LLM source, consider the following instructions:
  1. In the Gradio URL list, select one of the h2oGPT URL model endpoints.
    • This setting refers to the Gradio URL to the h2oGPT model endpoint (that is either the public https://gpt.h2o.ai endpoint or one's local Gradio endpoint generated by the h2oGPT repo).
    • You can utilize the llama.h2o.ai endpoint in case of an outage on gpt.h2o.ai.
  2. Click Save.

Supported large language model (LLM) sources​

Below, observe the supported LLMs in H2O Model Validation.

h2oGPT​

H2O Generative Pre-trained Transformer (h2oGPT) is an H2OAI large language model (LLM) fine-tuning framework and chatbot UI with document(s) question-answer capabilities.

H2O MLOps​

H2O MLOps is an open, interoperable platform for model deployment, management, governance, monitoring, and alerting that features integration with H2O Driverless AI, H2O-3 open source, and third-party models.

OpenAI​

Generative Pre-trained Transformer 4 (GPT-4) is a large language model (LLM) created by OpenAI.

  • To learn more, see GPT-4.
Feedback