Skip to main content

Create a new workflow

Overview​

H2O Eval Studio includes the MRM Workflows capability, a new tool for Model Risk Management. It provides a systematic methodology for evaluating RAG systems, detecting weaknesses, testing robustness, and incorporating a human-in-the-loop to calibrate evaluation criteria.

This page explains how to create a new workflow.

Instructions​

To create a new workflow:

  1. Click Workflows in the left navigation bar.
  2. Click New workflow.
  3. In the Workflow name box, enter a name (for example, My workflow).
  4. (Optional) In the Description box, enter a brief summary of the workflow.
  5. From the Model host drop-down menu, select a model host.
  6. From the LLM model drop-down menu, select a model for your workflow.
  7. In the Document section, choose an existing document, a collection, or upload a new one that contains the information you want to analyze.
  8. (Optional) In the Parameters field, enter advanced model settings in JSON format.
  9. Click Create. Create a new workflow
Feedback