View workflow
Overview
This page explains how to view a workflow you created and what appears in the workflow dashboard. For instructions on creating a workflow, see Create a new workflow.
Instructions
To view a workflow:
- Click Workflows in the left navigation bar.
- In the Workflows table, select the workflow you want to view.
The workflow dashboard displays the following details:
- Model host: The model host selected during workflow creation.
- LLM model: The LLM model selected during workflow creation.
- Document / Collection: The document or collection selected during workflow creation.
- Created test: Displays once tests are created.
- Created evaluation: Displays once evaluations are created.
A workflow consists of the following eight steps. Each step becomes available once the previous step is complete:
- Topic modeling: Identifies the most relevant topics in the provided text.
- Text generation: Generates test cases based on the text and identified topics.
- Generated test validation: Validates the generated test suite.
- Automated evaluation: Evaluates the model using the generated test cases.
- Human evaluation calibration: Calibrates evaluation metrics through human input to improve accuracy and reliability.
- Weakness detection: Detects weak areas by evaluating performance across topics and query types.
- Robustness testing (input variations): Perturbs test cases to simulate different scenarios and evaluate model robustness.
- Robustness testing (adversarial inputs): Tests model robustness using adversarial inputs.
Clone workflow
To create a new workflow by cloning an existing one:
- Click Clone.
- Update the Workflow name, Description, Model host, LLM model, or Parameters fields as needed.
- Click Create.
Delete workflow
warning
This action permanently deletes the workflow from the server. It cannot be undone.
To delete a workflow:
- Click Delete.
- Click Delete again to confirm.
Feedback
- Submit and view feedback for this page
- Send feedback about H2O Eval Studio to cloud-feedback@h2o.ai