AI Unit Hourly

This section provides detailed information on the daily cumulative hourly peak usage of AI units that are used in your H2O AI Managed Cloud (HAMC) environment.

To access this page, select AI unit hourly in the left navigation bar.

The page header displays the following information:

• Environment start date: The start date of the HAMC environment where the app is installed.
• Environment expiration date: The expiration date of the HAMC environment where the app is installed.
• Purchased AI units: The total number of AI units purchased.

note

AI unit data is updated twice daily.

The AI unit hourly page contains two tabs:

• Cumulative summary
• Component summary

Set thresholds

Admins can set usage thresholds so they receive an email alert when AI unit usage reaches one of the configured levels. These thresholds apply to AI unit usage for the entire contract period and do not affect the threshold shown when you switch a chart to view a specific month.

To set custom thresholds:

1. Open the Set Thresholds panel

   Click Set Thresholds in the top-right corner.

2. Define a threshold

   In the Set Custom Thresholds side panel, enter a percentage and select a severity level (for example, Info, Low, Warn, High, or Critical) for each threshold.

   
3. Add more thresholds

   Click + Add Threshold to add another threshold.

4. Save your changes

   Click Save to apply your changes.

note

Admins receive an alert email by default when usage reaches the 90% threshold level, even if no custom thresholds have been set.

Cumulative summary

The Cumulative summary tab displays the daily cumulative hourly usage of AI units.

note

The Cumulative summary tab contains two integrated plots that provide complementary views of AI unit usage:

• Plot 1: Shows usage over the entire contract period
• Plot 2: Shows monthly usage breakdowns

To switch between views, use the dropdown menu in the top-right corner of each plot.

Plot 1: Contract period

This chart displays the cumulative hourly peak usage of AI units over the entire contract period, from the environment start date to the expiration date.

The chart displays:

• AI unit usage: The actual maximum hourly consumption of AI units, shown as a percentage of the threshold value.
• Threshold value: The green line that represents the maximum number of cumulative AI units allowed for the entire contract period.
• Cumulative sum value: The line that shows the total cumulative value of AI units consumed over time.

Component breakdown

This chart breaks down the cumulative hourly peak usage of AI units by component. You can view data for the entire contract period or select a specific month from the dropdown menu.

tip

To hide specific components from the chart, select the component names in the legend below the chart:

Plot 2: Monthly view

This chart displays the cumulative hourly peak usage of AI units for a selected month. Use the dropdown menu to select a specific month.

The chart displays:

• AI unit usage: The actual maximum hourly consumption of AI units as a percentage of the monthly threshold value.
• Threshold value: The green line that represents the maximum number of cumulative AI units allowed for the selected month.
• Cumulative sum value: The red line that shows the total cumulative value of AI units consumed over time.

Component breakdown

This chart breaks down the cumulative hourly peak usage of AI units by component for the selected month.

tip

To hide specific components from the chart, select the component names in the legend below the chart:

Component summary

The Component summary tab displays the daily cumulative hourly peak usage of AI units for each application or product component installed in the environment.

note

This section contains two integrated plots that provide complementary views of AI unit usage by component:

• Plot 1: Shows usage over the entire contract period
• Plot 2: Shows monthly usage breakdowns

To switch between views, use the dropdown menu in the top-right corner of each plot.

Plot 1: Contract period

This chart displays the daily cumulative hourly peak usage of AI units for each component over the entire contract period.

Plot 2: Monthly view

This chart displays the daily cumulative hourly peak usage of AI units for each component in a selected month. Use the dropdown menu to select a specific month.

AI Unit calculation

To calculate the maximum capacity of AI Units consumed at a given point, AI Unit Hourly uses the following formula:

$$\text{AIUC} = \text{GPU} \times 2 + \text{MAX}\bigl((\text{MAX}(1, \text{CPU}) / 8.0 - \text{GPU}),\ (\text{RAM} / 64.0 - \text{GPU}),\ 0\bigr)$$

AIUC = AI Unit Consumption

• GPU: Measured in GPU cores (no distinction in GPU types is made)
• CPU: Measured in K8s vCPU units (with a minimum of 1)
• RAM: Measured in GBs (gigabytes)

Note

AI Unit Consumption is derived from Kubernetes resource requests for each workload, rather than limits or actual utilization.

• CPU and memory are calculated based on requested resources (with a minimum of 1 CPU core per deployment)
• Memory is measured in gigabytes
• GPU resources are mapped to a fixed number of AI Units per GPU

Example

For instance, consider that organization X has already consumed 1 GPU, 32 vCPUs, and 64 GBs of RAM since its first use of HAIC. Using the formula above, we can say that X at this point has consumed 5 AI Units since its first use of HAIC.

$$\begin{aligned} \text{AIUC} &= 1 \times 2 + \text{MAX}\bigl((\text{MAX}(1, 32) / 8.0 - 1),\ (64 / 64.0 - 1),\ 0\bigr) \\ \text{AIUC} &= 1 \times 2 + \text{MAX}\bigl((32 / 8.0 - 1),\ (1.0 - 1),\ 0\bigr) \\ \text{AIUC} &= 1 \times 2 + \text{MAX}\bigl((3),\ (0),\ 0\bigr) \\ \text{AIUC} &= 1 \times 2 + 3 \\ \text{AIUC} &= 5 \end{aligned}$$

---

Feedback

• Submit and view feedback for this page
• Send feedback about H2O Admin Center to cloud-feedback@h2o.ai