Skip to content
In this Guide

In this Guide

Deep Dives

AI: Claude and Codex patterns

ConfigHub: Deploy and manage

More in this Guide

Try NVIDIA AICR for GPUs

NVIDIA AICR turns five choices into one recipe for a GPU cluster. The choices are the service, the accelerator, the operating system, the workload and the platform. The Catalog holds 132 AICR recipes at v1.0.0, each kept as Argo CD Applications that you can read without a GPU.

Find your recipe in the Catalog · Read one AICR v1.0.0 recipe

Two things to try on this page

No GPU? Inspect a configuration locally · Already have GPU nodes? Compare them

What each path needs and proves

An “AICR platform” here is the composed set of Argo CD Applications AICR generates for one AI target, whether training or inference. This page never runs it, so it stays a stack in this site's sense, and never becomes the running, governed platform that stack could be.

The node comparison needs read access to a Kubernetes cluster and creates a temporary collector Job with its ServiceAccount and RBAC. It does not need an AICR recipe or deploy a platform bundle.

The retained-configuration exercise is local. It needs no ConfigHub account, Kubernetes cluster, cloud account, GPU, or registry login.

Compare a GPU workload with supplied Node facts with direct cub commands or an assistant, including saved results and a failure case.

Every AICR page

PageUse it to
The AICR entries in the CatalogFind the recipe for your service, accelerator and workload.
One AICR v1.0.0 recipeRead one recipe end to end. It is published as OCI and stored in ConfigHub.
One AICR v0.20.0 recipeSee a recipe promoted through development, staging and production.
Questions AICR users askGet answers with the commands that give them.
Compare two GPU nodesSee how two nodes differ, with no recipe.
One recipe under Argo CDRead what happened when one recipe ran on a throwaway cluster.
Where an AICR configuration comes fromCheck which NVIDIA recipe an entry came from.
What the AICR entries refuseSee what the Catalog will not claim for AICR.

Choose the question first

New to AICR, with no GPU or cluster? Start with the local configuration exercise. You will inspect retained files and their identity; you will not deploy them.

Already operate GPU nodes? Compare node snapshots. This needs cluster access and permission to create the temporary collector resources described above.

How inspection, destination checks and runtime proof differ
QuestionAICR path
What do I have?Use snapshot and diff to report differences between existing GPU nodes. No recipe, bundle, or Catalog match is required.
What will it produce?Select a provider-curated AICR leaf variant and inspect the exact files it generates.
Can this destination accept it?Check that the destination matches the variant's GPU, network, cloud, controller, credential, API, and component requirements.
Did it work?Run recipe-dependent resource and runtime checks only after the declared components have been deployed.

Path A: compare existing GPU nodes

Needs an existing Kubernetes cluster and collector permissions. The snapshot creates a temporary Job, ServiceAccount and RBAC; it does not change the node configuration. Use AICR's observation path when the question is whether two nodes or two points in time differ. It records kernel command-line settings, modules, system services, GPU hardware, and other measured state as YAML.

aicr snapshot --output baseline.yaml
# select the other node or repeat after the change
aicr snapshot --output current.yaml
aicr diff --baseline baseline.yaml --target current.yaml --fail-on-drift

A difference is not automatically a fault. Missing iommu=pt or nvidia_peermem is an observation first. A node without Mellanox networking may correctly omit both settings; a recipe intended for RDMA may require them.

Choose the recipe the provider intends for that node's service, accelerator, operating system, workload intent, platform, and relevant hardware before deciding what should change. NVIDIA curates the built-in AICR recipes. Other catalog providers can publish and review additional recipes.

Same observed targetResult
Assigned to standard networkingPass. The two RDMA settings do not apply.
Assigned to Mellanox RDMATwo findings: iommu=pt and nvidia_peermem.

The complete snapshot walkthrough includes a working local review command, a machine-readable result with both snapshot and profile hashes, optional local OCI output, and the commands that retain the review as non-deployable ConfigHub Units.

expected-resources answers a later question. It needs the selected variant and its declared components deployed. If those components are absent, record that check as blocked or not run; do not call it failed GPU conformance.

Read the maintained result · Open the complete review YAML · Open the AICR v0.20.0 release · See the tested assessment boundaries

Path B: inspect a retained configuration

This path reads a reviewed AICR-generated package. It does not inspect a live GPU node or prove that the selected platform runs.

WordWhat it means here
RecipeThe AICR recipe that NVIDIA curates, selected before generation.
BaseThe exact generated objects, digest, requirements, and evidence kept by the Catalog or ConfigHub.
VariantA later environment or policy change linked to that base.

Which AICR configuration is which

The Catalog holds the same NVIDIA AICR recipe at several versions, and this page runs a smaller selection from one of them. Choose by what you want to do.

You want toUseWhat it is
Run something now with no GPU, cluster or accountThe CPU starter on this pageSeven of the 17 Applications from NVIDIA AICR v0.14.0, selected by the Workshop because they need no GPU. It is not an upstream NVIDIA recipe. Read how the selection was made.
Inspect the whole recipe and take it into ConfigHubThe v0.20.0 entryAll 17 Applications of the EKS H100 training recipe with Kubeflow, with the charts inside them rendered and the five ConfigHub steps. It is the most fully recorded version.
See the newest NVIDIA releaseThe v1.0.0 entryThe same recipe at NVIDIA AICR v1.0.0, as 17 Applications. It is published as OCI. The charts inside its Applications are not rendered here.

None of the three has run on a GPU. Each entry page says what was and was not run for it.

1. Install ORAS

ORAS reads and writes OCI packages without running a container.

oras version

If that command fails, use the ORAS installation instructions.

2. Pull and check the configuration

Run one script. It uses an empty credential store for the public pull, checks the source digest, selects the seven reviewed files, and compares the local OCI with those files.

bash <(curl -fsSL https://confighub.github.io/helm-expt/site/sh/aicr-cpu-starter/try.sh)

Source: oci://europe-west1-docker.pkg.dev/nth-fort-499605-q5/helm-expt/aicr-eks-h100-training-kubeflow-argocd-config:0.14.0

Recorded source digest: sha256:dcf7feeeeaece04cb5d55cbc1106862172b3ae77718154252b39db1ad8957010

3. Read what you received

The result contains seven Argo CD Application files, the source-and-intent record that explains the selection, and a local OCI containing the same seven files.

find ./aicr-cpu-starter/config/templates -maxdepth 1 -type f -print
cat ./aicr-cpu-starter/source-and-intent.yaml
oras manifest fetch --oci-layout ./aicr-cpu-starter/aicr-cpu-starter.oci:0.14.0
Selected ApplicationArgo CD sync wave
cert-manager2
nfd3
prometheus-operator-crds6
kube-prometheus-stack7
k8s-ephemeral-storage-metrics9
kai-scheduler10
prometheus-adapter15

Expected local OCI digest: sha256:62eaf39703ca0e5e968fcd4a667cbccbb5b3ff16403471c4b3441b3681b2b225.

Where an AICR configuration comes from records the provider, catalog and selected recipe behind the retained configuration, and what this example proves.

Choose what to do next

Keep the files and OCI locally, or upload it into ConfigHub when your team needs shared changes, environment variants, approvals, and promotion from development to production. That account step is the same for every configuration.

To gate and move a change to this AI-platform configuration through environments, compare the exact object sets and promote the one that passed.

For deployment, choose the controller or direct path that will consume the reviewed objects. Do not apply this platform configuration until you have reviewed its component requirements and changed the recorded storage-class residue.

Compare this with a native platform built from tested parts. Build a Kubara platform composes similar components without Argo CD Applications from AICR. Apps on a platform defines how a workload lands on either kind.

Compare the other inference examples · Try the shorter Redis example