NeMo Relay
An agent observability tool from NVIDIA that provides fine-grained tracing of Agent Harness behavior. It helps developers transform the agent execution process from a black box into a traceable workflow, supporting process evaluation and efficiency optimization.
Timeline (last 90 days)
NeMo Relay is an observability component within the NVIDIA NeMo ecosystem, responsible for intercepting and structurally logging the inputs, outputs, latency, and other metadata of each LLM call and tool call, and exporting them in an OpenTelemetry-compatible format.
During the real task run, the execution order was: Phoenix starts first, then Hermes begins working, and Relay exports trace data to Phoenix in real time.
Patrick Moorhead is an NVIDIA technical marketing engineer who demonstrated using NeMo Relay to perform chain tracing on the Hermes agent and visualize it in Phoenix.
NeMo Relay is natively integrated with the Hermes installation and requires no additional separate deployment.
In the demo, the minimal validation task required Hermes to run a script and return the printed result 42; after running, it returned correctly and Relay fully recorded the execution.
NeMo Relay enables developers to see the complete path of an agent's task execution rather than just the endpoint, through fine-grained tracking of Agent Harness behavior.
NVIDIA has introduced NeMo Relay, a tool for tracking the behavioral trajectories of Agent Harnesses to address the observability gap.
All Facts (7)
NeMo Relay is an observability component within the NVIDIA NeMo ecosystem, responsible for intercepting and structurally logging the inputs, outputs, latency, and other metadata of each LLM call and tool call, and exporting them in an OpenTelemetry-compatible format.
50%UnverifiedNeMo Relay is natively integrated with the Hermes installation and requires no additional separate deployment.
50%UnverifiedDuring the real task run, the execution order was: Phoenix starts first, then Hermes begins working, and Relay exports trace data to Phoenix in real time.
50%UnverifiedPatrick Moorhead is an NVIDIA technical marketing engineer who demonstrated using NeMo Relay to perform chain tracing on the Hermes agent and visualize it in Phoenix.
50%UnverifiedNeMo Relay enables developers to see the complete path of an agent's task execution rather than just the endpoint, through fine-grained tracking of Agent Harness behavior.
50%UnverifiedIn the demo, the minimal validation task required Hermes to run a script and return the printed result 42; after running, it returned correctly and Relay fully recorded the execution.
50%UnverifiedNVIDIA has introduced NeMo Relay, a tool for tracking the behavioral trajectories of Agent Harnesses to address the observability gap.
50%