Reference
The HELM glossary
The definitive reference for agentic-operations vocabulary: 53 terms, each with a one-sentence definition precise enough to quote, the formula behind it where one exists, and how the term is commonly misused.
Operations practice
The vocabulary of running and measuring an operation: incidents, objectives, and the discipline of turning noisy telemetry into a correlated, prioritized record.
19 terms- AIOpsalso "AI for IT operations", "AIOps platform"
AIOps is the application of machine learning and analytics to operations telemetry so that noisy logs, metrics, and alerts become correlated incidents rather than a stream a person must read one line at a time.
Common mistakeMarketing any dashboard with a machine-learning badge as AIOps, even when it only correlates alerts and never recommends or takes a bounded action.
See alsoagentic operations, event correlation, noise reduction, observability
- agentic operationsalso "Agentic Ops", "agentic IT operations"
Agentic operations is the practice of assigning bounded, observable AI agents to investigate and propose fixes for operational problems under a named human approval boundary, rather than only surfacing alerts for a person to work by hand.
Common mistakeCalling a system agentic because it can call a large language model, when nothing in it actually proposes or takes an action against a live system.
See alsoAIOps, agentic AI, human-in-the-loop, graduated trust
- observabilityalso "o11y"
Observability is the property of a system that lets an operator infer its internal state, including states the system was not explicitly built to report, from the logs, metrics, and traces it externally emits.
Common mistakeTreating observability as a product category rather than a property, so buying a tool is assumed to grant it regardless of what telemetry the estate actually emits.
See alsoagent observability, agent trace, event correlation, coverage
- event correlationalso "alert correlation"
Event correlation is the process of grouping related telemetry events, such as several monitoring alerts describing one underlying fault, into a single incident record instead of leaving each alert to be worked separately.
Formula
ratio(incidents, records)Common mistakeAssuming correlation alone explains a fault, when grouping related alerts together says nothing about which one of them is the cause.
See alsonoise reduction, AIOps, situation, incident
- noise reductionalso "signal-to-noise improvement"
Noise reduction is the decrease in the number of items an operator must review as raw events are correlated into incidents and incidents are consolidated into situations.
Formula
ratio(situations, incidents)Common mistakeReporting a noise-reduction percentage without stating the two stage counts it was computed from, so the ratio cannot be checked against the record.
See alsoevent correlation, situation, coverage
- incidentalso "service incident"
An incident is a recorded, time-stamped disruption to a service, tracked from when it started through acknowledgement to resolution, and classified by severity.
Common mistakeUsing incident and situation interchangeably, when a situation can span or precede the incidents it is later shown to explain.
See alsosituation, MTTA, MTTR, postmortem
- situationalso "case", "correlated situation"
A situation is a correlated, ranked case that gathers the evidence, impacted services, and a recommended action for an emerging problem, whether or not an incident has yet been declared against it.
Common mistakeAssuming a situation always follows an incident, when the platform's situation record can exist before any incident has been opened.
See alsoincident, event correlation, evidence receipt
- MTTAalso "mean time to acknowledge"
MTTA, mean time to acknowledge, is the average elapsed time from an incident starting to a responder taking ownership of it.
Formula
mean of acknowledgedAt − startedAt over incidents with an acknowledgementCommon mistakeAveraging every incident including ones never acknowledged, which either breaks the calculation or silently drags the reported average toward zero.
- MTTRalso "mean time to resolve", "mean time to repair"
MTTR, mean time to resolve, is the average elapsed time from an incident starting to its resolution, measured only over incidents that have actually resolved.
Formula
mean of resolvedAt − startedAt over resolved incidentsCommon mistakeQuoting an MTTR improvement without saying whether it covers every severity or only the incidents convenient to the claim.
See alsoMTTA, MTTD, error budget, postmortem
- MTTDalso "mean time to detect"
MTTD, mean time to detect, is the average elapsed time from when a fault actually begins to when monitoring or a person first notices it.
Common mistakeTreating an incident's started timestamp as its detection time, when the two differ whenever a fault runs silently before anyone opens a record for it.
See alsoMTTA, MTTR, observability
- error budgetalso "error budget remaining"
An error budget is the amount of allowed unreliability still available under a service level objective before that objective is breached, expressed as a percentage of the target not yet spent.
Formula
min of serviceHealth.slos[].errorBudgetRemainingPercentCommon mistakeTreating a shrinking error budget as itself an incident, when it is a leading warning that only becomes an incident once the objective is actually breached.
- burn ratealso "error budget burn rate"
Burn rate is the speed at which a service is consuming its error budget, expressed as a multiple of the rate that would exhaust the budget exactly at the end of the measurement window.
Formula
max of serviceHealth.slos[].burnRateCommon mistakeReading a burn rate above one as an active incident, when it means the budget is depleting faster than sustainable, not that the objective has already been missed.
See alsoerror budget, SLO
- SLOalso "service level objective"
An SLO, service level objective, is the target level of a measured service level indicator that a service commits to over a defined window.
Formula
mean of serviceHealth.slos[].attainmentPercentCommon mistakeConfusing an SLO with an SLA, when the objective is an internal engineering target and the agreement is the external, often contractual, commitment built on top of it.
See alsoSLI, error budget, burn rate
- SLIalso "service level indicator"
An SLI, service level indicator, is the specific measured quantity, such as availability or latency, that a service level objective sets a target for.
Common mistakePicking an SLI that is easy to measure rather than one that reflects what a user actually experiences, such as server-side success rate instead of completed user requests.
See alsoSLO, error budget
- change-failure ratealso "CFR", "change failure rate"
Change-failure rate is the share of production changes that cause a degradation, an incident, or a rollback, measured against every change deployed in the same period.
Common mistakeQuoting a change-failure rate without defining what counts as a failure, since a rollback, a hotfix, and a customer-visible incident are not the same event.
See alsoblast radius, runbook
- blast radiusalso "impact radius"
Blast radius is the extent of a system, measured in affected services, sites, or users, that a single failure or change can reach before it is contained.
Common mistakeEstimating blast radius from a service's architecture diagram alone, when shared infrastructure and hidden dependencies routinely widen it beyond the diagram.
See alsochange-failure rate, authority boundary
- runbookalso "playbook"
A runbook is a documented, repeatable procedure for diagnosing or resolving a specific class of operational problem, written so a responder or an agent can follow it under pressure.
Common mistakeWriting a runbook once and never revising it, so it drifts out of step with a system that has since changed underneath it.
See alsoon-call, postmortem, governed action
- on-callalso "on-call rotation", "on-call roster"
On-call is the rotation of responders, human or agent, who carry responsibility for acknowledging and responding to incidents during a scheduled shift.
Common mistakeAdding an agent to a roster without also defining its escalation path, so an incident an agent cannot resolve waits for a human who was never notified.
See alsoMTTA, runbook, specialist agent
- postmortemalso "incident review", "retrospective"
A postmortem is the written record produced after an incident closes that reconstructs its timeline, root cause, and the follow-up actions the team commits to.
Common mistakeWriting a postmortem that assigns blame to a person, which discourages the honest reporting a postmortem depends on to find the real cause.
AI and agents
How an AI agent reasons, calls tools, and earns or is denied the authority to act on a live system.
14 terms- agentic AIalso "AI agent system"
Agentic AI is a system built from one or more AI agents that pursue a goal across multiple steps, calling tools and observing the results, rather than returning a single response to a single prompt.
Common mistakeCalling a chatbot agentic because it can hold a conversation, when nothing in it plans multiple steps or calls a tool against a live system.
See alsospecialist agent, tool call, agentic operations
- specialist agentalso "domain agent"
A specialist agent is an AI agent scoped to one operational domain or task, such as a filesystem-capacity investigator or a change-risk advisor, rather than a single general-purpose assistant covering everything.
Common mistakeDeploying one broad agent for every domain and calling each invocation a specialist, when nothing scopes its authority, tools, or context to that domain.
See alsoagentic AI, autonomy gradation, on-call
- autonomy gradationalso "autonomy dial", "progressive autonomy"
Autonomy gradation is the practice of assigning an AI agent one of several defined levels of independence, from observe-only through propose, act-with-approval, and act, rather than a single all-or-nothing switch.
Common mistakeDescribing a system as having graduated autonomy when it exposes no visible, per-workflow setting a person can actually inspect or change.
See alsohuman-in-the-loop, graduated trust, governed action
- human-in-the-loopalso "HITL"
Human-in-the-loop is a design in which an AI agent's proposed output must be reviewed or approved by a person before it takes effect on a live system.
Common mistakeCalling a system human-in-the-loop when the review step is a notification the person can ignore rather than an approval the action actually waits on.
See alsoautonomy gradation, governed action, graduated trust
SourceThe Register: survey of SREs on AI agents in production
- graduated trustalso "trust escalation"
Graduated trust is the earned expansion of an agent's authority over time, based on its demonstrated track record, rather than an authority level fixed permanently at deployment.
Common mistakeGranting an agent broad authority immediately because an early pilot went well, without a defined path for that authority to be revoked if its record later changes.
See alsoautonomy gradation, abstention, human-in-the-loop
SourceCleric: AI SRE
- abstentionalso "declining to act", "escalation on low confidence"
Abstention is an agent declining to propose or take an action when its confidence in the available evidence falls below a defined threshold, rather than guessing.
Common mistakeTreating every abstention as a failure of the agent, when an abstention that correctly flags insufficient evidence is the system working as designed.
See alsohallucination in operations, graduated trust, human-in-the-loop
- hallucination in operationsalso "ungrounded claim"
Hallucination in operations is an AI agent stating a fact, root cause, or fix as established when the operational record does not actually support the claim.
Common mistakeAssuming hallucination only means an invented citation, when a plausible but unsupported root cause in an incident write-up is the same failure with higher stakes.
See alsogrounded prompt, abstention, evidence receipt
- agent observabilityalso "AI observability"
Agent observability is the ability to inspect what an AI agent believed, planned, and did at each step of a task, not only the final answer it returned.
Common mistakeEquating agent observability with logging every prompt and response, when the useful record also needs the tool calls, evidence, and reasoning that connected them.
See alsoagent trace, tool call, observability
- agent tracealso "reasoning trace", "execution trace"
An agent trace is the ordered record of an AI agent's reasoning steps, tool calls, and observations for a single task, replayable end to end.
Common mistakePublishing a trace that shows the agent's final explanation without the intermediate tool calls, which is a narration of the work rather than a trace of it.
See alsoagent observability, tool call, agentic AI
- tool callalso "function call"
A tool call is a single, structured invocation an AI agent makes to an external function, API, or system, together with the arguments it passed and the result it received.
Common mistakeCounting a tool call as successful because it returned without an error, when returning the wrong data is a silent failure a status code will not reveal.
See alsoagent trace, MCP, model gateway
- MCPalso "Model Context Protocol"
MCP, the Model Context Protocol, is an open standard that lets an AI agent discover and call external tools and data sources through one consistent interface instead of a bespoke integration per source.
Common mistakeTreating MCP as a guarantee of safety or scope, when the protocol standardizes how a tool is called and says nothing about what authority that tool may exercise.
See alsotool call, agent-to-agent protocol, model gateway
- agent-to-agent protocolalso "A2A", "agent-to-agent interoperability"
An agent-to-agent protocol is a standard by which AI agents built on different frameworks or by different vendors can exchange tasks, context, and results with each other.
Common mistakeAssuming agents from different vendors can already cooperate because both are described as agentic, when without a shared protocol neither can hand the other a task.
See alsoMCP, model gateway, specialist agent
- model gatewayalso "LLM gateway", "model router"
A model gateway is the layer that routes an application's requests to one of several interchangeable AI model providers, so the application is not locked to a single vendor's model.
Common mistakeAssuming a model gateway makes every model interchangeable in practice, when prompts, tool schemas, and evaluation still need to be checked against each provider.
See alsoMCP, grounded prompt, agentic AI
- grounded promptalso "retrieval-grounded prompt"
A grounded prompt is an instruction to an AI model that is assembled from, and constrained to, verified data drawn from the operational record rather than the model's own unverified recall.
Common mistakeCalling a prompt grounded because it references real field names, when the values inserted into it were never checked against the record the names claim to describe.
See alsohallucination in operations, evidence receipt, model gateway
Governance and compliance
The controls, records, and boundaries that make an autonomous system auditable and safe to authorize.
15 terms- separation of dutiesalso "SoD"
Separation of duties is a control that requires two different principals to complete a sensitive action, so that no single identity can both request and approve the same change.
Common mistakeWriting separation of duties as a policy statement without an enforcement point, so nothing actually stops one identity from proposing and approving the same action.
See alsofour-eyes principle, authority boundary, role-based access control
- four-eyes principlealso "two-person rule", "maker-checker"
The four-eyes principle is the requirement that at least two people review and agree to an action before it takes effect, named for the two sets of eyes involved in the review.
Common mistakeSatisfying a four-eyes requirement with two approvals from the same team acting on the same incomplete information, rather than an independent second review.
See alsoseparation of duties, governed action
- authority boundaryalso "scope of authority"
An authority boundary is the explicit limit on what an identity, human or agent, is permitted to decide or execute, enforced at the point an action is requested rather than assumed from a role title alone.
Common mistakeDefining an authority boundary in a policy document that the system carrying out the action never actually checks against.
See alsogoverned action, least privilege, effect permission
- governed actionalso "controlled action"
A governed action is a proposed change to a live system that only takes effect after it clears a named authority boundary, and that leaves a record of who proposed it, who approved it, and when it ran.
Common mistakeCalling an action governed because a person clicked a button, when nothing in the system would have stopped the action from running without that click.
See alsoauthority boundary, separation of duties, evidence receipt
- evidence receiptalso "decision receipt"
An evidence receipt is a durable record attached to a decision or action that names the data it drew on, the reasoning applied, and who or what took the resulting step.
Common mistakeProducing a narrative summary of a decision and calling it a receipt, when a receipt must name the actual source fields a reader can go check.
See alsocustody, hash-linked ledger, audit trail
- custodyalso "chain of custody"
Custody is the unbroken record of who or what held responsibility for a piece of evidence or an action from its creation to the present, so its provenance can be verified rather than assumed.
Common mistakeKeeping a log of who touched a record without also keeping its state at each handoff, which proves access happened but not what changed.
See alsoevidence receipt, hash-linked ledger, immutability
- hash-linked ledgeralso "tamper-evident ledger"
A hash-linked ledger is a sequence of records in which each entry's hash is computed from its own content plus the previous entry's hash, so altering or removing any past entry breaks every hash that follows it.
Common mistakeCalling a database with a created-at timestamp a ledger, when nothing about it would reveal a row that was edited after the fact.
See alsoimmutability, custody, attestation
- immutabilityalso "append-only"
Immutability is the property that a recorded entry cannot be altered after it is written, so any later correction must appear as a new entry rather than a change to the old one.
Common mistakeAssuming a database is immutable because the application's interface has no edit button, when the underlying rows can still be updated directly.
See alsohash-linked ledger, custody, continuous control monitoring
- attestationalso "signed attestation"
An attestation is a signed statement by an identified party, human or system, confirming that a specific record, release, or control was in the stated condition at a stated time.
Common mistakeAccepting a vendor's self-reported outcome percentage as an attestation, when nothing about it is signed, dated, or checkable by a third party.
See alsoevidence receipt, continuous control monitoring, audit trail
- continuous control monitoringalso "CCM"
Continuous control monitoring is the automated, ongoing verification that a required control, such as an approval gate or an access boundary, is actually operating as designed, rather than a periodic manual check.
Common mistakeTreating a passed annual audit as evidence a control is working today, when continuous monitoring exists precisely because a control can silently fail between audits.
See alsoaudit trail, attestation, authority boundary
- audit trailalso "audit log"
An audit trail is the complete, ordered record of the actions taken on a system, including who or what took each one and when, sufficient to reconstruct events after the fact.
Common mistakeKeeping an audit trail of successful actions only, when the record of a denied or failed attempt is often what an investigation actually needs.
See alsoevidence receipt, continuous control monitoring, role-based access control
- data residencyalso "data localization"
Data residency is the requirement that specified data be stored, and sometimes processed, only within a named geographic or jurisdictional boundary.
Common mistakeSatisfying data residency for storage while still routing the same data through a processing or model endpoint located outside the required boundary.
See alsoleast privilege, authority boundary
- least privilegealso "principle of least privilege", "PoLP"
Least privilege is the principle that an identity, human or agent, should hold only the permissions its current task requires, and no broader access kept in reserve for convenience.
Common mistakeGranting a broad role once during setup because narrower roles are inconvenient to configure, then never revisiting it as the actual task narrows.
See alsorole-based access control, authority boundary, effect permission
- role-based access controlalso "RBAC"
Role-based access control is an access model that grants permissions to a named role rather than to an individual identity, so a person or an agent's access follows the role they are assigned.
Common mistakeConfusing a role label with the actual permission set behind it, when two people can carry the same job title while holding differently scoped roles in the system.
See alsoleast privilege, separation of duties, effect permission
- effect permissionalso "write permission", "action permission"
An effect permission is a granted capability that can change something outside the reader's own screen, such as approving a decision or executing an action, as distinct from a permission that only grants visibility.
Common mistakeAuditing only which permissions exist for a role without separating which of them carry an effect, which is the distinction that actually determines blast radius.
See alsoleast privilege, authority boundary, role-based access control
Value
How a claimed benefit is measured, modeled, and told apart from one that has actually happened.
5 terms- avoidable spendalso "cost avoidance"
Avoidable spend is the portion of a monthly run rate that a specific, named opportunity, such as an idle compute reservation, could eliminate if it were acted on.
Formula
costCapacity.monthlyRunRateUsd; avoidable value is modeledCommon mistakePresenting avoidable spend as savings already achieved, when the figure is a modeled opportunity that has not yet been realised.
See alsomodeled versus measured, realised outcome
- modeled versus measuredalso "modeled vs measured", "estimate versus observation"
Modeled versus measured is the distinction between a figure calculated from an assumption or a simulation and a figure read directly from an observed system, and it must be labelled every time either kind of number is shown.
Common mistakeDropping the modeled label once a number has circulated for a while, so a reader later treats an estimate as an observed result.
See alsoavoidable spend, realised outcome, source gap
- realised outcomealso "realized outcome", "confirmed result"
A realised outcome is a result confirmed to have actually occurred, such as a cost reduction that appeared on a subsequent bill, as distinct from a modeled projection of what acting on a recommendation would produce.
Common mistakeCounting a recommendation as an outcome the moment it is approved, when nothing has been realised until the approved action's effect is later confirmed.
See alsomodeled versus measured, avoidable spend
- source gapalso "known gap", "coverage gap"
A source gap is a known area of the operating estate that no connected telemetry source currently covers, tracked explicitly rather than left to appear as false good health.
Formula
telemetry.sourceGapCountCommon mistakeLetting an uncovered area of the estate read as healthy by default, when the honest state behind a source gap is unknown, not good.
See alsocoverage, modeled versus measured
- coveragealso "source coverage", "telemetry coverage"
Coverage is the share of an operating estate's registered telemetry sources that are actively connected and reporting fresh data, measured against every source registered for that estate.
Formula
telemetry.coveragePercent and source status countsCommon mistakeReporting coverage as a share of sources with any historical connection, rather than sources currently fresh, so a source that went stale months ago still counts toward the total.
See alsosource gap, observability
A-Z index
Every term in this glossary, in alphabetical order.