NVIDIA Certified Professional: Agentic AI NCP-AAI Cheatsheet
Everything worth re-reading in the hour before you sit NCP-AAI, on one page. No explanations — just the facts, the weights, the traps and the judgement calls. Print it or keep it open beside your last practice run.
Exam facts
- Credential
- NVIDIA-Certified Professional: Agentic AI
- Exam code
- NCP-AAI
- Level
- Professional (intermediate)
- Duration
- 120 minutes
- Questions
- 60–70
- Passing score
- 70%
- Price
- $200 USD
- Delivery
- Online, remotely proctored, via Certiverse
- Validity
- 2 years from issuance — recertify by retaking
- Question format
- Multiple choice
Domain weights
- Agent Architecture and Design15%
- Agent Development15%
- Evaluation and Tuning13%
- Deployment and Scaling13%
- Cognition, Planning, and Memory10%
- Knowledge Integration and Data Handling10%
- NVIDIA Platform Implementation7%
- Run, Monitor, and Maintain5%
- Safety, Ethics, and Compliance5%
- Human-AI Interaction and Oversight5%
Study time follows weight. The top two domains are more than half the exam.
Exam-day tactics
- Pace at just over a minute a question. The paper can run to 70 questions in 120 minutes, so a little over 90 seconds each is the pace to rehearse. Flag anything still unresolved at two minutes and move on.
- Find the constraint before you eliminate. Scenario questions name a constraint — latency, cost, availability, a specific failure type. Two options are usually right for the general subject and wrong for the stated constraint. Find the constraint clause first.
- Know each pattern's trigger condition, not just its name. Retry fires on a transient fault; the circuit breaker fires on a persistent one. Knowing the definitions is not the same as knowing which condition in a scenario calls for which — practice classifying the fault first.
- Know each NVIDIA tool by its one job. Toolkit orchestrates, NIM serves, TensorRT-LLM optimizes, Triton hosts, Guardrails constrains, a vector database indexes. One clear sentence per tool resolves most platform questions.
- Separate "is it good" from "is it fast". Evaluation and profiling answer different questions. When a scenario reports a metric improved, check which kind of metric it was before assuming the change was a win.
- Measure readiness by your weakest domain. A strong overall average can hide a domain you would fail on its own. Track results per domain and keep studying the lowest one, weighting the two largest domains first.
One trap per domain
The most common miss is treating "multi-agent" as inherently centralized — decentralized, federated, and hierarchical are distinct topologies with different failure and governance profiles, and a single agent with many tools is not automatically a multi-agent system. A close second is assuming more reasoning tokens guarantee correctness; in ReAct, it is the observation step that curbs hallucination, not the volume of reasoning.
The phrase "error handling" and "write software components or scripts" makes this sound like a coding exam. It is not — almost nothing here tests Python syntax. The single biggest trap is naming only Closed and Open for the circuit breaker and forgetting Half-Open, its recovery test; a close second is retrying a non-idempotent operation without a safeguard, or nesting retry layers that multiply load on an already-struggling dependency.
Evaluation and profiling get treated as the same activity, and they are not: evaluation tells you whether to change something, profiling tells you where the cost is. A question that optimizes a profiler metric like latency without re-checking evaluation is testing whether you will silently let quality degrade while a dashboard number improves.
NIM is not a model, and NIM is not Triton — it is a prepackaged microservice, and Triton is the general inference server underneath it (or something you run yourself). A close second: assuming single-node benchmarks predict distributed behavior, when contention, network latency, and tail effects only show up once you actually scale.
Reciting only task decomposition as "the" planning method is the standing trap — the underlying survey names five distinct directions, and Reflection and Plan Selection are common distractor-versus-correct pairs. A second, equally common miss is treating short-term memory as if it persists across sessions; it does not, by definition.
GraphRAG and vector RAG get set up as an either/or choice, and they are not — HybridRAG exists specifically to combine relational and semantic retrieval. The second common miss is treating agentic RAG as just RAG with an agent label on it: it plans sub-questions and reformulates on thin results rather than doing one lookup and stopping.
The toolkit does not replace your framework — it is framework-agnostic and works alongside LangChain, CrewAI, LlamaIndex, and Semantic Kernel, and its Model Context Protocol support is bidirectional, client and server both. Conflating the toolkit, NIM, TensorRT-LLM, Triton, and Guardrails is the domain's most common miss: each of the five has exactly one job.
Monitoring only infrastructure metrics — CPU, GPU, and memory graphs — misses agent-behavior drift entirely; you need step-level tracing to catch a multi-agent system producing conflicting actions. Treating retraining and versioning as manual, one-off tasks is the second standing miss, since the objective names automation explicitly.
Naming only input and output rails is the domain's most common miss — NeMo Guardrails has five stages, also dialog, retrieval, and execution. The second is conflating guardrails with bias mitigation: guardrails constrain and steer behavior at runtime, they do not retrain or debias the underlying model.
HITL gets treated as a free accuracy upgrade, and the drawbacks are just as testable as the benefits — added cost and latency is real, human reviewers disagree with each other, and exposing data to reviewers carries its own privacy risk. The second common miss is confusing RLHF, which trains a reward model from human feedback, with plain supervised labeling.
Where the questions concentrate
The three subjects that carry the most marks in each domain.
Agent Architecture and Design15%
- ReAct
- Multi-agent orchestration topologies
- Memory as an architectural decision
Agent Development15%
- The Retry pattern versus the Circuit Breaker pattern
- The circuit breaker's three states
- Idempotency as the precondition that makes a safe retry possible at all
Evaluation and Tuning13%
- Profiling versus evaluation
- The accuracy-versus-latency trade-off, and why "just maximize accuracy" is usually the wrong answer for a production scenario
- The NeMo Agent Toolkit's built-in evaluation system and profiler
Deployment and Scaling13%
- NVIDIA NIM
- Containerization and Kubernetes with load balancing as the scaling mechanism
- The serving stack's division of labor
Cognition, Planning, and Memory10%
- The full memory taxonomy
- The five planning directions (Task Decomposition, Plan Selection, External Module, Reflection, Memory), not just decomposition
- Why an LLM needs an explicit memory component at all, since every call is stateless on its own
Knowledge Integration and Data Handling10%
- The canonical RAG pipeline end to end
- Distinguishing vector RAG, GraphRAG, HybridRAG, and agentic RAG from one another
- Why query and document embeddings must come from the same model and vector space to be comparable
NVIDIA Platform Implementation7%
- The NeMo Agent Toolkit's framework-agnostic design
- NIM as a containerized, GPU-accelerated inference microservice, and its supported backends (TensorRT-LLM, vLLM)
- TensorRT-LLM (optimizes) versus Triton (serves) as two roles the exam constantly tests against each other
Run, Monitor, and Maintain5%
- Per-step telemetry and tracing as what actually diagnoses multi-agent behavior drift
- Monitoring (live operational health) versus evaluation (pre-release quality) as two distinct activities
- Continuous regression benchmarking of a live agent against prior versions
Safety, Ethics, and Compliance5%
- NeMo Guardrails' five rail stages
- Colang plus YAML as the configuration approach for guardrail flows, extendable with custom Python actions
- Layered safety
Human-AI Interaction and Oversight5%
- Human-in-the-loop benefits (accuracy, accountability, transparency) and drawbacks (cost and latency, reviewer inconsistency, privacy risk)
- HITL techniques
- The EU AI Act, Article 14's human-oversight requirement for high-risk systems
Every NVIDIA tool by its one job
Most wrong options are a real product doing a job that belongs to a different one.
| Tool | Its job | Not for |
|---|---|---|
| NeMo Agent Toolkit | Orchestrates and evaluates an agent workflow, framework-agnostically | Serving or optimizing a model — that is NIM, TensorRT-LLM, and Triton's job. |
| NVIDIA NIM | Serves a model behind a standard API endpoint as a containerized microservice | Being the model itself, or replacing Triton underneath it. |
| TensorRT-LLM | Optimizes an LLM for fast GPU inference before serving | Serving traffic on its own — something else hosts the optimized engine. |
| Triton Inference Server | Serves models across frameworks with dynamic batching and concurrency | Optimizing the model itself — Triton runs what you give it. |
| NeMo Guardrails | Constrains agent input, output, and tool calls at runtime, with an auditable log | Debiasing or retraining the underlying model — that is a data and training concern. |
| Vector database (e.g., Milvus) | Indexes embeddings and answers nearest-neighbor queries for RAG | Generating the embeddings — an embedding model produces them. |
| Kubernetes | Orchestrates container replicas: scheduling, self-healing, autoscaling | Optimizing or serving a model directly — it schedules the containers that do. |
Metrics, and what each one hides
The exam asks which metric answers which question. The blind spot is the half most candidates cannot state.
| Metric | Measures | Use when | Blind spot |
|---|---|---|---|
| Latency percentiles (p50/p95/p99) | How long a request takes, including tail behavior | Judging whether a deployment meets a stated response-time requirement | A good median can hide a bad p99 that the most-affected users actually experience |
| Throughput | Requests or tokens processed per second | Sizing capacity for a stated load | High throughput at high latency can still fail a user-facing requirement |
| Error rate | Share of requests or tool calls that fail | Tracking live reliability and deciding when a circuit breaker should trip | Says nothing about whether the successful responses were actually correct |
| Profiler output (token counts, timings, bottlenecks) | Where an agent run spends time and tokens | Deciding what to optimize before changing anything | Tells you where the cost is, not whether the output is any good — that is evaluation's job |
| Task benchmark score (evaluation pipeline) | How good the agent's outputs are against a fixed, repeatable task set | Comparing agent versions or configurations after a change | A benchmark score alone does not tell you which stage — reasoning, retrieval, or a tool call — produced a bad run |
| Uptime / availability | Share of time the live service is reachable and functioning | Judging whether a deployment meets a stated high-availability requirement | A system can be up and still be behaviorally wrong — uptime does not catch quality drift |
Numbers worth knowing
- 120 min
- Exam duration.
- 60–70
- Questions on the paper, multiple choice.
- 10 domains
- Agent Architecture and Design through Human-AI Interaction and Oversight.
- 15%
- Agent Architecture and Design, and Agent Development — tied for the largest domains.
- 5 rail stages
- NeMo Guardrails: input, dialog, retrieval, execution, output.
- 5 planning directions
- Task Decomposition, Plan Selection, External Module, Reflection, Memory.
- 3 breaker states
- Circuit breaker: Closed, Open, Half-Open.
- $200
- Exam fee in USD, one attempt.
- 2 years
- Validity. Recertify by retaking.
Acronyms
The fastest-decaying knowledge under exam pressure.
- RAG
- Retrieval-Augmented Generation
- MCP
- Model Context Protocol
- NIM
- NVIDIA Inference Microservices
- HITL
- Human-in-the-Loop
- RLHF
- Reinforcement Learning from Human Feedback
- ETL
- Extract, Transform, Load
- ANN
- Approximate Nearest Neighbor
- MLOps
- Machine Learning Operations
- CI/CD
- Continuous Integration / Continuous Delivery
- PII
- Personally Identifiable Information
If you only read four things
- ReAct: Synergizing Reasoning and Acting in Language ModelsYao et al., 2022 — the reasoning-and-acting framework the whole exam assumes
- Understanding the Planning of LLM Agents: A SurveyHuang et al., 2024, arXiv:2402.02716 — the five planning directions
- AI Agent MemoryIBM — the memory taxonomy behind Domain 5
- Retry PatternAzure Architecture Center, Microsoft Learn
Ready for a timed run?
Sit a full-length mock at exam pace, or drill the domain you are weakest in.