NCA-GENL6 phases5 domains

NVIDIA Certified Associate: Generative AI LLMs NCA-GENL Study Guide

Six phases, ordered so each one builds on the last. Every phase tells you how the exam questions that material, gives you a practice exercise, and ends with self-checks you should be able to answer without notes. The exercises are optional if you are short on time; the self-checks are not.

How to study for NCA-GENL

To study for the NVIDIA NCA-GENL certification, work through the five exam domains in order of weight rather than the order they are listed. Start with Core Machine Learning and AI Knowledge (30% of the exam), which covers transformer architecture, embeddings, retrieval-augmented generation and prompt engineering, and underpins everything else. Move to Software Development (24%) for model serving with Triton and TensorRT, quantization, batching and monitoring. Then Experimentation (22%), which is almost entirely about evaluation metrics, A/B testing and reinforcement learning from human feedback. Finish with Data Analysis and Visualization (14%), including the RAPIDS and cuML GPU stack, and Trustworthy AI (10%), where bias detection, privacy and the NIST AI Risk Management Framework carry the most marks. Build a small evaluation set early and reuse it, since measurement appears in three of the five domains. Most candidates with working Python and some machine-learning background need 30 to 45 hours of focused study.

Jump to Phase 1

What to study first for NCA-GENL

Study time should follow exam weight. The five domains and their share of the marks, heaviest first — this is the order the six phases below follow.

  1. The algorithms, architectures and techniques behind machine learning and large language models — and the judgement to pick between them for a stated task.

  2. Building, serving, optimising and monitoring the software around a model — the engineering that turns a checkpoint into a service.

  3. Performing, evaluating and interpreting experiments — including model evaluation and the use of human subjects in labeling and reinforcement learning from human feedback.

  4. Inspecting, cleaning and transforming data, and presenting what you find — with a strong emphasis on GPU-accelerated tooling.

  5. Building AI systems that are ethical, fair, private, transparent and verifiable — and knowing which control evidences each of those claims.

  1. Work the phases in order. Phase 2 assumes the embedding intuition from Phase 1, and Phases 4 through 6 all reuse the evaluation set you build in Phase 3.
  2. Build that evaluation set before you optimise anything. Every later phase re-runs it, which is what turns "this feels better" into a number you can defend.
  3. Answer the self-checks out loud or in writing. If you cannot handle one in four sentences without notes, the phase is not finished.
  4. Finish with timed practice at one minute per question, so exam pace is familiar before the day.

The 6-phase NCA-GENL study plan

Each phase names the domains it covers, how the exam questions that material, a practice exercise, and the self-checks that tell you whether to move on.

  1. Foundations and the vocabulary the exam assumes

    Be able to explain what a language model is trained to do, how a transformer processes a sequence, where a model's knowledge lives, and what shape the data is in — well enough that every later topic has somewhere to attach.

    • Core Machine Learning and AI Knowledge30%

    What the exam tests you on in this phase

    1. Explaining what self-attention computes and why it replaced recurrence — the most heavily questioned single subject on the exam
    2. Identifying an architecture from a described behaviour: encoder-only, decoder-only or encoder-decoder, and which suits a stated task
    3. Reading a memory or cost estimate: parameter count, precision, and why a longer prompt costs more
    4. Distinguishing what a base model does from what an instruction-tuned model does
    5. Naming what a loss function measures, and what a metric does not tell you

    Practice exercise

    A written account, in your own words, of next-token prediction, the attention mechanism, and how parameter count relates to memory footprint — with one worked arithmetic example.

    Self-check — answer without notes

    • What does self-attention compute, and what does it give you that a recurrent model does not?
    • Why does a base model continue your question instead of answering it?
    • A model has 8B parameters at 16-bit precision. How much memory do the weights need, and why is that not the same as the memory the service needs?
    • What does cross-entropy loss measure, and what does a loss of 2.0 tell you that accuracy does not?
    • Why does a longer prompt cost more memory, and which part of the model is responsible?
  2. Embeddings, retrieval, and the RAG pipeline end to end

    Build a retrieval-augmented pipeline and reason about every stage: chunking, embedding, indexing, retrieval, generation — and know which stage produced a bad answer.

    • Core Machine Learning and AI Knowledge30%
    • Data Analysis and Visualization14%

    What the exam tests you on in this phase

    1. Choosing retrieval over fine-tuning when a question mentions out-of-date facts, citations, or per-user data deletion — one of the highest-yield distinctions on the paper
    2. Selecting an embedding model or similarity measure for a described corpus and constraint
    3. Diagnosing a broken pipeline: given a bad answer, identifying whether chunking, retrieval or generation caused it
    4. Reasoning about chunk size, overlap and their effect on retrieval precision
    5. Recognising the components of a retrieval pipeline and what a vector database contributes

    Practice exercise

    A working RAG pipeline over a corpus you chose, plus a list of failures where each bad answer is attributed to a specific stage.

    Self-check — answer without notes

    • Cosine similarity versus dot product on unnormalized vectors — when do they disagree, and which do you want?
    • Your retriever returns the right document and the answer is still wrong. Name three distinct causes.
    • How does chunk size trade off against retrieval precision, and what does overlap buy you?
    • How would you choose between two embedding models for a specific corpus?
    • When is fine-tuning the wrong answer to "the model does not know our internal policies"?
  3. Experimentation and evaluation

    Evaluate models and changes like an experiment: a held-out set, one variable at a time, a stated metric, and a result you would defend in a review.

    • Experimentation22%

    What the exam tests you on in this phase

    1. Picking the right evaluation metric for a stated goal — perplexity, BLEU, ROUGE, precision, recall or F1 — and knowing what each one misses
    2. Reading an A/B test: what the control is for, and what an inconclusive result does and does not permit you to conclude
    3. Explaining reinforcement learning from human feedback: reward models, where preference labels come from, annotator agreement
    4. Scoring a retrieval pipeline with retrieval quality kept separate from answer quality
    5. Spotting a flawed experiment — data leakage, a missing control, a confound, an over-claimed benchmark result

    Practice exercise

    A frozen evaluation set of 20 or more items for your Phase 2 pipeline, scoring retrieval quality and answer quality separately, plus one A/B comparison you ran and interpreted.

    Self-check — answer without notes

    • Which metric would you use to compare two summarizers, and what does it miss?
    • Design an A/B test for two prompt templates. What is your control, your metric, and your stopping rule?
    • What is a reward model in RLHF, and where do the preference labels come from?
    • How do you measure hallucination, and how do you tell a retrieval failure from a generation failure?
    • A benchmark says your model is good. Good at what, and what does that not license you to claim?
    • What does cross-validation protect you from, and how does data leakage defeat it?
  4. Data analysis, preprocessing, and the GPU stack

    Inspect and prepare data competently, compare models with the right statistic, and know where RAPIDS and cuML fit.

    • Data Analysis and Visualization14%

    What the exam tests you on in this phase

    1. Knowing what RAPIDS and cuML are for, and when a GPU dataframe beats pandas — NVIDIA-specific tooling that generic data-science knowledge will not cover
    2. Choosing between stemming and lemmatization, and picking a vectorizer for a stated purpose
    3. Selecting the right statistic to compare two models on a described dataset
    4. Reading a chart or a data-quality summary and saying what it does and does not show
    5. Identifying a confound that could explain an apparent improvement

    Practice exercise

    A short data-quality report on your Phase 2 corpus: length distribution, duplicates, topic balance, and one chart you would put in front of a senior engineer.

    Self-check — answer without notes

    • What do RAPIDS and cuML do, and when would you choose them over pandas and scikit-learn?
    • Stemming or lemmatization for a retrieval index — which, and why?
    • Which statistic compares two regression models, and which compares two classifiers on an imbalanced set?
    • Name a confound that could explain an apparent improvement in your evaluation numbers.
  5. Serving, optimization, and monitoring

    Deploy a model-backed service and change its cost or latency deliberately, with a measurement to show for it.

    • Software Development24%

    What the exam tests you on in this phase

    1. Matching an NVIDIA product to a job: Triton serves, TensorRT optimises, NeMo customises, NeMo Guardrails constrains
    2. Explaining why the KV cache dominates memory at long context, and what paged attention and vLLM do about it
    3. Trading throughput against latency — continuous batching, batch size, and what each costs an individual request
    4. Reasoning about quantization: what INT8 changes in memory, speed and accuracy, and what quantization-aware training recovers
    5. Choosing what to monitor on a live service, and which signal catches drift, a latency regression or a quality drop
    6. Sizing hardware and components for a described workload

    Practice exercise

    A served model with monitoring on it, plus one optimization — quantization, batching, or a change of serving stack — whose effect you measured against your Phase 3 evaluation set.

    Self-check — answer without notes

    • What does Triton give you that a simple web wrapper around your model does not?
    • How does INT8 quantization change memory, throughput and accuracy, and what does quantization-aware training recover?
    • Why does the KV cache dominate memory at long context, and what does paged attention do about it?
    • How does continuous batching improve throughput, and what does it cost an individual request?
    • Name four things you would monitor on a live LLM service, and what each would catch.
  6. Trustworthy AI

    Attach a concrete control to every principle, so you can name the mechanism and the evidence rather than describing an ideal.

    • Trustworthy AI10%

    What the exam tests you on in this phase

    1. Identifying where bias entered a described system and which evaluation would have caught it — the most heavily questioned subject in this domain
    2. Applying the NIST AI Risk Management Framework by naming its four functions and what each covers
    3. Explaining why an external guardrail produces an audit trail that a trained-in refusal cannot
    4. Reasoning about privacy and consent: why trained weights cannot forget, and what that implies for retrieval versus fine-tuning
    5. Recognising indirect prompt injection through retrieved content as a corpus-trust problem

    Practice exercise

    A one-page trust checklist for your own service: each principle, the control that implements it, and the artifact that evidences it.

    Self-check — answer without notes

    • Where does bias enter an LLM system, and which evaluation finds each kind?
    • Name the four NIST AI RMF functions and what each is for.
    • What is NeMo Guardrails, and why does an external rail produce an audit trail that a trained-in refusal does not?
    • Why can you not delete one person's data from trained weights, and what does that imply about retrieval versus fine-tuning?
    • What is indirect prompt injection, and why does it make corpus trust a security property?

How long it takes to study for NCA-GENL

The same six phases on a calendar, at three intensities. Pick the one that matches the time you actually have — total hours matter less than leaving the judgement-shaped material time to settle.

Two weeks, intensive

35–40 hours over 14 days

You work with LLMs already and need the credential soon. Assumes you can give it two to three hours on weekdays and a full day each weekend.

  1. Days 1–3Phase 1 — transformers, attention, what a model is trained to do8h
  2. Days 4–6Phase 2 — embeddings and a working retrieval pipeline8h
  3. Days 7–8Phase 3 — evaluation metrics, A/B testing, RLHF. Build the evaluation set6h
  4. Days 9–10Phase 5 — serving, quantization, batching, monitoring6h
  5. Day 11Phases 4 and 6 — RAPIDS and cuML, then bias, NIST AI RMF, guardrails5h
  6. Days 12–14Timed mocks at one minute a question, then rebuild the weakest domain6h

Four weeks, steady

40 hours over 28 days

The default recommendation. Around ten hours a week leaves room for the material to settle between sessions, which matters more than total hours for the judgement-shaped questions.

  1. Week 1Phase 1, unhurried — attention properly, not approximately10h
  2. Week 2Phase 2, then Phase 3 and the evaluation set11h
  3. Week 3Phase 5 serving and optimisation, then Phase 4 data and the GPU stack11h
  4. Week 4Phase 6 Trustworthy AI, then timed mocks and targeted repair8h

Eight weeks, from a standing start

45–50 hours over 8 weeks

You know Python but have not built an LLM system. The extra weeks go on Phases 1 and 2, where someone new to the material needs the time — not on the smaller domains.

  1. Weeks 1–2Phase 1 — the vocabulary and the architecture, with the reading12h
  2. Weeks 3–4Phase 2 — build a retrieval pipeline end to end and break it deliberately13h
  3. Week 5Phase 3 — evaluation and the frozen evaluation set7h
  4. Week 6Phase 5 — serving, with one measured optimisation7h
  5. Week 7Phases 4 and 6 — the two cheapest domains to prepare6h
  6. Week 8Full-length timed mocks, then rebuild whichever domain lags5h

NCA-GENL topics by domain

Everything the plan covers, grouped by domain. Titles that link are published guides; the rest are on the way.

Core Machine Learning and AI Knowledge

30% · 10 topics · 3 published

  • A large language model is trained to do exactly one thing — predict the next token given every token before it — and every capability it appears to have, from answering questions to writing code, is that single objective applied repeatedly. Because the correct next token already sits in the training text, the objective is self-supervised: it needs enormous amounts of text but no human labels.

  • An LLM's parameters are the numbers learned during training — the weight matrices and biases inside every layer — and they are the only place the model stores anything it "knows." Nothing in a prompt, a retrieved document or a system message ever becomes a parameter, which is why prompting and RAG change behaviour and output while only fine-tuning changes what the model knows.

  • Data moves through a transformer as a three-dimensional tensor shaped (batch, sequence, hidden) — how many texts at once, how many tokens each, and how many numbers represent each token. Every layer in the stack consumes that shape and returns it unchanged, which is why the triple is the single vocabulary you need to read a model config, a memory estimate, or a shape-mismatch error.

  • Attention and the transformer, mechanism by mechanismcoming soon

    The densest subject on the exam, and the foundation for most of Domain 1.

  • Vectors, dot products, and cosine similaritycoming soon

    The one piece of linear algebra that has to be airtight — six later topics reduce to it.

  • Tokenization: BPE, WordPiece, and SentencePiececoming soon
  • Choosing an embedding model you can defendcoming soon
  • Prompt engineering that survives contact with a real modelcoming soon
  • The RAG pipeline, stage by stagecoming soon
  • Fine-tuning and LoRA: when to adapt a model, and when not tocoming soon

Software Development

24% · 6 topics

  • Serving a model: Triton, vLLM, and what each is forcoming soon
  • Quantization, batching, and the KV cachecoming soon
  • Monitoring an LLM service in productioncoming soon
  • Python NLP tooling in practice: spaCy, NumPy, vector databasescoming soon
  • Sizing hardware for a stated workloadcoming soon
  • Cost optimisation and troubleshooting a degraded servicecoming soon

Experimentation

22% · 7 topics

  • Evaluation metrics: which one answers which questioncoming soon
  • Build your evaluation set before you build anything elsecoming soon

    Re-run in every later phase — the instrument that makes the rest measurable.

  • Train, validation, test — and what counts as evidencecoming soon
  • A/B testing a prompt changecoming soon
  • RLHF, reward models, and human labelingcoming soon
  • Evaluating RAG: retrieval quality versus answer qualitycoming soon
  • Measuring hallucination and attributing it to a stagecoming soon

Data Analysis and Visualization

14% · 5 topics

  • Text preprocessing decisions that change your resultscoming soon
  • RAPIDS and cuML: GPU data science, and when to use itcoming soon
  • Comparing models with the right statisticcoming soon
  • Charts that convey a result honestlycoming soon
  • Confounds, trends, and what could explain your improvementcoming soon

Trustworthy AI

10% · 6 topics

  • Bias: where it enters, and the instrument for each kindcoming soon
  • The NIST AI Risk Management Framework in four functionscoming soon
  • Guardrails: NeMo, moderation, and layered defencecoming soon
  • Privacy, consent, and why weights cannot forgetcoming soon
  • Prompt injection, including through retrieved contentcoming soon
  • Transparency, citation, and the limits of a generated rationalecoming soon

Common NCA-GENL preparation mistakes

How people waste weeks preparing for this exam, and what to do instead. These are process errors rather than gaps in the material.

  1. Treating practice tests as the study method rather than the measurement.

    Do this instead

    Drill only after you have worked a phase. A practice test tells you where you are weak; it does not teach you the material, and answering the same bank repeatedly teaches the bank rather than the subject.

  2. Studying the domains in their published order.

    Do this instead

    Follow weight instead. Core Machine Learning and AI Knowledge is 30% of the paper and everything else builds on it, so starting anywhere else means learning the later domains twice.

  3. Skipping Data Analysis and Trustworthy AI because they are only 14% and 10%.

    Do this instead

    Give each a focused afternoon. Together they are almost a quarter of the exam and they are the cheapest marks available anywhere on it — an hour on RAPIDS and cuML, and an hour on the NIST AI RMF functions, both pay back immediately.

  4. Assuming the exam is "all applied, no theory" and skimming the architecture.

    Do this instead

    That advice holds for Software Development onwards and is wrong for Domain 1, where attention and transformer mechanics run through most of the questions. Learn what each mechanism does and why it exists.

  5. Reading about retrieval without building one.

    Do this instead

    Build a small pipeline and break it on purpose. The questions ask you to attribute a bad answer to chunking, retrieval or generation, and that diagnosis is very hard to fake from reading alone.

  6. Leaving multi-answer questions until exam day to think about.

    Do this instead

    Rehearse them. A quarter of the paper needs exactly two selections with no partial credit, so the habit of counting the required answers before reading the options is worth practising until it is automatic.

  7. Judging readiness by an overall practice average.

    Do this instead

    Track per-domain results and study the lowest. A strong average routinely hides one domain you would fail standing alone — most often Experimentation.

NCA-GENL exam-day tactics

Technique rather than content — how to spend the hour, how to handle the questions that give no partial credit, and how to know when you are ready.

Pace at 60 seconds a question

The paper can run to 60 questions in 60 minutes, so one minute each is the pace to rehearse. Flag anything still unresolved at 90 seconds and move on — a question you are stuck on costs you two you would have answered.

Every multi-answer question wants exactly two

Multi-answer questions are phrased "Select TWO" and always need exactly two selections — never one, never three. Scoring is all-or-nothing, so a single correct pick earns the same as a blank. Check the required count before you read the options.

Eliminate on the constraint, not the topic

Applied questions name a constraint: latency, memory, cost, no retraining, must cite sources. Two options are usually right for the subject and wrong for the constraint. Find the constraint clause first, then eliminate against it.

Freshness and attribution mean retrieval

Anything phrased around out-of-date facts, needing citations, or removing one user's data is a retrieval question, not a fine-tuning question. This single distinction is worth a disproportionate number of marks.

Know each NVIDIA product by its job

Triton serves, TensorRT optimises, NeMo customises, NeMo Guardrails constrains, RAPIDS and cuML accelerate dataframes and classical ML. One clear sentence for each is enough to pick the right option.

Measure readiness by your weakest domain

A strong overall average can hide a domain you would fail on its own. Track results per domain and keep studying the lowest one — that is a better readiness signal than any single score.

NCA-GENL study questions, answered

The questions people ask most often when planning their preparation.

How do I study for the NCA-GENL exam?

Study the five domains in order of weight, not the order they are published in. Begin with Core Machine Learning and AI Knowledge, because transformers, embeddings, retrieval and prompting reappear in every other domain. Then cover Software Development, Experimentation, Data Analysis and Trustworthy AI. Build a small evaluation set early and reuse it throughout, since measurement is tested in three of the five domains.

How long does it take to prepare for NCA-GENL?

Most candidates need 30 to 45 hours of focused study. Expect the upper end if you have never built a retrieval pipeline or deployed a model, and the lower end if you work with large language models daily. Experimentation usually takes longer than people plan for, because it is tested more deeply than its name suggests.

Can I pass NCA-GENL in two weeks?

Yes, if you already write Python and understand neural networks. Two weeks at two to three hours a day covers the ground. Prioritise transformer architecture, the retrieval pipeline and evaluation metrics — those three subjects account for the majority of the questions. Skip the optional practice exercises and use the self-checks and timed practice questions instead.

What should I study first for NCA-GENL?

Transformer architecture and the attention mechanism. It is the single most heavily questioned subject on the exam and every later topic assumes it. Once you can explain what self-attention computes and why it replaced recurrence, move on to embeddings and retrieval-augmented generation.

Which NCA-GENL domain is hardest?

Experimentation catches most candidates out. It is worth 22% of the exam and focuses almost entirely on evaluating models — choosing metrics, designing A/B tests, and understanding reinforcement learning from human feedback. Candidates who prepare it as general data analysis lose marks, because charting and data-mining skills are not what it asks about.

Do I need hands-on NVIDIA experience to pass?

No, but you do need to know the product landscape. Triton serves models, TensorRT optimises them, NeMo customises them, NeMo Guardrails constrains their outputs, and RAPIDS and cuML accelerate dataframes and classical machine learning. One clear sentence about each is enough to answer the questions that name them.

Is a practice test enough to pass NCA-GENL?

Not on its own. Practice questions show you where the gaps are but rarely teach the reasoning behind an answer, and the exam favours judgement over recall. Use them after each study phase to find your weakest domain, then go back to the material for that domain rather than repeating the questions.

How many hours a day should I study?

Two to three hours a day over three to four weeks suits most people, which fits the 30 to 45 hour range comfortably. Shorter daily sessions with a self-check at the end work better than long weekend blocks, because the material is broad and benefits from spaced review.

What is the best order to study the NCA-GENL domains?

Core Machine Learning and AI Knowledge first, then Embeddings and retrieval, then Experimentation, then Data Analysis, and Trustworthy AI last. This follows exam weight and dependency: the fundamentals support everything, and the two lightest domains are quick to prepare once you understand the rest.

How do I know when I am ready to book the exam?

When you score consistently across all five domains with none lagging, and you can answer the self-checks in this guide without notes. NVIDIA does not publish a passing score, so per-domain consistency is a better signal than any overall percentage — a strong average can hide one domain you would fail on its own.

Test the plan against real questions.

Practise by domain to find which phase you have not really finished, or sit a full-length timed mock at exam pace.