Q48 of 60 — CCA Practice Exam

Claude Code for Continuous Integration

Your CI pipeline uses Claude Code to generate automated code review summaries for pull requests. After three weeks in production, developers report that roughly 12% of summaries contain specific claims about code behavior — such as "this function will throw a NullPointerException when input is null" — that don't match what the code actually does. Logs show the review agent is being passed only the diff and a generic instruction to summarize changes. Which prompt engineering change would most directly reduce this category of hallucinated behavioral claims?

A. Add a chain-of-thought instruction requiring Claude to cite the specific line number and code path that supports each behavioral claim before including it in the summary.

B. Switch to a best-of-N approach by running the same diff through the review agent three times and surfacing only claims that appear in at least two of the three outputs.

C. Increase the context window allocation so Claude can see the full file history alongside the diff, giving it more information to base behavioral claims on.

D. Add an instruction explicitly restricting Claude to only describe changes visible in the provided diff and to flag any behavioral inference it cannot directly trace to a line in the diff.