Compare candidates using evidence instead of a general impression

Compare candidates against the job requirements before comparing them with each other. Otherwise, the strongest storyteller in the room can become the standard, even when the story says little about the work you need done.

A useful comparison shows the evidence for each requirement, how it was assessed, and what remains unknown. The final decision still requires judgment. The point of the worksheet is to make that judgment inspectable.

Complete independent notes before the meeting

Each assessor should finish their own evidence notes and ratings before reading the team’s conclusions. CIPD recommends this ordering because early discussion can influence other interviewers’ judgments. Read its selection-methods guidance.

Use the same role requirements and rating anchors. Record a paraphrase of the relevant answer or behavior and explain which anchor it supports. Avoid a summary such as “strong hire” until the underlying requirements have been assessed.

OPM’s structured-interview guide similarly describes independent evaluations followed by discussion of the evidence behind rating differences. Its method is a useful reference, not a requirement to reproduce a federal hiring process. Read the guide’s panel-interview and rating sections.

Create a comparison that exposes missing evidence

This fictional example compares two candidates for an implementation role. The illustrative scale is 1 for evidence below the task requirement, 2 for evidence meeting it, and 3 for stronger evidence against predefined behavioral anchors. N/A means the task was not adequately assessed. These values are not validated predictors of job performance.

Requirement	Candidate A: evidence and rating	Candidate B: evidence and rating	Decision issue
Clarify incomplete requirements	2: Identified missing inputs and confirmed them with the responsible person	2: Distinguished unknown facts from assumptions and confirmed the next step	Both meet the example requirement
Communicate an emerging risk	3: Explained a risk, options, timing, and follow-through using a relevant case	2: Explained the risk and recipient, with adequate follow-through	Difference is supported by specific evidence
Coordinate a handoff	N/A: Interview ran out of time	2: Named the next owner, needed information, and confirmation step	A has missing evidence, not a demonstrated failure

Candidate A’s two completed ratings cannot be fairly compared with Candidate B’s three by summing them. A score of five and a score of six would mostly reflect how many criteria were assessed. Nor should A’s missing item become zero.

Discuss requirements one at a time

Begin with a requirement and invite each assessor to give their evidence before their recommendation. This makes it harder for one global impression to fill every cell.

Useful debrief prompts include:

Which action in the answer supports that rating?
Did we apply the same anchor to both candidates?
Are we crediting the candidate’s own work or the outcome of a large team?
Did a standard probe resolve the ambiguity, or did we leave it unexplored?
Is the disagreement about the answer, the meaning of the requirement, or the evidence we failed to gather?

A correction to the notes may resolve the first issue. The second may reveal an unclear scorecard. The third may require a comparable follow-up assessment. These are different actions, so do not settle them all with a vote.

Decide how to handle incomplete coverage

In the fictional example, assess Candidate A’s handoff capability using the established process before concluding that B is stronger overall. If the follow-up adds a new task or criterion, consider whether other candidates need the same opportunity.

Missing evidence can also remain missing for practical reasons. If the organization must decide with uncertainty, name the unresolved item and who accepted that uncertainty. Do not rewrite N/A as a confident rating to make the paperwork look complete.

Keep any essential requirement visible. A high score elsewhere should not silently offset a requirement that the team established as necessary. At the same time, do not invent a new essential criterion during the debrief because it favors one person.

Use a short record with four fields:

Requirement: The task or capability being decided.

Evidence: The relevant assessment result and its source.

Uncertainty: Missing information, differing contexts, or a limit of the method.

Disposition: Proceed, gather a defined additional item, or do not proceed under the established criterion.

Keep the record focused on information relevant to the role and appropriate for your hiring process. A candidate’s familiar conversational style, shared hobbies, or an interviewer’s unexplained feeling should not become a substitute criterion.

A structured comparison does not eliminate bias or guarantee the right hire. It does make it possible to challenge the decision: another reviewer should be able to see which work mattered, what evidence was gathered, and why the team reached its conclusion.