Philippines staffing research ·
Do structured reference notes improve evidence consistency?
A paired-review design for testing traceability in reference-check notes without treating completeness as hiring validity.
Key Stats
The US Office of Personnel Management describes structured interviews as standardized in questions and evaluation; that principle does not mean a complete reference note predicts job performance.
Methodology
This desk review combines OPM structured-interview guidance, GAO data-reliability guidance, and NIST information-quality standards. It proposes de-identified simulated reference responses reviewed in paired formats. No candidates, referees, protected data, or hiring outcomes were studied; employment and privacy requirements need qualified local review.
Key Takeaways
Define approved job-related questions, consent boundaries, note fields, prohibited data, evidence attribution, reviewer task, and allowable dispositions before building scenarios.
Create matched free-form and structured versions of simulated responses, including uncertainty, refusal, hearsay, contradictions, and incomplete contact. Randomize format order and prevent reviewers from seeing paired versions together.
Measure traceable statements, unsupported inference, missing context detected, review time, disposition, and reviewer agreement. Ask reviewers to explain which evidence changed their assessment.
Philippines recruitment coordinators may manage consent records, schedule outreach, and organize notes. Criteria, credibility assessment, selection, rejection, accommodation, and legal decisions remain with authorized owners.
Limitations include artificial scenarios, learning effects, reviewer training, incomplete representation of real conversations, and the absence of outcome validation. Higher agreement is not proof of fairness or predictive validity.
Publish the scenario set, coding rules, disagreements, exclusions, and format-order checks. Retain structure only when it clarifies source and uncertainty without inviting irrelevant personal judgments.
Paired measures
Compare traceability, missing-context detection, unsupported inference, time, disposition, confidence, and reviewer agreement by note format.
Safety conditions
Use simulations, job-related prompts, minimum necessary data, independent first review, and documented adjudication.
Next step
Make reference evidence traceable while hiring authority stays with the client.
FAQs
Would complete notes validate a hiring decision?
No. Validity also depends on criteria, process, evidence quality, accommodations, and authorized judgment.
May coordinators contact people not supplied by the candidate?
Not under this protocol; outreach follows the client-approved consent and reference process.
Sources
- https://www.opm.gov/policy-data-oversight/assessment-and-selection/structured-interviews
- https://www.gao.gov/products/gao-20-283g
- https://www.nist.gov/director/nist-information-quality-standards