Ensure every examiner
grades the same way

Measure consistency across your examiner fleet. See who grades harder, who grades easier, and where your training standards need attention.

Instructor Overview — Pass Rates
Fleet Average
87%
Last 12 months
TRI A. Smith
92%
TRI B. Jones
71%
TRI C. Park
95%
TRI D. Lee
84%
Fleet average (87%)
TRI B. Jones — 16 points below fleet average

Compare pass rates across your examiner fleet

See how each examiner's pass rate stacks up against the fleet average. Quickly identify who is significantly above or below the norm, so you can investigate further and maintain fair, consistent training outcomes.

  • Fleet average benchmark line for instant comparison
  • Automatic flagging when pass rates fall outside norms
  • Filter by time period, form type, or aircraft
Rating Patterns — TRI B. Jones
Rating Distribution
B. Jones
Fleet Avg.
1
2
3
4
5
Concentrated at the satisfactory threshold — ratings cluster at grade 3

Spot unusual rating patterns

Every examiner develops habits over time. Some grade too harshly, others too leniently. The rating distribution view shows you exactly how each examiner spreads their scores compared to the fleet, making it easy to spot who needs a calibration conversation.

  • Side-by-side comparison with fleet average
  • Identify harsh or lenient grading tendencies
  • Drill down by competency area or form type
Consistency Report
FO R. Tanaka — OPC Line Check
Same trainee, two different examiners
TRI A. Smith
Flight Planning 4
Manual Flight 4
CRM 5
SOP Compliance 4
PASS
TRI B. Jones
Flight Planning 3
Manual Flight 2
CRM 3
SOP Compliance 2
FAIL
Consistency Score
32%
Significant variance detected — same trainee, opposite outcomes

When two examiners see the same trainee differently

When the same trainee gets a Pass from one examiner and a Fail from another, something needs attention. The consistency report puts both evaluations side by side and scores the agreement between examiners, so you can act on the discrepancy quickly.

  • Side-by-side rating comparison for the same trainee
  • Consistency score from 0-100% agreement
  • Automatic alerts when variance exceeds thresholds

Built for meaningful analysis

Instructor standardization in Qualify is designed to surface real patterns, not noise.

Minimum Data Threshold

Analysis requires at least 3 evaluations per instructor before results are shown. This ensures you are looking at meaningful trends, not drawing conclusions from a single check ride.

Variance Alerts

When an examiner's results start to drift significantly from the rest of the fleet, the system flags it automatically. You will know before it becomes a problem.

Microscope Integration

Instructor impact is a dedicated section in every trainee's intelligence report. When reviewing a trainee, you will always see which examiner assessed them and how that examiner compares to the fleet.

Ready to standardize
your examiner fleet?

See how Qualify helps training managers measure and improve consistency across every examiner in the organization.

Request a Demo View All Features