Best Practices in Pilot Selection

Demand for new civilian pilots continues to grow as the world’s aviation system expands. U.S. mainline and regional air carriers will need about 1,900 to 4,500 new pilots per year (U.S. Government Accountability Office, 2014). Selection of the new pilots is a critical human resource management challenge for operators. The authors review civilian pilot selection procedures relative to a set of seven best practices: (1) Conduct a job analysis; (2) Define measurable, observable job performance metrics; (3) Identify and use reliable and valid predictors; (4) Conduct an appropriate validation study; (5) Determine cut-scores (pass/fail) on tests based on predicted job performance; (6) Evaluate the fairness of tests and cut-scores; and (7) Document the analyses. The authors reviewed 15 pilot test batteries and selection processes for 2 U.S. and multiple foreign airlines based on publicly available information. Overall, adherence to best practices as defined by the relevant legal and professional guidelines, standards, principles, and practices for the development, validation, and use of employee selection procedures, was inconsistent. Relatively few of the test batteries were based on a recent or current job analysis. There is evidence of psychometric reliability and useful validity for the test batteries. However, there is no evidence on the reliability or validity of the interviews used in pilot selection. The primary job performance criterion is success or failure in training. No data are available on the comparative selection (pass) rates by demographic groups on the test batteries. Technical reporting and documentation on pilot test batteries is better in Europe than in the U.S. Overall, the authors agree with the 2012 conclusion reached by the International Air Transport Association (IATA) that pilot selection programs worldwide and in the U.S. do not appear to have a strong scientific basis. The authors make two recommendations to improve the state-of-the-art in civilian pilot selection.

• Record URL:
  • https://www.faa.gov/data_research/research/med_humanfacs/oamtechreports/2010s/media/201906.pdf
• Summary URL:
  • https://www.faa.gov/data_research/research/med_humanfacs/oamtechreports/2010s/2019/201906/
• Record URL:
  • https://rosap.ntl.bts.gov/view/dot/57077
• Corporate Authors:

  Federal Aviation Administration

  Civil Aerospace Medical Institute, P.O. Box 25082
  Oklahoma City, OK  United States  73125

  Federal Aviation Administration

  Office of Aerospace Medicine, 800 Independence Avenue, SW
  Washington, DC  United States  20591
• Authors:
  • Broach, Dana
  • Gildea, Kevin
  • Schroeder, David J
• Publication Date: 2019-2-13

Language

• English

Media Info

• Media Type: Digital/other
• Edition: Final Report
• Features: Appendices; Figures; References; Tables;
• Pagination: 73p

Subject/Index Terms

• TRT Terms: Air pilots; Airlines; Best practices; Civil aviation; Performance measurement; Personnel performance; Recommendations; Selection and appointment; Validation
• Subject Areas: Administration and Management; Aviation; Education and Training;

Filing Info

• Accession Number: 01735787
• Record Type: Publication
• Report/Paper Numbers: DOT/FAA/AM-19/6
• Files: NTL, TRIS, ATRI, USDOT
• Created Date: Apr 3 2020 4:39PM