Evaluation of Simulated Recognition Aids for Human Sensemaking in Applied Surveillance Scenarios

It was determined whether the human capability for sensemaking, or for identifying essential elements of information (EEIs), could be enhanced by a simulated recognition aid that directed attention to people and vehicles in scenes or by a simulated recognition aid that directed attention to EEIs. For intelligence analysts, sensemaking is challenging because it frequently involves making inferences about uncertain data. One way to enhance sensemaking may involve collaboration from a machine recognition aid such as Project Maven, an established algorithm that directs analysts’ attention to people and vehicles in scenes. The directed attention of Project Maven was simulated as well as a machine recognition aid that directed attention to EEIs. Full-motion videos were created of simulated compounds viewed by an overhead camera. Sensemaking was assessed by measuring participants’ ability to predict events and identify signs. Participants’ attention was directed by placing small globe symbols above either all people and vehicles, or all EEIs. Novices and intelligence analysts participated. Simulated recognition aids directing participants’ attention to EEIs improved EEI identification but directing attention to people and vehicles (emulating Project Maven) did not. Participants’ sensemaking was not enhanced by either type of simulated recognition aid. Guiding attention to features in a scene improves their identification whereas indiscriminate steering of attention to entities in the scene does not improve understanding of the holistic meaning of events, unless attention is drawn to relevant signs of those events. Results contribute to the goal of determining which human-machine systems improve the sensemaking capability of intelligence analysts in the field.

• Record URL:
  • https://doi.org/10.1177/00187208221120461
• Availability:
  • Find a library where document is available. Order URL: http://worldcat.org/issn/00187208
• Authors:
  • Frame, Mary E
  • 0000-0002-4586-9987
  • Maresca, Anna M
  • Christensen-Salem, Amanda
  • Patterson, Robert Earl
  • 0000-0002-0174-3872
• Publication Date: 2024-4

Language

• English

Media Info

• Media Type: Web
• Features: Figures; References; Tables;
• Pagination: pp 1056-1067
• Serial:
  • Human Factors
  • Volume: 66
  • Issue Number: 4
  • Publisher: Sage Publications, Incorporated
  • ISSN: 0018-7208
  • EISSN: 1547-8181
  • Serial URL: http://hfs.sagepub.com/

Subject/Index Terms

• TRT Terms: Behavior; Cognition; Human factors; Psychological tests; Reconnaissance; Surveillance
• Subject Areas: Safety and Human Factors; Security and Emergencies; Transportation (General);

Filing Info

• Accession Number: 01913435
• Record Type: Publication
• Files: TRIS
• Created Date: Mar 29 2024 4:58PM