• Joseph E Mercado, Michael A Rupp, Jessie Y C Chen, Michael J Barnes, Daniel Barber, and Katelyn Procci.
• U.S. Army Research Laboratory, Orlando, Florida joseph.mercado@med.navy.mil.
• Hum Factors. 2016 May 1; 58 (3): 401-15.

ObjectiveWe investigated the effects of level of agent transparency on operator performance, trust, and workload in a context of human-agent teaming for multirobot management.BackgroundParticipants played the role of a heterogeneous unmanned vehicle (UxV) operator and were instructed to complete various missions by giving orders to UxVs through a computer interface. An intelligent agent (IA) assisted the participant by recommending two plans-a top recommendation and a secondary recommendation-for every mission.MethodA within-subjects design with three levels of agent transparency was employed in the present experiment. There were eight missions in each of three experimental blocks, grouped by level of transparency. During each experimental block, the IA was incorrect three out of eight times due to external information (e.g., commander's intent and intelligence). Operator performance, trust, workload, and usability data were collected.ResultsResults indicate that operator performance, trust, and perceived usability increased as a function of transparency level. Subjective and objective workload data indicate that participants' workload did not increase as a function of transparency. Furthermore, response time did not increase as a function of transparency.ConclusionUnlike previous research, which showed that increased transparency resulted in increased performance and trust calibration at the cost of greater workload and longer response time, our results support the benefits of transparency for performance effectiveness without additional costs.ApplicationThe current results will facilitate the implementation of IAs in military settings and will provide useful data to the design of heterogeneous UxV teams.© 2016, Human Factors and Ergonomics Society.

11 keywords...

hide…