Re-examining the Trust in Autonomy (TIA) Scale as Trust and Distrust Factors

Author(s):

Julia L. Wright, Stephen M. Fiore, Joshua Foldes, and Gita Sukthankar

Abstract:

This report describes an exploratory factor analysis (EFA) of the Jian et al. “Trust in Automation” questionnaire and re-analysis of human–machine trust data using a two-factor model of the items (Jian J-Y, Bisantz AM, Drury CG. Foundations for an empirically determined scale of trust in automated systems. Int J Cogn Ergon. 2000;4(1):53–71). The purpose was to examine the degree to which two distinct factors—separately measuring trust and distrust—were identifiable. Data was gathered from six similar experiments that all used the questionnaire. Two datasets were created for analysis: a dataset wherein there is one data point for each participant (Single, N = 91), and a dataset that included repeated submissions by each participant (Full, N = 503). First, an EFA was performed to determine the robustness of the two factors. After verifying the two factors, we reanalyzed an existing dataset that examined trust based on levels of transparency when interacting with an agent. We show how separating out the trust and distrust subcomponents of the Jian et al. questionnaire can provide additional insights into human–machine teaming research.