TY - GEN
T1 - Toward explainable users
T2 - 45th IEEE Annual Computers, Software, and Applications Conference, COMPSAC 2021
AU - Abri, Faranak
AU - Gutiérrez, Luis Felipe
AU - Kulkarni, Chaitra T.
AU - Namin, Akbar Siami
AU - Jones, Keith S.
N1 - Publisher Copyright:
© 2021 IEEE.
PY - 2021/7
Y1 - 2021/7
N2 - To understand how end-users conceptualize consequences of cyber security attacks, we performed a card sorting study, a well-known technique in Cognitive Sciences, where participants were free to group the given consequences of chosen cyber attacks into as many categories as they wished using rationales they see fit. The results of the open card sorting study showed a large amount of inter-participant variation making the research team wonder how the consequences of security attacks were comprehended by the participants. As an exploration of whether it is possible to explain user’s mental model and behavior through Artificial Intelligence (AI) techniques, the research team compared the card sorting data with the outputs of a number of Natural Language Processing (NLP) techniques with the goal of understanding how participants perceived and interpreted the consequences of cyber attacks written in natural languages. The results of the NLP-based exploration methods revealed an interesting observation implying that participants had mostly employed checking individual keywords in each sentence to group cyber attack consequences together and less considered the semantics behind the description of consequences of cyber attacks. The results reported in this paper are seemingly useful and important for cyber attacks comprehension from user’s perspectives. To the best of our knowledge, this paper is the first introducing the use of AI techniques in explaining and modeling users’ behavior and their perceptions about a context. The novel idea introduced here is about explaining users using AI.
AB - To understand how end-users conceptualize consequences of cyber security attacks, we performed a card sorting study, a well-known technique in Cognitive Sciences, where participants were free to group the given consequences of chosen cyber attacks into as many categories as they wished using rationales they see fit. The results of the open card sorting study showed a large amount of inter-participant variation making the research team wonder how the consequences of security attacks were comprehended by the participants. As an exploration of whether it is possible to explain user’s mental model and behavior through Artificial Intelligence (AI) techniques, the research team compared the card sorting data with the outputs of a number of Natural Language Processing (NLP) techniques with the goal of understanding how participants perceived and interpreted the consequences of cyber attacks written in natural languages. The results of the NLP-based exploration methods revealed an interesting observation implying that participants had mostly employed checking individual keywords in each sentence to group cyber attack consequences together and less considered the semantics behind the description of consequences of cyber attacks. The results reported in this paper are seemingly useful and important for cyber attacks comprehension from user’s perspectives. To the best of our knowledge, this paper is the first introducing the use of AI techniques in explaining and modeling users’ behavior and their perceptions about a context. The novel idea introduced here is about explaining users using AI.
KW - Artificial intelligence
KW - Explainable users
KW - Mental model
KW - Natural language processing
KW - Perception
KW - Security attacks comprehension
UR - http://www.scopus.com/inward/record.url?scp=85115862366&partnerID=8YFLogxK
U2 - 10.1109/COMPSAC51774.2021.00254
DO - 10.1109/COMPSAC51774.2021.00254
M3 - Conference contribution
AN - SCOPUS:85115862366
T3 - Proceedings - 2021 IEEE 45th Annual Computers, Software, and Applications Conference, COMPSAC 2021
SP - 1703
EP - 1710
BT - Proceedings - 2021 IEEE 45th Annual Computers, Software, and Applications Conference, COMPSAC 2021
A2 - Chan, W. K.
A2 - Claycomb, Bill
A2 - Takakura, Hiroki
A2 - Yang, Ji-Jiang
A2 - Teranishi, Yuuichi
A2 - Towey, Dave
A2 - Segura, Sergio
A2 - Shahriar, Hossain
A2 - Reisman, Sorel
A2 - Ahamed, Sheikh Iqbal
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 12 July 2021 through 16 July 2021
ER -