GenAI-Chatbots as Debriefers: Investigating the Role Conformity and Learner Interaction in Counseling Training

Debriefing is essential for the effectiveness of simulation-based training but is generally considered resource-intensive. Generative Artificial Intelligence (GenAI)-based debriefing can be an alternative to human debriefers. However, there is no research yet whether GenAI chatbots can take up this role and how learners react to them. This paper presents a qualitative analysis of a debriefing following a counseling training conducted in Virtual Reality (VR) with the support of a GenAI chatbot. The debriefing helped students to analyze their experiences and application of consulting techniques. The analysis of the chatlogs (n = 22) are focused on the role conformity of the bot and the students’ ability to reflect their behavior within VR. The results revealed the chatbot’s strong role conformity but also its tendency for overly complimentary answers. However, this bias does not seem to influence students’ self-reflection. Instead, they maintained a self-critical attitude. Future research on AI-assisted debriefing could expand on these findings in related areas.