Tracing learner interaction and engagement with process data

In our Games and Learning Research Group at Tampere University, we study learner behavior using real-time data from multiple sources. These data include physiological signals, facial expressions, and verbal interactions.

In my talk, I will present four recent experiments. The first experiment involves a digital multiplayer learning game, in which we examine competitive dynamics within collaborative learning teams. The second experiment uses a physical board game in entrepreneurship education and explores the potential of different data modalities for detecting leader–follower dynamics within collaborative teams.

The third experiment traces heart rate, electrodermal activity, and facial expressions of higher education teachers and students in a synchronous online learning environment (i.e., Zoom). The aim of this study is to understand teacher–student interaction quality, as well as students’ perceived teacher enthusiasm and lesson enjoyment. The fourth experiment replicates this design in authentic higher education classroom settings.

In my speech, I will present both preliminary and published findings from these experiments. Overall, these studies highlight the potential of process data to investigate learning and instruction as dynamic, unfolding processes rather than merely static outcomes.