Monitoring students' engagement and understanding their learning pace in a virtual classroom becomes challenging in the absence of direct eye contact between the students and the instructor. Continuous monitoring of eye gaze and gaze gestures may produce inaccurate outcomes when the students are allowed to do productive multitasking, such as taking notes or browsing relevant content. This paper proposes Stungage - a software wrapper over existing online meeting platforms to monitor students' engagement in real time by utilizing the facial video feeds from the students and the instructor coupled with a local on-device analysis of the presentation content.
Key Features
- Multitask-agnostic: The proposed approach does not consider continuous eye gestures as the only notion for visual attention, rather it provides scope for counting the instances of positive multitasking, like taking notes during the classes; thus promoting a free and unconstrained environment.
- Identifies interesting lecture instances on the scene: The crux of our method is the fact that students focus on the screen during interesting instances of a lecture. Consequently, the method figures out such instances in real-time from the presentation video.
- Wrapper on top of the existing meeting Apps: Our method works as a wrapper on top of the existing meeting Apps, providing seamless integration opportunities.
- Asynchronous computation: Our method performs asynchronous local computation on the edge devices being used by the individual students, thus, resulting a very little overhead on the network load.
Licensing:The platform source and the collected dataset is free to download and can be used with GNU General Public License for non-commercial purposes. All participants signed forms consenting to the collected dataset and associated labels for non-commercial research purposes. The institute's ethical review committee has approved the field study (Order No: IIT/SRIC/DEAN/2023, Dated July 31, 2023).
Snigdha Das
IIT Kharagpur, India
Sandip Chakraborty
IIT Kharagpur, India
Bivas Mitra
IIT Kharagpur, India
Publications
- Snigdha Das, Sandip Chakraborty, Bivas Mitra: "I Cannot See Students Focusing on My Presentation; Are They Following Me? Continuous Monitoring of Student Engagement through "Stungage"", ACM UMAP 2022
- Snigdha Das, Bivas Mitra, Sandip Chakraborty: "Quantifying Students' Involvement during Virtual Classrooms: A Meeting Wrapper for the Teachers", India-HCI 2021
Funding and Support
For questions and general feedback, contact
Snigdha Das