Development and Validation of a Multimodal Evaluation Indicator System for Higher Educational Instruction

DOI

10.2991/978-94-6239-766-8_29How to use a DOI?

Keywords

Multimodal Evaluation; Higher Educational Instruction; Indicator System; Human-Annotated Dataset

Abstract

Traditional higher education evaluation paradigms suffer from metric fragmentation, superficial data usage, and an inability to dynamically adjust to changing pedagogical contexts. This study introduces a comprehensive framework designed to bridge the gap between raw multimodal classroom data and structured instructional insights. Utilizing a rigorous design process involving the Delphi method and Analytic Hierarchy Process (AHP), we developed a 4-dimensional developmental evaluation matrix featuring 16 secondary indicators and 42 fine-grained multimodal behavioral anchors. To validate this metric configuration, a non-intrusive multi-sensor spatial network was deployed to collect a 120-hour synchronized dataset spanning 20 faculty profiles in authentic higher educational settings, followed by strict multi-pass human expert annotation. Exploratory data analysis reveals significant correlations between instructional demographics and specific behavioral dimensions, while content validity is established through an alignment matrix mapping classroom behaviors directly to industry-demanded skill profiles. This foundational methodology provides a scalable blueprint and gold-standard dataset for building closed-loop, context-aware artificial intelligence evaluation architectures in higher education.

Copyright

© 2026 The Author(s)

Open Access

Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Download article (PDF)

TY  - CONF
AU  - Yuhang Li
AU  - Huajie Qu
AU  - Yinghui Ge
AU  - Lili Zhang
AU  - Tingting Liu
PY  - 2026
DA  - 2026/09/04
TI  - Development and Validation of a Multimodal Evaluation Indicator System for Higher Educational Instruction
BT  - Proceedings of the 2026 6th International Conference on Education, Information Management and Service Science  (EIMSS 2026)
PB  - Atlantis Press
SP  - 284
EP  - 290
SN  - 2589-4900
UR  - https://doi.org/10.2991/978-94-6239-766-8_29
DO  - 10.2991/978-94-6239-766-8_29
ID  - Li2026
ER  -