Publication
GenAIReading: Augmenting Human Cognition with Interactive Digital Textbooks Using Large Language Models and Image Generation Models
Ryugo Morita; Ko Watanabe; Jinjia Zhou; Andreas Dengel; Shoya Ishimaru (Hrsg.)
Augmented Humans International Conference (AHs-2025), Augmented Humans 2025, located at AHs-2025, March 16-20, Abu Dhabi, United Arab Emirates, Association for Computing Machinery, 2025.
Abstract
Cognitive augmentation is a cornerstone in advancing education, particularly through personalized learning. However, personalizing extensive textual materials, such as narratives and academic textbooks, remains challenging due to their heavy use, which can hinder learner engagement and understanding. Building on cognitive theories like Dual Coding Theory; which posits that combining textual and visual information enhances comprehension and memory; this study explores the potential of Generative AI (GenAI) to enrich educational materials. We utilized large language models (LLMs) to generate concise text summaries and image generation models (IGMs) to create visually aligned content from textual inputs. After recruiting 24 participants, we verified that integrating AI-generated supplementary materials significantly improved learning outcomes, increasing post-reading test scores by 7.50%. These findings underscore GenAI's transformative potential in creating adaptive learning environments that enhance cognitive augmentation.
Projects
- MMISS - Multimedia - Instruktion in Sicheren Systemen
- SDSD - Smarte Daten, Smarte Dienste. Landwirtschaftliche Datendrehscheibe für effiziente ressourcenschonende Prozesse