科研

We propose the use of metaverse for computer science education, leveraging virtual reality (VR) and artificial intelligence (AI) technologies. VR glasses are used to record videos such as presentation slides and class speeches emerged in the metaverse, whereas AI technologies automatically generate customized class notes summarized from the contents of the video recordings. This education metaverse can accommodate students’ digital avatars in different virtual workspaces including collaboration space, laboratories and classrooms. It consists of practical functions that mimics the physical classroom settings such as real-time voice chat, avatar movement and shared screen presentation. During the metaverse journey, the AI notes generator module is used to create personalized class notes using technologies including optical character recognition, automatic speech recognition, natural language processing, and text-to-speech. The current progress and future work are discussed towards a working prototype of our AI-assisted metaverse for proof-of-concept experiments in computer science education.