Highlights

The Clinical Conversation Training System is an immersive platform designed to enhance medical communication skills through realistic patient dialogue scenarios. Using Scenario-based QA and Instruction Prompting, it helps users build effective responses in high-pressure settings. A Cantonese language calibration ensures cultural and linguistic accuracy. Leveraging the Metaverse, it offers authentic, accessible training without hardware constraints and supports many concurrent users with a stable, extensible backend.

The Creative System of Chinese Shadow Puppetry in the Metaverse offers a unique VR experience where users control virtual puppets mirrored by robotic arms. Utilizing advanced gesture recognition, it preserves traditional Chinese culture while providing real-time synchronized feedback, enhancing immersion and engagement for users of all ages in an interactive virtual environment.

This work presents a mystical tarot reading experience guided by virtual Amelia, who helps seekers explore ancient wisdom through tarot cards. It invites users to engage by sharing their questions on life topics like love or career. The reading offers insightful guidance, revealing messages of abundance, creativity, and challenges like reluctance to leave unfulfilling situations, encouraging personal growth and clarity.

This VR kitchen lets users choose recipes from a menu and navigate using gestures or a controller. Step-by-step cooking instructions guide users through the process, allowing interaction with food and seasonings. Completed steps are highlighted, and upon finishing, users receive a score evaluating their performance, creating an engaging and interactive cooking practice experience.

The Living History of Hangzhou River project fuses VR, AI-driven NPCs, and 3D Gaussian Splatting to recreate the Grand Canal’s cultural legacy. Through immersive environments, interactive storytelling, and expert evaluation, the system demonstrates how emerging technologies can preserve heritage while engaging audiences. It offers a scalable model for education and tourism, bridging tradition and innovation in the metaverse era.

This project develops a VR framework for reimagining Wuzhen’s cultural heritage along China’s Grand Canal. Using 3D Gaussian Splatting and manual modeling, high-fidelity scenes are enhanced with digital humans for narrative guidance. Gesture-based interaction in a virtual dye workshop and personalized avatars enrich immersion. A location-based entertainment system enables safe, multiplayer experiences. The framework blends storytelling, spatial computing, and interaction to preserve and share Chinese intangible heritage.

This work develops an NFT recommendation system using real-time OpenSea transaction data. It features trending NFTs, whale user detection, image-based similarity search, and short-term price prediction via deep learning models. The platform enables users to discover, track, and invest in NFTs more effectively by combining live blockchain data with advanced machine learning for insightful and personalized recommendations.

This work develops a voice- and AI-driven VR platform for barrier-free interior design, empowering people with disabilities through hands-free 3D creation and real-time collaboration. It uses YOLO v8 for precise room data, speech recognition, eye tracking, and blockchain to ensure seamless design continuity. The platform promotes inclusive education, autonomy, and interactive learning in a unified metaverse environment.

This work demonstrates an AI-powered coloring system for line drawings. It offers two modes: automatic coloring without a reference and coloring based on a reference image. Users upload line art and optionally reference pictures, then generate detailed, vibrant colored images. The interface is user-friendly, allowing preview and saving of results, enhancing digital artwork creation with AI assistance.

This project develops a playable VR game tailored for a niche domain. It combines immersive virtual reality environments with unique interactive gameplay to engage users deeply. The game is designed to meet specific user needs within the niche, providing an enjoyable, accessible, and innovative experience that leverages VR technology for specialized entertainment and education.

This work presents a musical composition or sound design emphasizing continuous, evolving music over more than two minutes. The piece features layered sounds and melodies that create an immersive auditory experience, likely intended for relaxation, ambiance, or artistic expression, highlighting the emotional and atmospheric power of music without words or distinct narrative elements.​

This work develops a human-centered AI system that analyzes amateur football videos to match players’ styles with professional stars using multi-model deep learning. It generates personalized digital star cards via generative AI, offering an engaging interactive experience. The web-based platform emphasizes accuracy, usability, and scalability, supporting sports training, entertainment, and social interaction with future AR/VR integration plans.

This work presents a virtual travel assistant powered by an LLM agent integrating metaverse technology. The assistant interacts naturally to customize a historical and cultural VR tour, guiding users through landmarks like the Temple of Heaven and Forbidden City. It offers real-time explanations based on user focus and gestures, creating an engaging, informative, and immersive virtual travel experience.

This work showcases an intelligent shopping assistant that provides personalized food recommendations and recipes based on user needs, such as allergies. It suggests safe alternatives, interactive product guidance, and simple cooking tips, all delivered through natural, friendly conversation. The assistant focuses on enhancing the shopping experience while politely managing questions outside its expertise, creating an engaging and helpful dialogue.

This work demonstrates the setup and running of a Django web development server for a project called "myproject." It shows the server starting without issues, user login and logout processes, and data fetching capabilities. The demonstration highlights a basic web application environment for development, emphasizing user account management and backend data interaction within a sandbox testing space.

This work showcases an intelligent digital asset transaction platform that analyzes user wallet data to detect suspicious communities using community detection algorithms. Suspicious addresses can be flagged and recorded on the blockchain via smart contracts. The system predicts transaction risk scores, uses GPT-4 for risk analysis and suggestions, enhancing security by alerting on high-risk transactions and preventing fraud.

This work presents an interactive Scrum teaching simulation game that immerses players in a realistic agile software development environment. Players form teams, assign tasks, and manage sprints while interacting with AI-driven team members to solve problems. The game enhances understanding of Scrum’s practical application and promotes engaging learning through immersive gameplay, with future plans for multiplayer and metaverse integration.​

This work features a virtual fashion assistant named Selena who helps users explore and select sporty style brands. Through interactive dialogue, Selena gathers user preferences to provide personalized brand recommendations, including current stock and release information. The system creates an engaging shopping experience by combining conversational AI with a fashion database to assist users efficiently in a virtual retail environment.

This work presents an environmental restoration VR game where players revitalize a polluted barren land by disinfecting soil, irrigating, and planting trees. Players address water pollution by removing factory pollution sources and replacing them with clean energy. The game uses NPC guidance to teach sustainable practices, fostering awareness of environmental issues and solutions through engaging interactive gameplay.