Tags:Mixed Reality for rehab, Multimodal assessment, STEM education in VR and XR education
Abstract:
Embodied XR Design Principles.Mina Johnson-Glenberg. Manipulating or interacting with content in 2D is a powerful predictor of learning, but might these effects be enhanced when using 3D VR platforms? Manipulating objects in multiple dimensions can make the environment seem more immersive, presence is enhanced in VR, and user-initiated actions add to the experience of agency. Shouldn’t agentic VR activities always increase learning? I argue for more nuanced interactions (mediator/moderator analyses) to be done that include platform (e.g., desktop vs. VR) and subject variables. Examples and results from 3 studiesare presented across the XR spectrum.
AR – Embodied Graphing. An original app in the Physics Toolbox Suite teaches position-over-time graphing via real time locomotion.
MR – Titration with Haptics. A 3D-printed burette device was created that mimics a real glass burette. ATI interactions reveal that for lower prior knowledge chemistry students being in that novel MR condition was non-optimal.
VR – Catch a Mimic - VR Butterfly Game. Explore embodiment by platform interactions in natural selection. Hint - Low embodied VR is not a winner.
2nd talk SensaSea. Yanjun Lyu - MR and Fostering Children’s Social Collaboration. SensaSea is a responsive multisensory MR room-sized installation at ASU. The game incorporates wearable devices, interactive visual projections, auditory, and tactile modalities. Social proximity of humans controls the virtual gameplay on a very large floor projection. The multi-modal system features innovative real-time vibro-haptic feedback. As players locomote, their actions “stir up the ocean” causing sea creatures to follow them. As players approach one another, their associated creatures (turtle, sea horse, etc.) interact. Such MR games have ramifications for health including rehabilitation, and parent/caregiver engagement.
Symposium - XR and MultiModal Platforms for Healthcare and Education