Mixed Reality enables individuals to visualise and interact with artefacts and environments through a combination of physical and virtual assets. It has received increased interest from the design community as a means to accelerate, enrich and enhance prototyping activities. This article concerns MR’s ability to deceive an individual through the combination of virtual and physical assets and their underlying traits (e.g., mass, size), and a user’s cognitive ability to ‘join the dots’. If properly implemented, MR could save time and resources by reducing the required prototype fidelity and the need to fully realise variants. However, there is a gap in understanding how the traits of physical and virtual assets and cognition combine to form reality. This article presents a study investigated the role mass, virtual and physical model size played on users perception of an MR prototype. The relative impact of these factors was determined by varying these parameters and assessing the user’s perceived change. The key finding from this study was that the virtual model size had a far greater influence on prototype perceived by the user. This suggests that the required physical fidelity of an MR prototype can be lower than the virtual. Furthermore, exploring size design variants can be achieved exclusively through changes to the virtual model.

Precise and efficient performance in remote robotic teleoperation relies on intuitive interaction. This requires both accurate control actions and complete perception (vision, haptic, and other sensory feedback) of the remote environment. Especially in immersive remote teleoperation, the complete perception of remote environments in 3D allows operators to gain improved situational awareness. Color and Depth (RGB-D) cameras capture remote environments as dense 3D point clouds for real-time visualization. However, providing enough situational awareness needs fast, high-quality data transmission from acquisition to virtual reality rendering. Unfortunately, dense point-cloud data can suffer from network delays and limits, impacting the teleoperator’s situational awareness. Understanding how the human eye works can help mitigate these challenges. This paper introduces a solution by implementing foveation, mimicking the human eye’s focus by smartly sampling and rendering dense point clouds for an intuitive remote teleoperation interface. This provides high resolution in the user’s central field, which gradually reduces toward the edges. However, this systematic visualization approach in the peripheral vision may benefit or risk losing information and burdening the user’s cognitive load. This work investigates these advantages and drawbacks through an experimental study and describes the overall system, with its software, hardware, and communication framework. This will show significant enhancements in both latency and throughput, surpassing 60% and 40% improvements in both aspects when compared with state-of-the-art research works. A user study reveals that the framework has minimal impact on the user’s visual quality of experience while helping to reduce the error rate significantly. Further, a 50% reduction in task execution time highlights the benefits of the proposed framework in immersive remote telerobotics applications.

Immersive learning technologies offer K–12 English learners simulated contexts for language acquisition through virtual interactions, influencing learner attitudes and enhancing cross-curricular skills. While past literature reviews have explored learners’ English skills and emotions, few have delved into the learning effectiveness of immersive technologies for K–12 students. This systematic review analyzed 33 studies from 2012 to 2021, focusing on research designs, the role of immersive technologies in English learning, and the theoretical underpinnings of these studies. Results highlight the methods used to gauge learning effectiveness, the ways immersive technologies bolster learners’ attitudes and skills, and a noticeable gap in theoretical grounding. Recommendations for future research are provided.

In the medical education field, the use of highly sophisticated simulators and extended reality (XR) simulations allow training complex procedures and acquiring new knowledge and attitudes. XR is considered useful for the enhancement of healthcare education; however, several issues need further research.

The main aim of this study is to define a comprehensive method to design and optimize every kind of simulator and simulation, integrating all the relevant elements concerning the scenario design and prototype development.

A complete framework for the design of any kind of advanced clinical simulation is proposed and it has been applied to realize a mixed reality (MR) prototype for the simulation of the rachicentesis. The purpose of the MR application is to immerse the trainee in a more realistic environment and to put him/her under pressure during the simulation, as in real practice.

The application was tested with two different devices: the headset Vox Gear Plus for smartphone and the Microsoft Hololens. Eighteen students of the 6th year of Medicine and Surgery Course were enrolled in the study. Results show the comparison of user experience related to the two different devices and simulation performance using the Hololens.

Design is multi-modal, and depending on the current stage in the process, progress can be facilitated through working in either the physical or virtual domain with frequent iterations commonly required between. Traditionally, prototyping workflows are sequential, although current trends such as Digital Twinning and Mixed Reality (MR) enable decreased domain transition times, reducing the cycle time. This leads towards fully integrated digital-physical prototypes, enabling work in both domains simultaneously by increasing synchronicity of select variables. This paper considers those variables involved, the sensors that measure them and their rate of synchronisation, thereby investigating the feasibility of MR workflow interventions, and exploring the benefits that may be realised. The paper identifies four components of MR implementations in prototyping and myriad methods by which domain transition may occur and uses these in context of a case study to propose four levels of workflow synchronisation. It was found achieving some high rates of synchronicity is possible, but achieving the highest levels as prescribed by digital twinning is neither feasible nor pragmatic against current MR capabilities and design prototyping workflows.