Lee, YemonConnor, Andy MMarks, Stefan2025-05-062025-05-062024-05-22Journal on Multimodal User Interfaces, ISSN: 1783-8738 (Print); 1783-8738 (Online), Springer. doi: 10.1007/s12193-024-00431-21783-87381783-8738http://hdl.handle.net/10292/19153This paper presents an evaluation of a potential new interaction mode in virtual reality (VR) to determine whether it provides any positive impact in terms of how users interact with content. We evaluated the user experiences for 3D object manipulation across three modes of interaction. Interaction using controllers and gestures are used as baselines from which to gauge the potential value of the new mode of interaction, where a single controller and gestures are combined. This paper reports on a user study that captures quantitative and qualitative data related to a variety of object manipulation tasks in a Virtual Environment (VE). We investigated the impact of this new interaction mode with 40 participants across a number of interaction tasks, with the quantitative evaluation indicating that generally, the mixed mode of interaction resulted in task completion times consistently faster than gesture-based interaction and, in some cases, faster than with the use of controllers alone. A qualitative evaluation of the user experience indicated potential application areas for the new mode of interaction.This version of the article has been accepted for publication, after peer review (when applicable) and is subject to Springer Nature’s AM terms of use, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: http://dx.doi.org/10.1007/s12193-024-00431-20801 Artificial Intelligence and Image Processing0806 Information Systems1203 Design Practice and Management4607 Graphics, augmented reality and games4608 Human-centred computingJournal ArticleOpenAccess10.1007/s12193-024-00431-2