<link rel="stylesheet" href="styles.cf390c6bfbe7555f.css">
Repository logo

RPD-Grounded Simulated Users for Pre-screening AR Training Interface Designs: A Unity ML-Agents Approach

Loading...
Thumbnail Image

Files

Size: 1.09 MB, File format: Adobe PDF

Authors

Thilakarathna, Thusithanjana

Wong, BL William

Nguyen, Minh

Supervisor

Degree name

Journal Title

Journal ISSN

Volume Title

Publisher

BCS Learning & Development

Abstract

Evaluating augmented reality (AR) training interfaces typically requires recruiting domain practitioners, coordinating controlled studies, and incurring the logistical and ethical costs of human-subject testing. This paper presents a pre-screening framework that uses simulated users to surface interface design trade-offs before human trials begin. Agents are built with Unity ML-Agents and grounded in the Recognition-Primed Decision (RPD) model, with distinct reward structures derived from Cognitive Task Analysis of paramedic diagnostic reasoning encoding novice and expert decision strategies. We evaluate three interface configurations varying in button density, spatial layout, and labelling across both agent types, and characterize behaviour using behavioural interaction indicators computed from interaction logs and conceptually organized using a structure inspired by the NASA Task Load Index (NASA-TLX). Results show that dense dispersed layouts impose the highest temporal and search cost on novice agents, while deceptive clustering imposes the highest temporal and effort cost on expert agents. Search Complexity Indicator diverged between cohorts in a pattern consistent with RPD-predicted selective attention: expert agents narrowed search as complexity increased while novice agents maintained broad attention throughout. These patterns were consistent across behavioural indicator scores and raw interaction metrics including path entropy, inter-click intervals, and idle ratios. The framework requires no human participants, produces reproducible behavioural traces across conditions, and is intended as a complement to human-subject evaluation rather than a replacement. Validation against human self-reported ratings and objective performance data is identified as the essential next step.

Description

Keywords

46 Information and Computing Sciences, 4608 Human-Centred Computing, 4602 Artificial Intelligence, Simulated users, Recognition-Primed Decision, augmented reality training, Unity ML-Agents, AR UI evaluation

Source

Proceedings of the 39th International BCS Human-Computer Interaction Conference 2026 (BRITCHI26). 1–3 November 2026, Brunel University, UK. Pages: 97-107

Rights statement

© Thilakarathna et al. Published by BCS Learning and Development Ltd. Proceedings of BRITCHI 26 2026, UK. Open access.

Endorsement

Review

Supplemented By

Referenced By