Xiyue Wang

Debut at a conference - CHI'18 LBW

Email: xwang.xiyue[at]gmail.com

Living at the boundaries of art, design and engineering, I strive to light up our daily lives with support and inspiration from the technologies. My recent research focuses on tangible interfaces that make the museums accessible to people with vision impairments.

🌘 AFFILIATION
Researcher, Accessibility Lab, Miraikan - The National Museum of Emerging Science and Innovation

🌗 KEYWORDS
Human-Computer Interaction; Accessibility; Tangible User Interfaces; Ubiquitous Computing; Affective Computing; Data Processing; Data Analytics; Machine Learning; Deep Learning

🌕 NEWS

Jul 31, 2023	A paper is accepted to ASSETS 2023.
Jul 31, 2022	A paper is accepted to ASSETS 2022.
Oct 2, 2021	Started to work as an accessibility researcher for Miraikan.

🌖 SELECTED PUBLICATIONS

ASSETS

TouchPilot: Designing a Guidance System That Assists Blind People in Learning Complex 3D Structures

Wang, Xiyue, Kayukawa, Seita, Takagi, Hironobu, and Asakawa, Chieko

In Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility 2023

Abs DOI Project Page

Making complex structures accessible to blind people is challenging due to the need for skilled explainers. Interactive 3D printed models (I3Ms) have been developed to enable independent learning of 3D models through activating audio labels. However, they present single-layered information and require users to identify interactive elements through a pinpointing action, which might be insufficient for learning complex and unfamiliar subjects. In this paper, we investigate I3Ms for complex structures. We propose TouchPilot, a guidance system designed based on a study that observed learner-explainer interaction styles. TouchPilot guides users step by step through navigation, exploration of hierarchical elements, and confirmation of their entire areas. A follow-up study found that the guidance system led to better learning outcomes and higher independence compared to a pinpointing system. Feedback suggests that being primed by the guidance system systematically, followed by pinpointing freely for review, is preferred for learning complex structures.
ASSETS

BentoMuseum: 3D and Layered Interactive Museum Map for Blind Visitors

Wang, Xiyue, Kayukawa, Seita, Takagi, Hironobu, and Asakawa, Chieko

In Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility 2022

Abs DOI Project Page

Obtaining information before a visit is one of the priority needs and challenges for blind museum visitors. We propose BentoMuseum, a layered, stackable, and three-dimensional museum map that makes complex structural information accessible by allowing explorations on a floor and between floors. Touchpoints are embedded to provide audio-tactile interactions that allow a user to learn the museum’s exhibits and navigation when one floor is placed on a touch screen. Using a tour design task, we invited 12 first-time blind visitors to explore the museum building, chose exhibits that attracted them, and built a mental map with exhibit names and directions. The results show that the system is useful in obtaining information that links geometric shapes, contents, and locations to then build a rough mental map. The connected floors and spatial structures motivated users to explore. Moreover, having a rough mental map enhanced orientation and confidence when traveling through the museum.