Academic Publications
The publications are presented in a chronological order.
Click on the title to access the publication.
2025
Thiago Prado de Campos
,
Saul Delabrida
,
Eduardo Filgueiras Damasceno
,
Natasha Malveira Costa Valentim
ICEIS'25:27th International Conference on Enterprise Information Systems, April, 2025 - Porto,
Portugal
DOI: 10.5220/0013447100003929
UUXE-ToH v4 Outperforms Traditional Tools in Evaluating
Touchable Holographic Experiences
Touchable Holographic Solutions (THS) enable natural hand
interactions with virtual objects in augmented and mixed reality environments, presenting unique
challenges for usability and user experience (UX) evaluation. Traditional tools, such as the
System Usability Scale (SUS) and User Experience Questionnaire (UEQ), do not adequately address
critical aspects of THS, including immersion and presence. The UUXE-ToH questionnaire was
developed to bridge this gap, integrating usability and UX dimensions into a single instrument
tailored to THS contexts. This paper presents the results of a performance and acceptance study
conducted during a workshop at a conference on Human-Computer Interaction (HCI). The study
compared UUXE-ToH v4 with a combination of established instruments, using the Cubism game as a
case study on Meta Quest 2 and Meta Quest 3 devices. Fourteen participants evaluated the game
using one of the two approaches, providing feedback on effectiveness, efficiency, and technology
acceptance. Results show that UUXE-ToH v4 enabled the identification of a greater number of
unique usability and UX issues and scored higher in ease of use and future intention to use
compared to the combined instruments. These findings highlight the robustness and applicability
of UUXE-ToH v4 in evaluating THS, offering significant insights for improving evaluation
methodologies and the design of interactive holographic solutions.
Francisco Anderson Mariano da Silva
,
Wellington Candeia de Araújo
,
Thiago Prado de Campos
,
Tiago Silva da Silva
ICEIS'25:27th International Conference on Enterprise Information Systems, April, 2025 - Porto,
Portugal
DOI: 10.5220/0013433800003929
Evaluating Serious Games in Medical Training: Introducing the MAQJSEM Method
The integration of serious games into medical education, particularly in surgical training, has proven to be a promising approach for enhancing skills and knowledge acquisition. This study introduces the MAQJSEM (Method for Evaluating the Quality of Serious Games in Medical Education), a comprehensive evaluation method designed to address critical dimensions such as motivation, user experience, usability, and knowledge acquisition. The development process involved a systematic literature review, followed by validation through a pilot study and expert evaluations. MAQJSEM was applied to a mobile application focusing on surgical training, and its evaluation revealed the method’s robustness and practicality in assessing serious games within this context. Notable findings include the importance of incorporating emotional and immersive elements, as well as clear instructions and intuitive usability features. Expert feedback led to the refinement of dimensions and items, enhancing the clar ity and relevance of the method. MAQJSEM contributes significantly by offering a validated and adaptable tool for improving serious games in medical education. The method supports developers and educators in creating engaging and pedagogically effective tools, fostering skill development and preparation for real-world challenges in the medical field.
Thiago Prado de Campos
,
Saul Delabrida
,
Natasha Malveira Costa Valentim
Livro:
Minicursos do IHC
2024, 06 Jan 2025
DOI: 10.5753/sbc.16123.0.3
Boas Práticas e Desafios na Avaliação de UX em Ambientes
Virtuais e Aumentados
Apresenta conceitos fundamentais e práticas para promover
experiências de usuário imersivas considerando desafios e cuidados na condução de estudo com
pessoas utilizando ferramentas de realidade virtual.
Thiago Prado de Campos
,
Maria Castello
,
Eduardo Filgueiras Damasceno
,
Natasha Malveira Costa Valentim
Journal on Interactive Systems, Vol. 16 n. 1 (2025), 01 Jan 2025
DOI: 10.5753/jis.2025.4694
A Comprehensive Overview of Usability and UX Evaluation
Technologies for Touchable Holography
This article presents an extended Systematic Mapping Study
(SMS) focused on usability and user experience (UX) valuation technologies for Touchable
Holographic Solutions (THS). Given the growing integration of holograms in Augmented Reality
(AR) and Mixed Reality (MR) settings, evaluating usability and UX becomes highly important. Our
study expands on previous research by analyzing an additional two years of publications,
covering 5429 studies, and selecting 65 that discuss 200 evaluation technologies. The main
problem addressed is the gap in comprehensive evaluation frameworks that integrate usability and
UX criteria. We followed systematic guidelines to identify and analyze evaluation technologies,
highlighting an increased focus on UX alongside traditional usability. Key findings include the
persistent emphasis on time efficiency in usability evaluations and the dominance of generic UX,
usability, and pleasure/fun in UX assessments. However, unique aspects of MR, such as presence,
are often overlooked. The study also reveals a preference for empirical validation through
controlled experiments and case studies, although few technologies have undergone such
validation. Head-mounted displays (HMDs) and smart glasses, especially Microsoft Hololens™,
remain prevalent due to their advanced capabilities. Our findings underscore the need for
integrated evaluation technologies and empirical validation to ensure reliability. This work
contributes to the Human-Computer Interaction (HCI) area by mapping current evaluation
technologies, identifying research gaps, and providing a foundation for developing innovative
and effective evaluation methods for THS, thus advancing the understanding and improvement of
user interaction in immersive environments.
2024
Thiago Prado de Campos
,
Eduardo Filgueiras Damasceno
,
Natasha Malveira Costa Valentim
International Journal of Human-Computer Interaction, 20 Sep 2024
DOI: 10.1080/10447318.2024.2400755
UUXE-ToH: A Validated Tool for Assessing Usability and UX in
Touchable Holograms
Touchable Holographic Solutions (THS) are an application
type in Augmented and Mixed Reality (AR/MR) environments. Evaluating THS requires considering
Usability and User eXperience (UX), particularly Immersion and Presence, often overlooked by
current methods. A systematic mapping study and exploratory search revealed gaps, such as the
lack of a unified instrument for THS usability and UX evaluation, methods that address
THS-specific aspects, and challenges in adapting general evaluation technologies. To bridge
these gaps, we present the Usability and User Experience Evaluation in Touchable Holograms
(UUXE-ToH) questionnaire, with 67 Likert scale items and three open-ended questions. A
validation study with 13 experts provided quantitative data and qualitative feedback. Results
confirm the UUXE-ToH’s efficacy and offer insights for improvement. This research contributes to
Human-Computer Interaction (HCI) by introducing a validated tool for evaluating THS, integrating
hedonic and pragmatic aspects, and supporting early problem identification in development,
accessible to professionals with diverse UX expertise.
Thiago Prado de Campos
,
Marcelo da Silva Hounsell
,
Eduardo Filgueiras Damasceno
,
Natasha Malveira Costa Valentim
SVR '24: Proceedings of the 26th Symposium on Virtual and Augmented Reality, September, 2024
DOI: 10.1145/3691573.3691584
User Experience and Playability Insights from a Puzzle Game
in Mixed Reality
This study investigates the usability, user experience (UX), and playability
of a mixed reality (MR) game called Cubism, which allows participants to interact with holograms
using hand gestures. We conducted an experiment with seven participants to evaluate their
interaction with the game. The Usability and User Experience Evaluation in Touchable Hologram
(UUXE-ToH) questionnaire was the primary data collection instrument to capture participants’
perceptions of usability, satisfaction, and overall experience. Our findings indicate that the
mixed reality environment of Cubism offers an engaging and intuitive user experience, though
several challenges were identified. These insights contribute to the growing body of knowledge
on human-computer interaction in mixed-reality contexts and suggest avenues for improving the
design of future mixed-reality games. This research is valuable to the VR/AR/MR community by
highlighting the critical factors influencing user interaction and satisfaction in MR games.
Thiago Prado de Campos
,
Eduardo Filgueiras Damasceno
,
Natasha Malveira Costa Valentim
ICEIS'24:26th International Conference on Enterprise Information Systems, April, 2024 - Angers,
France
DOI: 10.5220/0012564100003690
Designing and Refining a Questionnaire for Usability and UX
in Touchable Holography
Augmented and Mixed Reality enables applications where users engage in
natural hand interactions, simulating touch, termed touchable holography solutions (THS). These
applications are achievable through head-mounted displays and are helpful in training, equipment
control, and entertainment. Usability and User eXperience (UX) evaluations are crucial for
ensuring the quality and appropriateness of THS, yet many are assessed using non-specific
technologies. The UUXE-ToH questionnaire was proposed and subjected to expert study for content
and face validity to address this gap. This study enhances questionnaire credibility and
acceptance by identifying clarity issues, aligning questions with study theory, and reducing
author-induced bias, offering an effective and cost-efficient approach. The study garnered
numerous contributions that were analyzed qualitatively and processed to refine the
questionnaire. This paper introduces the UUXE-ToH in its initial version, details expert
feedback an alysis, outlines the methodology for incorporating suggestions, and presents the
enhanced version, UUXE-ToH v2. This evidence-based process contributes to a better understanding
of usability and UX evaluation in the THS context. UUXE-ToH can impact the quality of life of
users of solutions applied to education, health, and entertainment by helping develop better
products.
2023
Thiago Prado de Campos
,
Eduardo Filgueiras Damasceno
,
Natasha Malveira Costa Valentim
IHC'23: XXII Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais, October,
2023
DOI: 10.1145/3638067.3638071
State of the Art in Usability and UX Evaluation for
Touchable Holographic Interfaces
Interacting with holograms using the hands is on track to reach a
broad audience in the coming years. Therefore, a current challenge
is understanding how to evaluate this new interaction scenario concerning Usability and User
eXperience (UX). In this use context, the
user interacts with virtual objects in your real environment. Some
already known evaluation technologies have been applied to this
type of solution, although they were not created considering aspects
such as immersion and presence, typical in this interactive environment. Thus, this paper
presents a Systematic Mapping Study (SMS)
that sought to identify usability and UX evaluation technologies
applied to touchable holographic solutions in augmented reality
or mixed reality environments. Furthermore, the SMS sought to
answer questions about evaluation technologies and holographic
solutions. The SMS examined 3551 publications and selected 40 that
presented 106 usability or UX evaluation technologies in a touchable holographic solution. The
results shed light on methods and
aspects little addressed and showed patterns and preferences for
combinations of devices, gestures, and feedback types. This work
contributes to HCI researchers by better understanding the state
of the art of usability and UX evaluation technologies applied to
touchable holographic solutions, classifying them, and discussing
the main gaps and opportunities.
Thiago Prado de Campos
,
Eduardo Filgueiras Damasceno
,
Natasha Malveira Costa Valentim
iSys – Brazilian Journal of Information Systems, v. 16, n. 1, p. 8: 1-8: 33, 2023
DOI: 10.5753/isys.2023.2919
Assessing Porifera: A Collaborative Tool for Systematic
Review Processes
This article presents a study to evaluate the quality of the Porifera
collaborative
tool, which supports
Systematic Literature Review (SLR) and Systematic Mapping Study (SMS) processes. The study
revealed a
high perceived usefulness and ease of use of the tool and identified points for improving the
interface,
such as user feedback and error prevention. The quantitative and qualitative results suggest
that
Porifera is a valuable tool for learning and performing collaborative SLR and SMS. Additionally,
the
article compares Porifera with other related tools, including a discussion on how these other
tools were
evaluated.
Extended version of selected papers from the XVIII Brazilian Symposium on Information
Systems
(SBSI'22)
2022
Thiago Prado de Campos
,
Eduardo Filgueiras Damasceno
,
Natasha Malveira Costa Valentim
SBES'22: XXXVI Brazilian Symposium on Software Engineering, October, 2022
DOI: 10.1145/3555228.3555273
Porifera: Enhancing Collaboration in Systematic Literature
and Mapping Studies
This paper presents Porifera, a collaborative tool to support Systematic
Literature Review (SLR)
and
Systematic Mapping Study (SMS). The tool allows the creation of a project for a researchers
team. The
user defines the goal, the inclusion and exclusion criteria for selecting primary studies, the
search
string, and the digital libraries. Also, the tool imports publications and identifies
duplicates. The
selection process occurs with the individual application of criteria and resolution of
disagreements.
During the process, it is possible to observe the agreement and reliability of the researchers'
evaluations. Porifera works on a web platform and integrates external services for translation,
reference citation, and linking publications' files. Porifera's use can improve review and
selection
processes, optimize time, and prevent errors while facilitating collaboration between
researchers.
Thiago Prado de Campos
,
Eduardo Filgueiras Damasceno
,
Natasha Malveira Costa Valentim
SBSI’22: XVIII Brazilian Symposium on Information Systems, May, 2022
DOI: 10.1145/3535511.3535531
A Collaborative Information System for Supporting Systematic
Reviews in Research
Context: Systematic Literature Review (SLR) or Systematic Mapping Study (SMS)
are a process in
which
publications dataset is systematically analyzed to cover a research field. These processes
involve
multiple investigators collaborating to produce more improved work and often use automated tools
to
facilitate their work. Problem: However, not all tools offer proper support to collaborative SLR
or SMS.
That is, missing a tool to support the study selection process, allowing the collaboration
between
researchers by applying individual criteria and collective decision, supported by agreement or
discussion and consensus. Solution: We developed the Porifera tool to fill this lack. IS Theory:
Technology Acceptance Model (TAM) and a Grounded Theory's phase subset were used to evaluate
Porifera's
tool quality. Methodology: Undergraduate and postgraduate students enrolled in the Experimental
Software
Engineering Research, used the Porifera tool and answered a post-used questionnaire with TAM's
sentences
and other open questions. Then, a quantitative and qualitative analysis was performed. Summary
of
Results: It was possible to see high perceived usefulness and ease of use for Porifera. Too it
noted the
effectiveness of resources to support the collaborative activity and its contribution to
learning and
performing a collaborative SLR or SMS. The evaluation showed points to improve the Porifera's
interface.
Contribution and Impact in the IS area: The Porifera is an IS for data, information, and
knowledge
research management because it gathers publications records and allows it will be interpreted
and
processed, making possible decisions making by researchers. The Porifera also allows performing
an SLR
or SMS with mobility, knowledge sharing, flexibility, and integration between people and
technology.
Earlier to 2021
Thiago Prado de Campos
,
Sérgio Roberto Pereira da Silva
IHC'13: XII Brazilian Symposyium on Human Factors in Computing Systems, October, 2013
DOI: 10.5555/2577101.2577142
Apoio à Pesquisa Exploratória na Web com Ferramenta Baseada
em Extensão de Navegador
This paper describes a study on the phenomenon of exploratory research on the
Web. As a result,
we present a framework to support this type of information seeking with six dimensions: quality,
presentation, time, cognition and knowledge acquisition, personalization and collaboration. We
also present a tool that brings a new way to view the search history with features to organize
research projects. This tool aims to test some aspects of these dimensions, being based on a
server and a
browser extension model. The experiments done showed results that demonstrate a good
acceptability of
the features introduced.
