Explore the vast range of titles available.

Many initiatives have promoted collaborative heuristic evaluation to avoid discrepancies between evaluator’s ratings. This paper presents G4NHE (Game for aNy heuristic evaluation), a card game proposed to increase the engagement of different evaluators in an evaluation process based on heuristic evaluation. G4NHE is a generalization of previous work (the G4H gamification) to be applied to different usability heuristics. G4H was designed to support Nielsen’s heuristics only. The main goal of G4NHE is to provide an engaging and ludic way to consolidate collaborative heuristic evaluation. It can also be used by students and professionals to coordinate the tasks of heuristic evaluations. Several usability heuristics were analyzed to identify the common characteristics and how these characteristics demand changes in the rules of original G4H generic gamification named G4NHE. G4NHE can be used as complementary material to HCI courses. This paper presents the steps used to create G4NHE and a guide to enable any HCI professional or student to use G4NHE gamification with any usability heuristic. As a result, this work enables gamification non-specialists to create a gamification based on G4H (a gamification built for Nielsen’s heuristics) to any usability heuristic. G4NHE still needs to be fully evaluated, but the expectations are that it can take advantage of the engagement, ludic teaching, and participation satisfaction already present in G4H by using any usability heuristic.

PurposeTo address the key problem of lack of use in the advancement of open government data (OGD) portals from the aspect of good usability, which is an essential prerequisite to the acceptance and usage of a portal, this paper aims to develop a usability framework including design principles and criteria for OGD portals and to discover problems in the present usability design.Design/methodology/approachThis study builds the usability framework by extending usability principles for general websites to address the specific needs of OGD portals. Criteria for each principle are developed accordingly based on the literature. A comparative heuristic evaluation involving five expert evaluators and 13 Chinese province-level OGD portals has been carried out to test the capability of the usability framework.FindingsA usability framework with 24 principles and 63 criteria has been built. The heuristic evaluation shows OGD portals performed better in meeting general principles than the OGD portals specific ones. Insufficient help functions weakened OGD portals' usability. Similarities and differences were found of Chinese OGD portals compared with similar studies in the United States.Originality/valueThis paper proposed a usability framework for OGD portals and proved its capability in recognizing usability problems and its causes by carrying out a comparative heuristic evaluation in China. By comparing the evaluation results with other studies in the United States, the findings and lessons learnt in this study can thus be shared across international borders.

Background There are differences of opinion regarding the selection of the most practical usability evaluation method among different methods. The present study aimed to compare two expert-based evaluation methods in order to assess a nursing module as the most widely used module of a Hospital Information System (HIS). Methods Five independent evaluators used the Heuristic Evaluation (HE) and Cognitive Walkthrough (CW) methods to evaluate the nursing module of Shafa HIS. In this regard, the number and severity of the recognized problems according to the usability attributes were compared using two evaluation methods. Results The HE and CW evaluation methods resulted in the identification of 104 and 24 unique problems, respectively, of which 33.3% of recognized problems in the CW evaluation method overlapped with the HE method. The average severity of the recognized problems was considered to be minor (2.34) in the HE method and major (2.77) in the CW evaluation method. There was a significant difference in terms of the total number and average severity of the recognized problems by these methods ( P  < 0.001). Based on the usability attribute, the HE method identified a larger number of problems concerning all usability attributes, and a significant difference was observed in terms of the number of recognized problems in both methods for all attributes except ‘memorability’. Also, there was a significant difference between the two methods based on the average severity of recognized problems only in terms of ‘learnability’. Conclusion The HE method identified more problems with lower average severity while the CW was able to recognize fewer problems with higher average severity. Regarding the evaluation goal, the HE method was able to be used to improve the effectiveness and satisfaction of the HIS. Furthermore, the CW evaluation method is recommended to identify usability problems with the highest average severity, especially in terms of ‘learnability’.

Sex workers face an epidemic of violence around the world. However, violence against sex workers (VASW) is underreported, and sex workers hesitate to report to the police because they are frequently punished; therefore, an alternative for reporting is needed. Sex workers also face stigmatization from health care workers, further discouraging help-seeking behavior or reporting in health care facilities. Sex workers have been recipients of services from nongovernmental organizations, typically related to HIV and sexual transmission of infections, but violence remains underaddressed. This study aims to apply human-centered design methods to adapt ReportVASW for use in the Middle East and North Africa and to evaluate the usability of the prototype interface and identify opportunities for improvement. Evaluation methods included cognitive walkthrough and System Usability Scale by 9 potential end users, and heuristic evaluation by 2 informatics professionals and 2 service providers. This study explores ways to improve the trilingual prototype of ReportVASW, with particular attention to ways to improve the data collection tool. Multiple methods identified multiple issues to address. Heuristic analysis revealed 2 serious issues to address, with scores over 2.5 out of 4 in the tool used. The most serious problems identified in heuristic analysis were related to language, particularly the Arabic version. Translation issues were addressed before end user testing. End users were enthusiastic about the idea of a mobile tool to document VASW, provided it led to change. They gave ReportVASW a System Usability Scale of 91.4, above the 68 considered good. Even as end users were enthusiastic, they offered suggestions for improvement. Many opportunities to improve the interface were identified. Most changes are not overly complex, and the majority involve adapting the language used and improving the translation. Development of the trilingual ReportVASW data collection tool for the Middle East and North Africa region is worth pursuing.

Technology has the potential to facilitate the development of higher-order thinking skills in learning. There has been a rush towards online learning by education systems during COVID-19; this can therefore be seen as an opportunity to develop students’ higher-order thinking skills. In this short report we show how critical thinking and creativity can be developed in an online context, as well as highlighting the importance of grit. We also suggest the importance of heuristic evaluation in the design of online systems to support twenty-first century learning.

Heuristic evaluation (HE) is widely used to evaluate various software, interfaces, systems, or application domains, but using generic heuristics will fail to detect specific usability issues. Researchers currently rely on traditional heuristics such as Nielsen’s, SMART, SMASH, or other domain-specific heuristics, which are unsuitable for a modern API system. Although several researchers have successfully developed heuristics specifically for modern systems such as web apps or smartphone apps, there is a lack of specific heuristics for Progressive Web Applications (PWA), a hybrid of native and web apps. Therefore, this paper reports the systematic development of specific heuristics for PWA using a standard eight-step methodology: Exploratory, Experimental, Descriptive, Correlation, Selection, Specification, Validation, and Refinement. The PWA heuristics called PWAUH developed in this study consist of 15 heuristics. We have validated our initial PWAUH with five experts from academia and industry, and the initial 14 heuristics are suitable for further expert validation. Subsequently, PWAUH was further validated using three different PWA domains, cultural heritage, stock photo industry, and marketplace, with sixteen experts ranging from academicians, UX researchers, R&D executives, and postgraduate students in HCI. An additional heuristic is included in the list in the refinement stage. Findings show that PWAUH is effective in identifying usability issues.

Background None of the evaluation methods can identify all the usability problems of information systems. So far, no study has sufficiently investigated the potential of a combination of these methods to identify usability problems. The present study aimed at examining the potential for combining two commonly utilized user-based and expert-based methods to evaluate the usability of a hospital information system. Methods Think aloud (TA) and Heuristic evaluation (HE) methods were used to identify the usability problems of two subsystems of the Social Security Electronic System in Iran. To this end, the problems were categorized into five groups based on ISO-Nielsen usability attributes. The Chi-square test was applied to compare the intended methods based on the total number of problems and the number of problems within each group, followed by utilizing the Mann-Whitney U test to compare the mean severity scores of these methods. Results The evaluation by combining these methods yielded 423 problems of which 75% varied between the methods. The two methods were significantly different in terms of the total number of problems, the number of problems in each usability group, and the mean severity of two satisfaction and efficiency attributes ( P  < 0.05). However, no significant difference was observed between the two methods based on the mean severity of problems and severity scores related to three usability attributes i.e., effectiveness, learnability, and error prevention ( P  > 0.05). In addition, the mean severity of problems identified by each method was at the “Major” level. Conclusion Based on the results, although the mean severity scores of the identified problems were not significantly different, these methods identify heterogeneous problems. HE mainly identifies problems related to satisfaction, learnability, and error prevention while TA detects problems related to effectiveness and efficiency attributes. Therefore, using a combination of these two methods can identify a wider range of usability problems.

With the growing emphasis on developing 21st century skills among today's youth, there is continued optimism about the possibilities granted by increasing access to networked technologies, particularly for encouraging youth to pursue their interests and take ownership of their learning. Yet, research demonstrates the importance of adult support in realizing the promise of achieving these outcomes. Designers of such systems are thus faced with the need to create youth-centered spaces that also provide adult facilitation of learning. This paper presents an adaptation of the traditional heuristic evaluation method which provides designers of online learning systems with a holistic view of how adult learning support is enabled across the system. We describe how the heuristic evaluation method was adapted, and through a case example analyzing one online social learning system used in a middle school context, we demonstrate how it can be used to help identify areas for improvement and promising areas for further research. We also present a framework of heuristics which reflect specific educator learning support roles that have been found to be important for youth learning, particularly for supporting 21st century skills. This work contributes a novel heuristic evaluation method that can help designers of online learning platforms attend not only the experiences of learners, but also to how educators are enabled to support their learning.

Background Usability engineering is essential for ensuring the safety and effectiveness of medical software, as design‐related issues are a leading cause of use errors in clinical settings. Heuristic evaluation provides a practical approach to identifying usability problems, but its outcomes depend heavily on expert interpretation. Large Language Models (LLMs), such as ChatGPT, offer a potential means to augment heuristic evaluation by generating structured, context‐aware usability feedback. This study explored the use of ChatGPT to support heuristic assessment of the Radiation Planning Assistant (RPA), a web‐based radiotherapy planning tool designed to support clinical teams in low‐ and middle‐income countries. Methods ChatGPT was provided with the RPA user and technical guides, training videos for each functional dashboard, and Zhang et al.’s 14 usability heuristics. The model was instructed to score each dashboard according to these heuristics, using Zhang's 0–4 severity scale, and to propose concrete interface improvements. The resulting feedback was reviewed and scored independently by the RPA developer team and by 13 users during a dedicated User Meeting. Comparative analysis was performed between ChatGPT, developer, and user ratings. Results ChatGPT identified 26 potential usability issues across six heuristic domains. The developer team considered nine of these actionable, though all were classified as minor (severity ≤ 2). User ratings showed wide variability, with nine suggestions achieving mean scores ≥ 1.5. Qualitative agreement between users and developers was limited, underscoring the importance of diverse perspectives in heuristic evaluation. Three suggestions—enhanced upload logs, reversible actions (“reopen request”), and stronger error prevention—were rated as potentially high priority by a minority of users. ChatGPT's ratings were consistent across dashboards. Conclusions While ChatGPT did not reveal any critical usability failures, its heuristic assessment proved valuable in prompting discussion, identifying minor refinements, and enriching both developer and user engagement with the RPA's interface design. This study demonstrates that LLMs can serve as an effective, low‐cost complement to conventional heuristic evaluation, supporting early‐stage usability review and stakeholder dialogue in the development of medical software.

Introduction The pharmacy surveillance information system (PSIS) is intended to manage the dispensing practice of under-controlled drugs and substances. We designed and developed a PSIS for the first time in a developing country. This study aimed to evaluate the usability of this system using a heuristic evaluation method before the pilot implementation in outpatient pharmacies. Materials and methods The study was conducted in 2022 during the development of a pharmacy surveillance information system. Five evaluators examined the system using Nielson’s heuristic evaluation method. The detected usability problems were categorized into 10 Nielson’s usability principles, and their severity was calculated. Results In total, 91 unique usability problems were identified. The most detected usability problems were minor (60%). The “consistency and standard” (31%), “aesthetic and minimalist design” (28%), and “match between system and the real world” (12%) were the most frequent problems. Also, the “flexibility and efficiency of use” (mean = 2.9), “error prevention” (2.85), and “user control and freedom” (2.8) were the most severe problems. Conclusion The study has identified the most common and severe usability issues of an information system. It is important for the system developers to address these issues as it can significantly improve users’ trust and satisfaction. Therefore, all the identified usability problems were resolved before the system was implemented.