Journal Article

Usefulness of the script concordance test and influence of reference panel composition on clinical reasoning assessment in pediatric surgery intensive care nurses

Celik, Nazmiye, Tasdelen Teker, Gulsen, Senel, Emrah

2025

Overview

This study aims to achieve two objectives. The first is to evaluate the feasibility, validity and reliability of Script Concordance Test (SCT) designed to assess the clinical reasoning (CR) skills of nurses working in a Pediatric Surgery Intensive Care Unit (PSICU). The second is to investigate the impact of different reference panels on SCT scores. Although the SCT is widely used to assess CR in nursing students, its application in postgraduate nursing practice remains underexplored. A descriptive evaluation and a validation study. A 13-case SCT, was administered to 30 nurses working in the PSICU. The scoring key for the SCT was developed based on three distinct panels. The scores of experts and participants were compared using a t-test. Reliability was assessed through generalizability (G) theory. A decision (D) study conducted within the G theory framework determined the number of cases and items required to achieve optimal reliability. A statistically significant difference in SCT scores was observed across the three-panel compositions. SCT demonstrated its ability to effectively distinguish between experts and participants. The highest reliability (0.71) was achieved with the mixed panel scoring. According to the D study, achieving a reliability of 0.80 or higher requires 100 items. The SCT can be recommended as a tool that provides valid and reliable measures for assessing CR in postgraduate nursing practice. When developing the scoring key for the (SCT), it is advisable to use either a panel consisting solely of nurses or a mixed reference panel. •Although the SCT has been used in nursing students, it has not yet been applied in postgraduate nursing practice.•SCT is a tool that provides valid and reliable measures for assessing clinical reasoning in post-graduate nursing practice.•When creating the scoring key for the SCT, a mixed reference panel consisting of both nurses and physicians can be used.•The number of cases or questions can be increased to enhance the reliability.

• Publisher: Elsevier Ltd,Elsevier Limited
• Subject: Adult / Clinical assessment / Clinical Competence - standards / Clinical decision making / Clinical Reasoning / Clinical skills / Cognition & reasoning / Critical Care Nursing / Decision making / Educational Measurement - methods / Educational Measurement - standards / Evaluation / Evidence / Experts / Feasibility / Feedback / Feedback (Response) / Female / Generalizability / Humans / Hypotheses / Intensive care / Intensive Care Units, Pediatric / Learning Strategies / Long Term Memory / Male / Measures / Medical personnel / Networks / Nurses / Nursing / Nursing clinical reasoning / Nursing education / Nursing practice / Nursing Students / Patients / Pediatric Nursing / Pediatrics / Postgraduate nursing education / Problem solving / Professional judgement / Professional practice / Reasoning / Reference Materials / Reliability / Reproducibility of Results / Scores / Script concordance test / Students / Surgeons / Surgery / Surveys and Questionnaires / Test Content / Test validity and reliability / Tests / Thinking Skills / Usefulness / Validation studies / World Problems