Explore the vast range of titles available.

Personalized Learning (PL) has been widely promoted. Despite the increasing interest in PL, it is difficult to be implemented, because it can be complicated, costly, and even impossible without the help of powerful and advanced technology. This national survey study aimed at systematically investigating technology usage and needs of teachers in learner-centered schools in the U.S based on the conceptual framework of the Personalized Integrated Education System (PIES). PIES specifies four major functions: recordkeeping, planning, instruction, and assessment. A total of 308 learner-centered schools were identified that met at least three of the five criteria of PL: (1) personalized learning plans, (2) competency-based student progress, (3) criterion-referenced assessment, (4) problem- or project-based learning, and (5) multi-year mentoring. Survey responses of 245 teachers from 41 schools were analyzed. Results indicate that only 12% of teachers responded that they had a technology system that integrated the four major functions. Among the rest, 21% reported that they had no such systems. Technology was most widely used for planning and instruction but not for recordkeeping and assessment.

A framework of literacy may have roles to play in the assessment and treatment of children and youth with developmental disorders. This review aims to evaluate the conventional practice of assessment and treatment for children and youth with a developmental disorder in the physical domain, called developmental coordination disorder (DCD), and explore how the framework of physical literacy could contribute to the advancement of the current practice. This study adopts a method of narrative critical review based on a non-systematic search for its broad coverage to provide insights into the trend and future alternative directions. Over recent decades, children and youth with DCD have been typically assessed with standardized norm-referenced tests, before and after task-oriented intervention, for aiding diagnosis and evaluating the treatment effect. However, a recent high-quality systematic review showed limited evidence for the treatment effect assessed by the tests. Here, a framework of physical literacy is proposed to be used as an alternative to the conventional practice by recalibrating treatment goals and modifying the assessment and intervention approaches; criterion-referenced real-life authentic assessment and activities are encouraged with an emphasis on the enjoyment of movement and value of physical activity towards the attainment of physically active and healthy lifestyle goals from a lifespan perspective. The application of the physical literacy framework to the assessment and treatment of DCD needs to be further examined conceptually and empirically, while exploring a potential contribution of the literacy framework to transform the conventional assessment and treatment of children and youth with other developmental disorders.

We created a serious game to teach first year anesthesiology (CA-1) residents to perform general anesthesia for cesarean delivery. We aimed to investigate resident knowledge gains after playing the game and having received one of 2 modalities of debriefing. We report on the development and validation of scores from parallel test forms for criterion-referenced interpretations of resident knowledge. The test forms were intended for use as pre- and posttests for the experiment. Validation of instruments measuring the study's primary outcome was considered essential for adding rigor to the planned experiment, to be able to trust the study's results. Parallel, multiple-choice test forms development steps included: (1) assessment purpose and population specification; (2) content domain specification and writing/selection of items; (3) content validation by experts of paired items by topic and cognitive level; and (4) empirical validation of scores from the parallel test forms using Classical Test Theory (CTT) techniques. Field testing involved online administration of 52 shuffled items from both test forms to 24 CA-1's, 21 second-year anesthesiology (CA-2) residents, 2 fellows, 1 attending anesthesiologist, and 1 of unknown rank at 3 US institutions. Items from each form yielded near-normal score distributions, with similar medians, ranges, and standard deviations. Evaluations of CTT item difficulty (item p values) and discrimination (D) indices indicated that most items met assumptions of criterion-referenced test design, separating experienced from novice residents. Experienced residents performed better on overall domain scores than novices (P < .05). Kuder-Richardson Formula 20 (KR-20) reliability estimates of both test forms were above the acceptability cut of .70, and parallel forms reliability estimate was high at .86, indicating results were consistent with theoretical expectations. Total scores of parallel test forms demonstrated item-level validity, strong internal consistency and parallel forms reliability, suggesting sufficient robustness for knowledge outcomes assessments of CA-1 residents.

The current article evaluates a national English language proficiency test known as the “MSRT test” which is used to determine the eligibility of candidates for admission to and completion of higher education programs in Iran. Students in all majors take this standardized, high-stake criterion-referenced test to determine if they have obtained the minimum English proficiency level and can be graduated. The present paper seeks to examine the test and its psychometrics characteristics due to the significance of such a high-stakes examination that may have social and long-lasting effects on the participants. It is claimed that the test measures participants’ “knowledge of language” for communication rather than their “knowledge about language” in a constrained context. As a result, the test dimensionality and validity are up for debate. It was found that fundamental revisions in terms of test format and content are required to improve the test quality. The current study examined the areas that are yet unexplored and attempts to describe the MSRT assessment comprehensively.

Purpose: The current study aimed to understand the clinical decision-making skills of school-based speech-language pathologists (SLPs) using narrative and expository discourse information from three sources: perception of language through listening to language alone, standardized criterion-referenced narrative assessment data, and word- and morpheme-level language sample analysis data. Method: Twenty-eight current school-based SLPs participated in the study. During this study, participants rated language quality and made decisions regarding the provision of language services after being provided information from informal assessment measures. Results: SLPs' ratings of language quality and complexity varied across the story retell, wordless picture book generation, and expository samples. There was a lack of consistency in ratings within each context across areas of clarity, sample complexity, language complexity, and vocabulary across all SLPs. Self-reported factors that influenced SLPs' ratings included components of structure, syntax, and semantics. SLPs did not indicate a need for services after listening alone. When provided with criterion-referenced narrative assessment scores and word- and morpheme-level language sample data, more SLPs made a recommendation for services. Conclusions: The study demonstrates the need for objective language measure data during diagnostic decision making. Additionally, SLPs may not realize the information obtained from real-time perception, and analysis of language samples may be an unreliable and inconsistent picture of a child's language abilities. The results of this study highlight the need to continue to rely on multiple sources of assessment data. SLPs should continue to incorporate systematic methods to minimize variability of perceptions in the process of making diagnostic decisions.

Cosmology concepts encompass complex spatial and temporal relations that are counterintuitive. Cosmology findings, because of their intrinsic interest, are often reported in the public domain with enthusiasm, and students come to cosmology with a range of conceptions some aligned and some at variance with the current science. This makes cosmology concepts challenging to teach, and also challenging to evaluate students’ conceptual understanding. This study builds on previous research of the authors investigating the methodological challenges for characterising students’ cosmology conceptions and the reasoning underlying these. Insights from student responses in two iterations of an open-ended instrument were used to develop a concept inventory that combined cosmological conceptions with reasoning levels based on the SOLO taxonomy. This paper reports on the development and validation of the Cosmology Concept Inventory (CosmoCI) for high school. CosmoCI is a 28-item multiple-choice instrument that was implemented with grade 10 and 11 school students ( n  = 234) in Australia and Sweden. Using Rasch analysis in the form of a partial credit model (PCM), the paper describes a validated progression in student reasoning in cosmology across four conceptual dimensions, supporting the utility of CosmoCI as an assessment tool which can also instigate rich discussions in the science classroom.

PurposeThis research aims to explore stakeholder perspectives on Ethiopia’s occupational competency assessment and certification systems.Design/methodology/approachThe study utilized a mixed-methods strategy within a concurrent embedded design and adopted a pragmatic perspective. Data collection involved questionnaires, interviews, and focus group discussions, selecting respondents via purposive sampling for their significant experience and deep understanding of competency assessment. Analytical methods included descriptive and inferential statistics, as well as narrative techniques.FindingsThere is a generally positive perception of the value of competency assessments. However, the study finds several major limitations: inadequate candidate competency assessment, lack of skill gap analysis in TVET institutions for improved training, failure to maintain assessment standards, a high candidate-to-assessor ratio, and assessment tools that do not meet occupational standards. These issues show that the existing method misjudges TVET candidates' skills. To increase employer acceptance of competency assessments, the Center of Competence (CoC) agencies should integrate industry expertise, highlight their benefits, and emphasize the importance of training quality and career goals for candidates and trainers.Practical implicationsA study reveals that African nations like Ethiopia, Ghana, South Africa, Rwanda, Morocco, Benin, and Senegal have been implementing competency-based training (CBT) for around two decades, with support from countries like Canada, France, Belgium, Germany, Switzerland, Australia, Luxembourg, and Japan. However, the programs are often inconsistent and disorganized, with little private sector participation. There is a significant difference between the goals of quality assurance entities and the resources allocated. Although competency assessment is a fundamental part of CBT, there is a lack of research demonstrating its practice. Therefore, we conducted this research in Ethiopia, the second most densely populated nation in Africa. The results apply to other comparable nations implementing CBT programs (IIEP-UNESCO, 2021).Originality/valueThe research on stakeholders' perceptions of competency assessment is still in its early stages, with most studies focusing on training quality-related issues. This study expands on our knowledge of occupational competency assessment by analyzing perspectives from a comprehensive stakeholder perspective, considering contextualized assessment practices, addressing stakeholder needs, providing practical implications, and identifying future research directions. Furthermore, it offers valuable perspectives on developing competency-based education in Africa and other regions.

Many students struggle with mathematics, in Norway a pressing concern is the decline in proficiency in high school, and the increased number in need of special education. Assessments of proficiency levels are traditionally done through norm- and criterion-referenced achievement tests, who will rarely detect students struggling or identify effective interventions. In a systematic replication of Lin and Kubina authors examined the relationship between component and composite frequency and accuracy; systematic variations were inclusion of multiple grade levels (5–9), assessing association between composite skills and component skills, and a second screening identifying natural levels and gain. Findings show that component frequency is associated with composite frequency and as such support the findings from Lin and Kubina, and also support the notion that basic skills are prerequisites of more complex skills. Natural level was overall below US students, as was natural gain.

The aim of this study was to design and validate an instrument, based on the WHO 5As+5Rs model, to test the acquisition by nursing students of a brief tobacco intervention (BTI) learning. A validation design of an instrument following the criterion referenced tests model using videos of simulated BTIs in the primary care setting was carried out. The study included 11 experts in smoking prevention/care and 260 second-year nursing students. The study was in two stages: (1) selection and recording of clinical simulations (settings), and (2) test construction. Content was validated by applying the Delphi consensus technique and calculating the Content Validity Ratio (CVR) and Content Validity Index (CVI). A pilot test was conducted for item analysis. Reliability was evaluated as internal consistency (Kuder-Richardson [KR-20]) and test-retest temporal stability (intraclass correlation coefficient [ICC]). Three simulation settings were recorded. An instrument (BTI-St®) was developed with 23 items for dichotomous (yes/no) response. CVR was >70% for all items, KR-20 of 0.81–0.88, and ICC between 0.68 and0.73 (p < 0.0001). The BTI-St® is a robust and reliable instrument that is easily and rapidly applied. It follows the WHO 5As+5Rs model and offers objective criterion-referenced evaluation of BTI learning in nursing students.

Ethical capability is one of a suite of broad competencies that are recent inclusions in national and state curricula in Australia. Problems arise in how to support teachers to assess student progress in complex skill areas. Using methodology derived from the work of Griffin, this study investigated whether a criterion-referenced assessment framework, in the form of rubrics and a learning progression, could be developed for the construct of Ethical Decision-Making (EDM). Firstly, the domain of ethical competency was critically interrogated by examining curriculum documents, educational models, and empirical research into moral development. A construct of EDM and a derived skills framework were then presented to an expert panel of teachers. Over the course of two workshops, the panel critically reviewed the framework and co-constructed a set of rubrics. In a final iteration, the rubrics formed the basis for developing a hypothetical learning progression. Further research would be required to determine whether these assessment materials are useful to support teacher judgement about student progress and curriculum planning. [Author abstract]