Explore the vast range of titles available.

This study explored the effectiveness of extended time (ET) accommodations in the 2017 NAEP Grade 8 Mathematics assessment to enhance educational equity. Analyzing NAEP process data through an XGBoost model, we examined if early interactions with assessment items could predict students’ likelihood of requiring ET by identifying those who received a timeout message. The findings revealed that 72% of students with disabilities (SWDs) granted ET did not use it fully, while about 24% of students lacking ET were still actively engaged when timed out, indicating a considerable unmet need for ET. The model demonstrated high accuracy and recall in predicting the necessity for ET based on early test behaviors, with minimal influence from background variables such as eligibility for free lunch, English Language Learner (ELL) status, and disability status. These results underscore the potential of utilizing early assessment behaviors as reliable predictors for ET needs, advocating for the integration of predictive models into digital testing systems. Such an approach could enable real-time analysis and adjustments, thereby promoting a fairer assessment process where all students have the opportunity to fully demonstrate their knowledge. This study explored the effectiveness of extended time (ET) accommodations in the 2017 NAEP Grade 8 Mathematics assessment to enhance educational equity. Analyzing NAEP process data through an XGBoost model, we examined if early interactions with assessment items could predict students’ likelihood of requiring ET by identifying those who received a timeout message. The findings revealed that 72% of students with disabilities (SWDs) granted ET did not use it fully, while about 24% of students lacking ET were still actively engaged when timed out, indicating a considerable unmet need for ET. The model demonstrated high accuracy and recall in predicting the necessity for ET based on early test behaviors, with minimal influence from background variables such as eligibility for free lunch, English Language Learner (ELL) status, and disability status. These results underscore the potential of utilizing early assessment behaviors as reliable predictors for ET needs, advocating for the integration of predictive models into digital testing systems. Such an approach could enable real-time analysis and adjustments, thereby promoting a fairer assessment process where all students have the opportunity to fully demonstrate their knowledge.

In the 21st century, complex problem-solving (CPS) serves as a key indicator of educational achievement. However, the elements of successful CPS have not yet been fully explored. This study investigates the role of strategic exploration and different problem-solving and test-taking behaviors in CPS success, using logfile data to visualize and quantify students’ problem-solving behavior on 10 CPS problems with different characteristics and levels of difficulty. Additionally, in the present study, we go beyond the limits of most studies that focus on students’ problem-solving behavior pattern analyses in European cultures and education systems to examine Arabic students’ CPS behavior. The results show that computer-based assessments of CPS are feasible and valid in Jordanian higher education. The findings also confirm the structural validity of CPS, indicating that the processes of knowledge acquisition (KAC) and knowledge application (KAP) can be distinguished and separated in the problem-solving process. Large differences were identified in students’ test-taking behavior in terms of the efficacy of their exploration strategy. We identified four latent classes based on the students’ exploration strategy behavior. The study thus leads to a better understanding of how students solve problems and behave during the problem-solving process in uncertain situations.

In educational settings, students rely on metacognitive processes to determine whether or not to exert effort. We investigated ways to minimize cognitively disengaged responses (i.e., not-fully-effortful responses) during a low-stakes mathematics assessment. Initially, we established theory-driven time thresholds for each item to detect such responses. We then administered the test to 800 eighth-graders across three conditions: (a) control (n = 271); (b) instruction (n = 267); and (c) nudge (n = 262). In the instruction condition, students were told to exert their best effort before starting the assessment. In the nudge condition, students were prompted to give their best effort following each first-attempt response that was both incorrect and not-fully-effortful. Therefore, students had multiple opportunities to adjust their level of effort. Nudges, but not effort instruction, significantly reduced students’ not-fully-effortful responses. Neither the nudges nor the effort instruction significantly impacted performance. In a post-test survey, most students reported that they received nudges whenever they did not know the answer (55%). Overall, these findings suggest that while nudges reduce cognitively disengaged responses, most students appear to strategically modulate their level of effort based on self-monitoring their knowledge and response effort.

One of the biggest challenges for online learning is upholding academic integrity in online assessments. In particular, institutions and faculties attach importance to exam security and academic dishonesty in the online learning process. The aim of this study was to compare the test-taking behaviors and academic achievements of students in proctored and unproctored online exam environments. The log records of students in proctored and unproctored online exam environments were compared using visualization and log analysis methods. The results showed that while a significant difference was found between time spent on the first question on the exam, total time spent on the exam, and the mean and median times spent on each question, there was no significant difference between the exam scores of students in proctored and unproctored groups. In other words, it has been observed that reliable exams can be conducted without the need for proctoring through an appropriate assessment design (e.g., using multiple low-stake formative exams instead of a single high-stake summative exam). The results will guide instructors in designing assessments for their online courses. It is also expected to help researchers in how exam logs can be analyzed and in extracting insights regarding students' exam-taking behaviors from the logs.

This study aimed to explore the effects of marking and metacognition-evaluated feedback (MEF) in computer-based testing (CBT) on student performance and review behavior. Marking is a strategy, in which students place a question mark next to a test item to indicate an uncertain answer. The MEF provided students with feedback on test results classified as correct answers with and without marking or incorrect answers with and without marking. The study analyzed 454 ninth graders randomly assigned to three groups:Gmm (marking + MEF),Gmu (marking), andGuu (none). Each group was further categorized into three subgroups based on their English ability. Results showed that marking improved medium-ability examinees' test scores. This was a promising finding because the medium-ability students were the very target group that had the most potential for improvement. Additionally, MEF was found to be beneficial as well in that it encouraged students to use marking skills more frequently and to review answer-explanations of the test items. The follow-up interviews indicated that providing adaptive and detailed AEs for low-ability students were necessary. The present study reveals the potential of integrating marking and adaptive feedbacks into the design of learning functions that are worth implementing in CBT systems.

This study examines the relationship between stereotype threat and individual test-taking behaviors. Previous research has examined the impact of stereotype threat on test scores, but little research has examined the impact of stereotype threat on the test-taking behaviors impacting those scores. Using a pre-post experimental design, stereotype threat was manipulated and test-taking behaviors (e.g., time spent per item, response changes) were measured while completing verbal ability items before and after the manipulation. The results indicated that stereotype threat minimally impacted time-related test-taking behaviors, but did impact behaviors related to response changes. Implications of the findings are discussed.

Students’ use of learning strategies (i.e., what students do when studying) is linked to their achievement in undergraduate science, technology, engineering, and math (STEM) courses, and several study strategies have been individually associated with course and exam grades in multiple contexts. In this study, we surveyed students in a learner-centered, large-enrollment introductory biology course about their study strategies. We aimed to identify groups of strategies that students often reported together, possibly reflecting broader approaches to studying. Exploratory factor analysis revealed three groups of study strategies frequently co-reported (which we named housekeeping strategies , use of course materials , and metacognitive strategies ). These strategy groups map onto a model of learning that associates specific suites of strategies to phases of learning, which correspond to different levels of cognitive and metacognitive engagement. Consistent with previous work, only some study strategies were significantly associated with exam scores: students reporting higher use of course materials and of metacognitive strategies earned higher scores on the first course exam. Students who improved on the subsequent course exam reported increasing their use of housekeeping strategies and of course materials . Our findings contribute to a deeper understanding of students’ approaches to studying in introductory college biology and of the relationships between study strategies and achievement. This work may support instructors in adopting intentional classroom practices to foster students’ development as self-regulated learners, able to identify expectations and criteria for success and to implement appropriate and effective study strategies.

Getting admission into a university is highly competitive globally and can be regarded as a mental stressor for some individuals. In Bangladesh, most of the universities allow students to repeat the test, whereas repeat test-taking students are supposed to suffer from psychological issues like burnout because of academic non-achievement in their first attempt. But there is no prior study assessing burnout to the population, which was investigated herein. A cross-sectional study was carried out among a total of 911 Bangladeshi university entrance test-taking students (i.e., 49.5% first-time test-takers). The survey measures included socio-demographics, admission-related issues, and mental health problems (depression, anxiety, and burnout). Of the mental health problems, depression, anxiety, and burnout were assessed by the Patient Health Questionnaire (PHQ-9), Generalized anxiety disorder (GAD-7), and Maslach Burnout Inventory—Student Survey (MBI–SS), respectively. In light of two-dimensional and three-dimensional cutoff schemes of the MBI—SS, about 43.7% and 17.3% of the test-taking students, respectively, were classified to be burnout in the total sample. Additionally, 48.1%, 71.4%, and 49.1% of the students in the total sample reported higher emotional exhaustion, higher cynicism, and lower academic efficacy, respectively. In respect to the student status, two-dimensional burnout (48.0% vs. 39.2%; χ 2 = 7.164, p = 0.007), and emotional exhaustion (52.2% vs. 43.9%, χ 2 = 6.789, p = 0.034) were significantly higher among the repeat test-taking students. Satisfaction with previous mock tests, depression, and anxiety were the associated factors of burnout in all three samples. Based on the present study, it can be concluded that the university entrance test appearing students are highly prevalent to burnout, and the rate increases with academic non-achievement. As the first study assessing burnout to the population, the findings are anticipated to be helpful for policymaking and further studies both inside and outside Bangladesh.

Objectives : The current study aimed to carry out a post-validation item analysis of multiple choice questions (MCQs) in medical examinations in order to evaluate correlations between item difficulty, item discrimination and distraction effectiveness so as to determine whether questions should be included, modified or discarded. In addition, the optimal number of options per MCQ was analysed. Methods: This cross-sectional study was performed in the Department of Paediatrics, Arabian Gulf University, Manama, Bahrain. A total of 800 MCQs and 4,000 distractors were analysed between November 2013 and June 2016. Results: The mean difficulty index ranged from 36.70–73.14%. The mean discrimination index ranged from 0.20–0.34. The mean distractor efficiency ranged from 66.50–90.00%. Of the items, 48.4 %, 35.3 %, 11.4 %, 3.9 % and 1.1 % had zero, one, two, three and four nonfunctional distractors (NFDs), respectively. Using three or four rather than five options in each MCQ resulted in 95 % or 83.6 % of items having zero NFDs, respectively. The distractor efficiency was 91.87%, 85.83% and 64.13 % for difficult, acceptable and easy items, respectively (P <0.005). Distractor efficiency was 83.33 %, 83.24% and 77.56 % for items with excellent, acceptable and poor discrimination, respectively (P <0.005). The average Kuder- Richardson formula 20 reliability coefficient was 0.76. Conclusion: A considerable number of the MCQ items were within acceptable ranges. However, some items needed to be discarded or revised. Using three or four rather than five options in MCQs is recommended to reduce the number of NFDs and improve the overall quality of the examination.