Catalogue Search | MBRL
Search Results Heading
Explore the vast range of titles available.
MBRLSearchResults
-
DisciplineDiscipline
-
Is Peer ReviewedIs Peer Reviewed
-
Item TypeItem Type
-
SubjectSubject
-
YearFrom:-To:
-
More FiltersMore FiltersSourceLanguage
Done
Filters
Reset
5,042
result(s) for
"Content Validity"
Sort by:
Content Validity of Assessment Instrument for Employee Engagement
by
Dhanda, Upasana
,
Shrotryia, Vijay Kumar
in
Action orientation
,
Content Validity
,
Employee involvement
2019
Numerous overlapping and inconsistent views of academicians and practitioners on construct of employee engagement have led to the development of various measurement instruments that differ in terms of the variables. The article attempts to develop an assessment instrument and to assess content validity of the proposed variables/dimensions. The construct is generated through grounded theory method, conducting structured interviews of human resource heads (15 best firms). The assessment of content validity is done through six domain experts. Content validity index, Kappa statistic, and content validity ratio (Lawshe test) were implemented for content validity. Three dimensions (alignment, affective, and action-oriented) having 10 items each were identified. The item content validity index (I-CVI) ranged from 0.66 to 1 and scale content validity index (S-CVI/Ave) ranged from 0.848 to 0.932. The instrument is assessed with high content validity. It bridges the research gap of incongruity among academic and industry. The next step of research will involve testing of this instrument for psychometric properties and testing its comprehensiveness for respondents.
Journal Article
Qualitative Research and Content Validity: Developing Best Practices Based on Science and Experience
by
Tesler, Laura E.
,
Brod, Meryl
,
Christensen, Torsten L.
in
Best practice
,
Clinical trials
,
Content validity
2009
Purpose Establishing content validity for both new and existing patient-reported outcome (PRO) measures is central to a scientifically sound instrument development process. Methodological and logistical issues present a challenge in regard to determining the best practices for establishing content validity. Methods This paper provides an overview of the current state of knowledge regarding qualitative research to establish content validity based on the scientific methodological literature and authors' experience. Results Conceptual issues and frameworks for qualitative interview research, developing the interview discussion guide, reaching saturation, analysis of data, developing a theoretical model, item generation and cognitive debriefing are presented. Suggestions are offered for dealing with logistical issues regarding facilitator qualifications, ethics approval, sample recruitment, group logistics, taping and transcribing interviews, honoraria and documenting content validity. Conclusions It is hoped this paper will stimulate further discussion regarding best practices for establishing content validity so that, as the PRO field moves forward, qualitative research can be evaluated for quality and acceptability according to scientifically established principles.
Journal Article
Developing the 'Imagery during exercise questionnaire-Gym Version' and assessing its content validity
by
Beneka, Anastasia
,
Efstathiou, Michalis
,
Daskalaki, Katerina
in
Construct Validity
,
Content Validity
,
Dropout Rate
2024
Mental imagery (MI) is a psychological technique traditionally applied outside exercise contexts. However, recent studies indicate its potential benefits during physical activity, particularly for enhancing positive emotions and self-regulation of exercise behavior. While existing questionnaires capture aspects of MI regarding the exercise, none are specifically designed to evaluate MI during training. Therefore, it is necessary to create a new questionnaire. Establishing its content validity (CV) is the initial step in this process. Despite its importance for subsequent validity assessments and the reliability of the measurement instrument, CV is often overlooked or superficially addressed, possibly owing to a lack of comprehensive guidelines. In response to these needs, the aim of this study was to develop the \"Imagery during Exercise Questionnaire-Gym Version\" (IdEQ-GV) to assess the functions of MI during exercise and to measure its CV. This study also provides a step-by-step presentation of the content validation process. The development of the IdEQ-GV involved instrument design and judgmental evidence from academic experts and lay experts (i.e., potential research subjects). The first version of the questionnaire, consisting of 34 items across 6 dimensions, was assessed by three content experts who evaluated its CV in terms of relevance, essentiality, clarity, and comprehensiveness and provided feedback. The second version, comprising 28 items across 5 dimensions, was re-evaluated by content experts and discussed in cognitive interviews with 13 gym members, who also provided feedback and scores regarding comprehensibility and comprehensiveness. After making the necessary modifications, the third version of the IdEQ-GV, containing 24 items, was evaluated by a new sample of 20 exercisers for comprehensibility. The methods used to quantify CV included the content validity index (CVI), the scale-level CVI (S-CVI), which comprises the average CVI (S-CVI/Ave) and universal agreement (UA) among experts (S-CVI/UA), and the content validity ratio (CVR). The IdEQ-GV was found to have an excellent CV regarding relevance, with an S-CVI/UA of 1.00. For clarity, the S-CVI/Ave was 0.95. For essentiality, the average CVR of the scale was 0.83. For comprehensiveness, according to the content experts' scores, the S-CVI/Ave was 0.93, while the first sample of exercisers gave it a perfect score. Regarding comprehensibility, the final sample of exercisers rated the SCVI/Ave at 0.93. Through this analytical process, it has been established that the IdEQ-GV has excellent content validity and is now ready for widespread distribution to establish additional psychometric properties.
Journal Article
Academics’ Epistemological Attitudes toward Sources of Knowledge Questionnaire
2024
The role of knowledge and its sources in the academic field is central to cognition and action. The present research provides a theoretical and methodological viewpoint on evaluating sources of knowledge. This article presents a novel model and method for studying the epistemological attitudes (EAs) of academics toward sources of knowledge. The EA is an epistemological phenomenon and mechanism presenting the cognition of knowledge sources as a process occurring in epistemological, contextual, and subjective realms. Adhering to the model, the EA incorporates four concepts that embody the epistemological strategy and epistemological approach for knowledge acquisition, the context of relevant usage, the motivation for utilizing the source, and the inherent personal value acquired. Based on the model, a new method has been developed to study the sources of knowledge used by academics and represent their constructs. The development process consisted of three stages: formal, substantive, and procedural. In the formal and substantive stages, the content and methodology were developed, and in the procedural stage, the appropriateness of the content was assessed by adapting the expert review approach. A panel of seven experts comprising university academics and subject-matter experts in philosophy, methodology, education research, and psychology participated in the expert review study. The results present the experts’ analysis of the method regarding the content validity index (CVI). A questionnaire that explores academics’ EAs toward various sources of knowledge has been developed. The method reflects how well knowledge sources transfer objective and meta-knowledge dimensions. These help determine essential sources for education, research, and science.
Journal Article
Development and evaluation of the measurement properties of a generic questionnaire measuring patient perceptions of person-centred care
2020
Background
Implementation of person-centred care (PCC) is a challenging undertaking. Thus, a call has been issued for a robust and generic instrument to measure and enable evaluation of PCC across settings and patient groups. This study aimed to develop a generic questionnaire measuring patients’ perceptions of PCC. Further aims were to evaluate its content and measurement properties using a mixed-methods approach entailing Rasch and qualitative content analyses.
Methods
The study was conducted in three iterative phases. Phase one included six key informants to gain a broad view of the concept. Phase two entailed a Delphi study involving two rounds with eight experts who generated ratings on relevance, readability, comprehensiveness and suggestions for revision. Data were analysed using the Item Content Validity Index in conjunction with qualitative comments to improve the questionnaire. Phase three was performed using a mixed-methods design. Quantitative data were collected from patients (
n
= 553) responding to the questionnaire who were recruited from six in- and outpatient care units in a health care region in Sweden. Data was analysed using the Rasch measurement model. Qualitative data were based on the respondents’ free-text comments, cognitive interviews (
n
= 10) and field notes, and then analysed with deductive content analysis.
Results
A questionnaire was developed and operationalised based on the information given by key informants in phase one and then validated for its content by experts in phase two. In phase three Rasch analyses revealed problems with targeting, thresholds and two misfitting items. These problems were corroborated by data from the qualitative analyses, which also revealed some issues of wording and interpretation of items. When thresholds were resolved and two items removed, the questionnaire met the assumptions of the Rasch model.
Conclusions
Experts gave the questionnaire content high ratings and it met measurement requirements assumed by the Rasch model after revisions. Those problems on targeting that remain need to be addressed in future studies. Meanwhile, we regard the questionnaire as of sufficient quality to be useful in benchmarking PCC.
Journal Article
Development of Teaching Effectiveness Scale for University Teachers
by
Nasir Mehmood
,
Shumaila Shahzad
in
teaching effectiveness, content validity index, content validity ratio, confirmatory factor analysis
2021
Effectiveness can be assessed in terms of achievability of objectives. Teaching process at higher education level aims at students' cognitive, psychomotor and effective development so that university graduates could become effective members of society after completion of their studies. Purpose of education can never be achieved without teachers. It can safely be said that effectiveness of education system largely depends on effectiveness of its teachers. Accountability or teacher evaluation helps ensure teaching effectiveness. Therefore, this study aimed at construction of such a scale which could be used to assess university teachers' teaching effectiveness. For preparing Teaching Effectiveness Scale (TES), primarily, 65 statements were prepared as an item pool after literature review related to capabilities of efficient and effective teacher. Items were extracted from literature review (i.e., contemporary scales for teacher evaluation), informal interviews with ten university teachers and focus group discussions with three intact groups of graduates were held. Later on, 16 Subject Matter Experts (SMEs) judged the content validity. Content Validity Index (CVI) and Content Validity Ratio (CVR) were calculated to retain 43 content valid items. Finally, these 43 items were administered to 698 university students. Confirmatory Factor Analysis (CFA) was performed on LISREL 8.8. to ensure construct validity. Finally, there remained 32 items whose factor loadings were more than 0.40. Reliability Coefficient Value (RCV) was high (r= 0.87). In this way, TES comprised four sub scales i.e. (a) Classroom Management (CM), (b) content and pedagogical skills, (c) Facilitative Classroom Environment (FCE) and (d) Student Teacher Relationship (STR). The scale possesses high psychometric properties and is available for use.
Journal Article
Validity and reliability of the theory of planned behavior questionnaire on the balanced dietary behavior of adolescents in a post-disaster area
by
Riyadi, Hadi
,
Dewi, Nikmah Utami
,
Dwiriani, Cesilia Meti
in
Adolescents
,
content validity
,
content validity index
2022
Introduction: The assessment of mediator components of behavior change based on the Theory of Planned Behavior (TPB) can be carried out with a questionnaire instrument. Meanwhile, the questionnaire to assess the mediator of adolescents’ balanced dietary behavior in post-disaster areas has not yet been developed. Failure to recognize nutritional problems in this period can increase morbidity and mortality. Therefore, this present study attempts to provide the overview of the implementation of content and face validity as well as reliability of the TPB questionnaire on the balanced dietary behavior of adolescents in the post-disaster area by taking a study case in Palu City, Central Sulawesi, Indonesia.Methods: By involving nine expert panelists, the content validity was conducted qualitatively and quantitatively by calculating the Content Validity Index (CVI) and Kappa statistics scores. Face validity was conducted qualitatively by interviewing ten adolescents’. Meanwhile, Cronbach’s Coefficient Alpha was calculated to measure the reliability by interviewing 30 adolescents aged 15–17 years old living in the disaster site with their mothers during the massive disaster in 2018.Results: The results showed that the Item CVI and the kappa statistics scores were between 0.75 and 1 and 0.72 and 1, respectively. The final version of the questionnaire was resolved based on the panelists’ recommendation, the face validity’s findings, and the results of the questionnaire reliability assessment. There were 14 items of attitude, 12 items of subjective norms, 17 items of behavioral control, and eight items of intention components with acceptable questionnaire reliabilities.Conclusion: Overall, the TPB questionnaire on the balanced dietary behavior of adolescents has excellent validity and reliability to measure the mediator of balanced dietary behavior changes of adolescents.
Journal Article
Exploring hospital compliance with the primary nursing care model: validating an inventory using the Delphi method
by
Cristofori, Elena
,
Cocchieri, Antonello
,
Cavalletti, Manuela
in
Accountability
,
Administration
,
Checklist
2021
Background
The primary nursing care model is considered a personalized model of care delivery based on care continuity and on the relationship between the nurse and patient. Primary nursing checklists are not often mentioned in the literature; however, they represent a valid instrument to develop, implement, and evaluate primary nursing. The aim of this study was to create a structured checklist to explore hospital compliance in primary nursing.
Methods
The Delphi method was used to develop and validate a checklist. The preliminary version was created and sent to three experts for their opinions. Their comments were ultimately used in the first version, which included four components with 19 items regarding primary nursing characteristics. A two-round Delphi process was used to generate consensus items. The Delphi panel consisted of six experts working in primary nursing contexts and/or teaching or studying primary nursing. Data were collected using a structured questionnaire from July 2020 to January 2021. These experts were asked to rate each element for relevance using a 4-point Likert-type scale. Furthermore, the consensus among the panel of experts was set at ≥78%, with selected items being voted “quite relevant” and “highly relevant”. Content validity index (I-CVI) and modified kappa statistic were also calculated. Following expert evaluation, the first version of the checklist was modified, and the new version, constituting 17 items, was sent to the same experts.
Results
The first version of the checklist demonstrated a main relevance score of 3.34 (SD = 0.83; range = 1.3–4; mean I-CVI = 0.84; range: 0.83–1), but three items did not receive an adequate I-CVI score, that is, lower than 0.78. After the second round, the I-CVIs improved. The main score of relevance was 3.61 (SD: 0.35; range = 2.83–4; mean = I-CVI: 0.93). The S-CVI/UA was 0.58, and the S-CVI/Ave was 0.93.
Conclusion
Measuring primary nursing compliance should be implemented to provide continuous feedback to nurses. Moreover, utilizing valid checklists could permit comparing different results from others’ research. Future research should be conducted to compare the results from the checklist with nursing outcomes.
Journal Article
Determining Content Validity and Reporting a Content Validity Index for Simulation Scenarios
2015
This article aims to assist educators and researchers in determining content validity (CV) and reporting a content validity index (CVI) for simulation scenarios.
Educators and researchers involved in health care curricula may not recognize the need to validate and/or do not know how to validate a simulation scenario.
Two methods based on previous research that can be used to determine CV and report a CVI are discussed (Lynn and Lawshe).
Simulation scenarios need to be written so experts can fully understand the entirety of content and accurately assess whether items are relevant. Information for a CV template for experts is provided.
Determining item CV and reporting an overall CVI are important elements necessary to simulation scenarios, especially when the scenario is used in a high-stakes assessment or research.
Journal Article
Reliability and validity assessment of instrument to measure sustainability practices at shipping ports in India
by
Kishore, L.
,
Pai, Yogesh P.
,
Shanbhag, Parthesh
in
Cohen’s Kappa Index
,
Content Validity Index
,
Content validity ratio
2024
Sustainability has emerged as one of the most critical factors influencing the competitiveness of maritime shipping ports. This emergence has led to a surge in research publications on port sustainability-related topics. However, despite the increasing awareness and adoption of sustainability practices, documented literature on empirical studies with survey and interview data is very limited. Moreover, the existence of validated instruments to objectively assess sustainability through sustainability practices for shipping ports in India needs to be traced. This study contributes by validating an instrument to evaluate objectively sustainability practices in shipping ports by adopting a four-stage process, starting with item identification based on an extensive literature review, instrument evaluation by subject matter experts, assessing of the instrument with suitable content validation indices, and finally evaluating the validity and reliability of the hypothesized theoretical model. For content validation, Content Validity Index, Cohens Kappa coefficient, and Lawshe’s Content Validity Ratio were computed with the assessment by a subject matter expert panel comprising six members from the port industry as well as academicians cum researchers in the field of shipping ports. The content-validated instrument was administered to 200 samples comprising officer category port employees. The measurement model was evaluated and validated using the Confirmatory Factor Analysis to assess the extent to which the measured variables represent the theoretical construct of the study and ascertain the factor structure. The empirically validated instrument met the required guidelines of model fit, reliability, and construct validity measures and was found to be a confirmed model for measuring sustainability practices in shipping ports. Structural Equation Modeling methodology was adopted to explain the variance and the path relationship between the higher-order and lower-order constructs of sustainability. The results indicate that the economic dimensions are the major contributors to the overall sustainability of the port as they drive investments in environmental and social dimensions, leading to overall sustainable development. The study’s findings will be helpful for researchers, academicians, policymakers, and industry practitioners working towards sustainability practices that contribute to sustainable growth and development in the shipping industry.
Journal Article