Explore the vast range of titles available.

The mixed methods appraisal tool (MMAT) was developed for critically appraising different study designs. This study aimed to improve the content validity of three of the five categories of studies in the MMAT by identifying relevant methodological criteria for appraising the quality of qualitative, survey, and mixed methods studies. First, we performed a literature review to identify critical appraisal tools and extract methodological criteria. Second, we conducted a two-round modified e-Delphi technique. We asked three method-specific panels of experts to rate the relevance of each criterion on a five-point Likert scale. A total of 383 criteria were extracted from 18 critical appraisal tools and a literature review on the quality of mixed methods studies, and 60 were retained. In the first and second rounds of the e-Delphi, 73 and 56 experts participated, respectively. Consensus was reached for six qualitative criteria, eight survey criteria, and seven mixed methods criteria. These results led to modifications of eight of the 11 MMAT (version 2011) criteria. Specifically, we reformulated two criteria, replaced four, and removed two. Moreover, we added six new criteria. Results of this study led to improve the content validity of this tool, revise it, and propose a new version (MMAT version 2018).

Background Community-Based Participatory Research (CBPR) is an approach in which researchers and community stakeholders form equitable partnerships to tackle issues related to community health improvement and knowledge production. Our 2012 realist review of CBPR outcomes reported long-term effects that were touched upon but not fully explained in the retained literature. To further explore such effects, interviews were conducted with academic and community partners of partnerships retained in the review. Realist methodology was used to increase the understanding of what supports partnership synergy in successful long-term CBPR partnerships, and to further document how equitable partnerships can result in numerous benefits including the sustainability of relationships, research and solutions. Methods Building on our previous realist review of CBPR, we contacted the authors of longitudinal studies of academic-community partnerships retained in the review. Twenty-four participants (community members and researchers) from 11 partnerships were interviewed. Realist logic of analysis was used, involving middle-range theory, context-mechanism-outcome configuration (CMOcs) and the concept of the ‘ripple effect’. Results The analysis supports the central importance of developing and strengthening partnership synergy through trust. The ripple effect concept in conjunction with CMOcs showed that a sense of trust amongst CBPR members was a prominent mechanism leading to partnership sustainability. This in turn resulted in population-level outcomes including: (a) sustaining collaborative efforts toward health improvement; (b) generating spin-off projects; and (c) achieving systemic transformations. Conclusion These results add to other studies on improving the science of CBPR in partnerships with a high level of power-sharing and co-governance. Our results suggest sustaining CBPR and achieving unanticipated benefits likely depend on trust-related mechanisms and a continuing commitment to power-sharing. These findings have implications for building successful CBPR partnerships to address challenging public health problems and the complex assessment of outcomes.

Background This realist review was conducted to understand how stigma is reduced in relation to HIV test uptake in low- and middle-income countries (LMICs). Methods A systematic search of eight databases resulted in 34 articles considered for synthesis. Data synthesis was guided by a preliminary programme theory and included coding the meaning units to develop themes or intervention pathways that corresponded to context-mechanism-outcome configurations. Results We found that the interventions produced an effect through two pathways: (a) knowledge leads to changes in stigmatizing attitudes and increases in HIV test uptake and (b) knowledge and attitudes lead to changes in stigmatizing behaviours and lead to HIV test uptake. We also found one competing pathway that illustrated the direct impact of knowledge on HIV test uptake without changing stigmatizing attitudes and behaviour. The identified pathways were found to be influenced by some structural factors (e.g., anti-homosexuality laws, country-specific HIV testing programmes and policies), community factors (e.g., traditional beliefs and practices, sexual taboos and prevalence of intimate partner violence) and target-population characteristics (e.g., age, income and urban-rural residence). Conclusions The pathways and underlying mechanisms support the adaptation of intervention strategies in terms of social context and the target population in LMICs.

A systematic review of qualitative studies was undertaken to understand the barriers to physical activity experienced by adolescents who were overweight or obese. From a search of electronic databases and ‘grey’ literature, published between 1950 and 2009, 15 studies met the inclusion criteria. Bronfenbrenner’s model of human development provided an ecological lens for identifying and synthesising barriers to physical activity. Two reviewers appraised study quality. Miles and Huberman’s cross-case analysis was integrated with thematic networking to synthesize the individual, interpersonal and environmental level barriers for boys and girls of different ethnicities and socioeconomic status, across school settings and generalised context. Thirty-five barriers were identified, 13 of which occurred in physical activity situations in the school setting, 18 were not linked to a specific setting, and the remainder were common across both contexts. The fact that these barriers emerged from studies that focused on topics such as victimisation and mental health is particularly poignant and reflects the potentially pervasive influence of adolescent’s excessive weight not only in relation to physical activity situations but other aspects of their lives. Furthermore, socioeconomic status and ethnicity was poorly considered, with only one study linking these participant characteristics to quotations and discussing the potential implications. At present, there are few qualitative studies with sufficiently thick description or interpretive validity that provide insight into this vulnerable group of adolescents, and give them a voice to influence policy and practice.

Background Research funders in Canada and abroad have made substantial investments in supporting collaborative research approaches to generating and translating knowledge as it is believed to increase knowledge use. Canadian health research funders have advocated for the use of integrated knowledge translation (IKT) in health research, however, there is limited research around how IKT compares to other collaborative research approaches. Our objective was to better understand how IKT compares with engaged scholarship, Mode 2 research, co-production and participatory research by identifying the differences and similarities among them in order to provide conceptual clarity and reduce researcher and knowledge user confusion about these common approaches. Methods We employed a qualitative descriptive method using interview data to better understand experts’ perspectives and experiences on collaborative research approaches. Participants’ responses were analysed through thematic analysis to elicit core themes. The analysis was centred around the concept of IKT, as it is the most recent approach; IKT was then compared and contrasted with engaged scholarship, Mode 2 research, co-production and participatory research. As this was an iterative process, data triangulation and member-checking were conducted with participants to ensure accuracy of the emergent themes and analysis process. Results Differences were noted in the orientation (i.e. original purpose), historical roots (i.e. disciplinary origin) and partnership/engagement (i.e. role of partners etc.). Similarities among the approaches included (1) true partnerships rather than simple engagement, (2) focus on essential components and processes rather than labels, (3) collaborative research orientations rather than research methods, (4) core values and principles, and (5) extensive time and financial investment. Core values and principles among the approaches included co-creation, reciprocity, trust, fostering relationships, respect, co-learning, active participation, and shared decision-making in the generation and application of knowledge. All approaches require extensive time and financial investment to develop and maintain true partnerships. Conclusions This qualitative study is the first to systematically synthesise experts’ perspectives and experiences in a comparison of collaborative research approaches. This work contributes to developing a shared understanding of collaborative research approaches to facilitate conceptual clarity in use, reporting, indexing and communication among researchers, trainees, knowledge users and stakeholders to advance IKT and implementation science.

Context: Participatory research (PR) is the co-construction of research through partnerships between researchers and people affected by and/or responsible for action on the issues under study. Evaluating the benefits of PR is challenging for a number of reasons: the research topics, methods, and study designs are heterogeneous; the extent of collaborative involvement may vary over the duration of a project and from one project to the next; and partnership activities may generate a complex array of both short- and long-term outcomes. Methods: Our review team consisted of a collaboration among researchers and decision makers in public health, research funding, ethics review, and community-engaged scholarship. We identified, selected, and appraised a large-variety sample of primary studies describing PR partnerships, and in each stage, two team members independently reviewed and coded the literature. We used key realist review concepts (middle-range theory, demi-regularity, and context-mechanism-outcome configurations [CMO]) to analyze and synthesize the data, using the PR partnership as the main unit of analysis. Findings: From 7,167 abstracts and 591 full-text papers, we distilled for synthesis a final sample of twenty-three PR partnerships described in 276 publications. The link between process and outcome in these partnerships was best explained using the middle-range theory of partnership synergy, which demonstrates how PR can (1) ensure culturally and logistically appropriate research, (2) enhance recruitment capacity, (3) generate professional capacity and competence in stakeholder groups, (4) result in productive conflicts followed by useful negotiation, (5) increase the quality of outputs and outcomes over time, (6) increase the sustainability of project goals beyond funded time frames and during gaps in external funding, and (7) create system changes and new unanticipated projects and activities. Negative examples illustrated why these outcomes were not a guaranteed product of PR partnerships but were contingent on key aspects of context. Conclusions: We used a realist approach to embrace the heterogeneity and complexity of the PR literature. This theory-driven synthesis identified mechanisms by which PR may add value to the research process. Using the middle-range theory of partnership synergy, our review confirmed findings from previous PR reviews, documented and explained some negative outcomes, and generated new insights into the benefits of PR regarding conflicts and negotiation between stakeholders, program sustainability and advancement, unanticipated project activity, and the generation of systemic change.

IntroductionIndigenist evaluation is emergent in Australia; the premise of which is that evaluations are undertaken for Indigenous, by Indigenous and with Indigenous people. This provides opportunities to develop new models and approaches. Exploring a collective capability approach could be one way to inform an Indigenist evaluation methodology. Collective capability suggests that a base of skills and knowledges exist, and when these assets come together, empowerment and agency emerge. However, collective capability requires defining as it is not common terminology in population health or evaluation. Our aim is to define the concept of collective capability in Indigenist evaluation in Australia from an Australian Indigenous standpoint.Methods and analysisA modified Rodgers’ evolutionary concept analysis will be used to define collective capability in an Australian Indigenous evaluation context, and to systematically review and synthesise the literature. Approximately 20 qualitative interviews with Aboriginal and Torres Strait Islander knowledge holders will clarify the meaning of collective capability and inform appropriate search strategy terms with a consensus process then used to code the literature. We will then systematically collate, synthesise and analyse the literature to identify exemplars or models of collective capability from the literature.Ethics and disseminationThe protocol has approval from the Australian Institute of Aboriginal and Torres Strait Islander Studies Ethics Committee, approval no. EO239-20210114. All knowledge holders will provide written consent to participate in the research. This protocol provides a process to developing a concept, and will form the basis of a new framework and assessment tool for Indigenist evaluation practice. The concept analysis will establish definitions, characteristics and attributes of collective capability. Findings will be disseminated through a peer-reviewed journal, conference presentations, the project advisory group, the Thiitu Tharrmay reference group and Aboriginal and Torres Strait Islander community partners supporting the project.

Background In Australia, billions of dollars are spent on Indigenous programs, services, and initiatives annually; however, more evidence is needed regarding which modes of commissioning program evaluations best benefit Indigenous communities. The Australian Productivity Commission called for ‘more and better’ evaluations of Indigenous programs, and commissioning processes that engage Indigenous communities, organisations, and leaders. So, too, have Indigenous representative organisations, Indigenous services, and stakeholders. To date, few studies have sought to characterise the commissioning practices of government and non-government organisations surrounding Indigenous health and wellbeing programs. Fewer still have investigated the role of Indigenous engagement and leadership before, during and after the commissioning process. Methods Using Indigenous Standpoint Theory and a qualitative approach, this study illuminates the perceptions of Australian Indigenous and non-Indigenous commissioners, evaluators, and providers on the commissioning of evaluated Indigenous health and wellbeing programs. Results Building on a published scoping review by undertaking 23 qualitative interviews with 35 Australian-based participants about commissioning practices, this study verifies and canvases the strengths of individual commissioning models, and the interplay between power, cultural safety, and reciprocity in the commissioning space. The paper also considers the relationship between these three factors along a continuum of practice and posits a sliding scale across the five commissioning models. Conclusions To improve the quality of evaluations further attention needs to be paid to the commissioner’s cultural capability. Additionally, Commissioners need to develop their understanding of the relationship between Commissioner and Indigenous people’s power and the utility of evaluations.

Background In recent decades, financial investment has been made in health-related programs and services to overcome inequities and improve Indigenous people’s wellbeing in Australia and New Zealand. Despite policies aiming to ‘close the gap’, limited evaluation evidence has informed evidence-based policy and practice. Indigenous leaders have called for evaluation stakeholders to align their practices with Indigenous approaches. Methods This study aimed to strengthen culturally safe evaluation practice in Indigenous settings by engaging evaluation stakeholders, in both countries, in a participatory concept mapping study. Concept maps for each country were generated from multi-dimensional scaling and hierarchical cluster analysis. Results The 12-cluster Australia map identifies four cluster regions: An Evaluation Approach that Honours Community; Respect and Reciprocity; Core Heart of the Evaluation; and Cultural Integrity of the Evaluation. The 11-cluster New Zealand map identifies four cluster regions: Authentic Evaluation Practice; Building Māori Evaluation Expertise; Integrity in Māori Evaluation; and Putting Community First. Both maps highlight the importance of cultural integrity in evaluation. Differences include the distinctiveness of the ‘Respecting Language Protocols’ concept in the Australia map in contrast to language being embedded within the cluster of ‘Knowing Yourself as an Evaluator in a Māori Evaluation Context’ in the New Zealand map. Participant ratings highlight the importance of all clusters with some relatively more difficult to achieve, in practice. Notably, the ‘Funding Responsive to Community Needs and Priorities’ and ‘Translating Evaluation Findings to Benefit Community’ clusters were rated the least achievable, in Australia. The ‘Conduct of the Evaluation’ and the ‘Prioritising Māori Interests’ clusters were rated as least achievable in New Zealand. In both countries, clusters of strategies related to commissioning were deemed least achievable. Conclusions The results suggest that the commissioning of evaluation is crucial as it sets the stage for whether evaluations: reflect Indigenous interests, are planned in ways that align with Indigenous ways of working and are translated to benefit Indigenous communities Identified strategies align with health promotion principles and relational accountability values of Indigenous approaches to research. These findings may be relevant to the commissioning and conduct of Indigenous health program evaluations in developed nations.

Background This report presents the initial results of the first Epidemiological Catchment Area Study in mental health in Canada. Five neighbourhoods in the South-West sector of Montreal, with a population of 258,000, were under study. The objectives of the research program were: 1) to assess the prevalence and incidence of psychological distress, mental disorders, substance abuse, parasuicide, risky behaviour and quality of life; 2) to examine the links and interactions between individual determinants, neighbourhood ecology and mental health in each neighbourhood; 3) to identify the conditions facilitating the integration of individuals with mental health problems; 4) to analyse the impact of the social, economic and physical aspects of the neighbourhoods using a geographic information system. 5) to verify the adequacy of mental health services. Method A longitudinal study in the form of a community survey was used, complemented by focused qualitative sub-studies. The longitudinal study included a randomly selected sample of 2,433 individuals between the ages of 15 and 65 in the first wave of data collection, and three other waves are projected. An overview of the methods is presented. Results The prevalence of psychological distress, mental disorders and use of mental health services and their correlates are described for the first wave of data collection. Conclusion Several vulnerable groups and risk factors related to socio-demographic variables have been identified such as: gender, age, marital status, income, immigration and language. These results can be used to improve treatment services, prevention of mental disorders, and mental health promotion.