Explore the vast range of titles available.

Purpose Service user involvement in instrument development is increasingly recognised as important, but is often not done and seldom reported. This has adverse implications for the content validity of a measure. The aim of this paper is to identify the types of items that service users felt were important to be included or excluded from a new Recovering Quality of Life measure for people with mental health difficulties. Methods Potential items were presented to service users in face-to-face structured individual interviews and focus groups. The items were primarily taken or adapted from current measures and covered themes identified from earlier qualitative work as being important to quality of life. Content and thematic analysis was undertaken to identify the types of items which were either important or unacceptable to service users. Results We identified five key themes of the types of items that service users found acceptable or unacceptable; the items should be relevant and meaningful, unambiguous, easy to answer particularly when distressed, do not cause further upset, and be non-judgemental. Importantly, this was from the perspective of the service user. Conclusions This research has underlined the importance of service users' views on the acceptability and validity of items for use in developing a new measure. Whether or not service users favoured an item was associated with their ability or intention to respond accurately and honestly to the item which will impact on the validity and sensitivity of the measure.

Background Cognitive Behaviour Therapy (CBT) is the front-line psychological intervention for step 3 within UK psychological therapy services. Counselling is recommended only when other interventions have failed and its effectiveness has been questioned. Method A secondary data analysis was conducted of data collected from 33,243 patients across 103 Improving Access to Psychological Therapies (IAPT) services as part of the second round of the National Audit of Psychological Therapies (NAPT). Initial analysis considered levels of pre-post therapy effect sizes (ESs) and reliable improvement (RI) and reliable and clinically significant improvement (RCSI). Multilevel modelling was used to model predictors of outcome, namely patient pre-post change on PHQ-9 scores at last therapy session. Results Counselling received more referrals from patients experiencing moderate to severe depression than CBT. For patients scoring above the clinical cut-off on the PHQ-9 at intake, the pre-post ES (95% CI) for CBT was 1.59 (1.58, 1.62) with 46.6% making RCSI criteria and for counselling the pre-post ES was 1.55 (1.52, 1.59) with 44.3% of patients meeting RCSI criteria. Multilevel modelling revealed a significant site effect of 1.8%, while therapy type was not a predictor of outcome. A significant interaction was found between the number of sessions attended and therapy type, with patients attending fewer sessions on average for counselling [M = 7.5 (5.54) sessions and a median (IQR) of 6 (3–10)] than CBT [M = 8.9 (6.34) sessions and a median (IQR) of 7 (4–12)]. Only where patients had 18 or 20 sessions was CBT significantly more effective than counselling, with recovery rates (95% CIs) of 62.2% (57.1, 66.9) and 62.4% (56.5, 68.0) respectively, compared with 44.4% (32.7, 56.6) and 42.6% (30.0, 55.9) for counselling. Counselling was significantly more effective at two sessions with a recovery rate of 34.9% (31.9, 37.9) compared with 22.2% (20.5, 24.0) for CBT. Conclusions Outcomes for counselling and CBT in the treatment of depression were comparable. Research efforts should focus on factors other than therapy type that may influence outcomes, namely the inherent variability between services, and adopt multilevel modelling as the given analytic approach in order to capture the naturally nested nature of the implementation and delivery of psychological therapies. It is of concern that half of all patients, regardless of type of intervention, did not show reliable improvement.

Depression is one of the most prevalent mental health conditions in the world. However, the heterogeneity of depression has presented obstacles for research concerning disease mechanisms, treatment indication, and personalization. The current study used network analysis to analyze and compare profiles of depressive symptoms present in community samples, considering the relationship between symptoms. Cross-sectional measures of depression using the Patient Health Questionnaire - 9 items (PHQ-9) were collected from community samples using data from participants scoring above a clinical threshold of ≥10 points (N = 2,023; 73.9% female; mean age 49.87, SD = 17.40). Data analysis followed three steps. First, a profiling algorithm was implemented to identify all possible symptom profiles by dichotomizing each PHQ-9 item. Second, the most prevalent symptom profiles were identified in the sample. Third, network analysis for the most prevalent symptom profiles was carried out to identify the centrality and covariance of symptoms. Of 382 theoretically possible depression profiles, only 167 were present in the sample. Furthermore, 55.6% of the symptom profiles present in the sample were represented by only eight profiles. Network analysis showed that the network and symptoms' relationship varied across the profiles. Findings indicate that the vast number of theoretical possible ways to meet the criteria for major depressive disorder (MDD) is significantly reduced in empirical samples and that the most common profiles of symptoms have different networks and connectivity patterns. Scientific and clinical consequences of these findings are discussed in the context of the limitations of this study.

Background A previously published article in this journal reported the service effects from 103 services within the UK Improving Access to Psychological Therapies (IAPT) initiative and the comparative effectiveness of CBT and Counselling provision. All patients received High-intensity CBT or High-intensity Counselling, but some also received Low-intensity CBT before being stepped-up to High intensity treatments. The report did not distinguish between patients who received low-intensity CBT before being stepped-up. This article clarifies the basis for collapsing low- and high-intensity interventions by analysing the four treatment conditions separately. Method Data from 33,243 patients included in the second round of the National Audit of Psychological Therapies (NAPT) were re-analysed as four separate conditions: High-intensity CBT only ( n  = 5975); High-intensity Counselling only ( n  = 3003); Low-intensity CBT plus High-intensity CBT ( n  = 17,620); and Low-intensity CBT plus High-intensity Counselling ( n  = 6645). Analyses considered levels of pre-post therapy effect sizes (ESs), reliable improvement (RI) and reliable and clinically significant improvement (RCSI). Multilevel modelling was used to model predictors of outcome, namely patient pre-post change on PHQ-9 scores at last therapy session. Results Significant differences obtained on various outcome indices but were so small they carried no clinical significance. Including the four treatment groups in a multilevel model comprising patient intake severity, patient ethnicity and number of sessions attended showed no significant differences between the four treatment groups. Comparisons between the two high-intensity interventions only ( N  = 8978) indicated Counselling showed more improvement than CBT by 0.3 of a point on PHQ-9 for the mean number of sessions attended. However, this result was moderated by the number of sessions and for 12 or more sessions, the advantage went to CBT. Conclusions This re-analysis showed no evidence of clinically meaningful differences between the four treatment conditions using standard indices of patient outcomes. However, a differential advantage to high-intensity Counselling for fewer than average sessions attended and high-intensity CBT for more than average sessions attended has important service implications. The finding of equivalent outcomes between high-intensity CBT and Counselling for more severe patients also has important policy implications. Empirically-informed procedures (e.g., predictive modelling) for assigning patients to interventions need to be considered to improve patient outcomes.

Generic preference-based measures (EuroQoL-5D (EQ-5D) and SF-6D) are used in the economic evaluation of mental health interventions. However, there are inconsistent findings regarding their psychometric properties. To investigate the psychometric properties of the EQ-5D and SF-6D in different mental health conditions, using seven existing data-sets. The construct validity and responsiveness of the measures were assessed in comparison with condition-specific indicators. Evidence for construct validity and responsiveness in common mental health and personality disorders was found (correlations 0.22-0.64; effect sizes 0.37-1.24; standardised response means 0.45-1.31). There was some evidence for validity in schizophrenia (correlations 0.05-0.43), but responsiveness was unclear. EQ-5D and SF-6D can be used in the economic evaluation of interventions for common mental health problems with some confidence. In schizophrenia, a preference-based measure focused on the impact of mental health should be considered.

This commentary examines publicly available information on 2017–2018 outcomes in the UK government’s Improving Access to Psychological Therapies (IAPT) programme, a National Health Service (NHS) primary care mental health programme in England. In that year there were 1.4 million referrals into IAPT and over 500,000 people completed a course of treatment. The IAPT database collects routine session-by-session outcome monitoring data for this population, including outcomes for depression and anxiety in a stepped care model which includes a range of psychological therapies, among them Cognitive Behavioural Therapy (CBT) and Person-centred Experiential Therapy, known in the IAPT programme as Counselling for Depression (CfD). In 2017–18, 32% of all referrals were for anxiety and stress disorders, 26% for depression, and 35% were unspecified. The definition of treatment completion is receipt of 2 sessions or more and on this basis 60% of all referrals in 2017–18 did not complete treatment, predominantly because they failed to attend the initial appointment, or ended after only one session. Four years of data on outcomes for CBT and CfD suggests these therapies are broadly comparable in terms of both recovery rate and average number of sessions, though the number of referrals to each therapy varied widely. Data on treatment choice and satisfaction was favourable but there were issues with low return rates and invalid data. Information on outcomes for ethnicity, sexual orientation, disability and religion, as well as a measure of local economic deprivation, indicate lower outcomes for a number of patient groups. Data on employment status outcomes suggest little overall change, including for the category of those on benefits payments. The data published alongside the annual IAPT reports mean there is an increasing amount of information in the public domain about IAPT performance, but it is time consuming to extract and evaluate. This report highlights a number of points of concern which suggest the need for improvement on multiple axes. We suggest that improved researcher access to the huge IAPT dataset can allow for more detailed evaluations of IAPT that can inform policy/decision-making to improve outcomes for clients.

Background There is debate about how best to increase access to psychological therapy and deliver mental healthcare effectively and efficiently at a national level. One trend is the increased use of the telephone to deliver therapy. However, there is the potential to disadvantage certain patient groups and/or impact on uptake of help. This study aims to answer three questions: (i) Which factors are associated with being offered an assessment by telephone? (ii) Which factors are associated with attendance at assessment? and (iii) What is the impact of an assessment by telephone on subsequent treatment appointment? Methods Routine outcome data was provided by seven UK Improving Access to Psychological Therapy services. The analysis sample comprised 49,923 patients who referred to 615 general practices in 2017. Multilevel modelling, including service and GP practice as random factors, was used to answer the three research questions. Results The offer of an initial assessment by telephone was strongly associated with local service configuration. Patient self-referral, a shorter wait, greater age and lower deprivation were associated with attendance at assessment and subsequent treatment session. Telephone mode assessment had no impact on the uptake of the assessment but may influence the uptake of further treatment if this was also by telephone. The practitioner carrying out the assessment had a significant effect on subsequent treatment uptake. Conclusion Offering telephone assessments does not have a negative impact on uptake of assessment and services may benefit by facilitating and integrating telephone assessments into their systems. The COVID-19 pandemic has accelerated the use of telephone and other remote means of delivery, and results from this study can inform services to consider how best to re-configure post-pandemic.

BackgroundHigher education institutions face challenges in providing effective mental health services for diverse student needs. In the UK, discrepancies between healthcare and education service provision create barriers for students and require stronger alignment through partnerships.ObjectivesThis study aimed to identify risks, barriers and enablers to developing service partnerships between universities and the National Health Service (NHS) in England. It investigated existing partnerships and strategies that facilitate effective collaborative working.Design and settingA case study approach was employed, including coproduction and stakeholder involvement with staff and service users, to gather information from eight English universities developing regional student mental health hubs. This research received appropriate ethical approval.ParticipantsIn total, 27 professional staff from counselling, mental health, disability and well-being services participated and represented their respective services.Outcome measuresDescriptive information was collected from service websites, handbooks, reports and 11 focus groups using a standardised data collection template. Inter-rater reliability was used to determine the agreement between coders and finalise focus group themes. EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Standards for Reporting Qualitative Research were adopted.ResultsUsing inductive thematic analysis, five themes were identified for developing partnerships: building blocks, facing barriers, achieving positive outcomes, shaping student services and developing coordinated care. Fleiss’ kappa showed strong agreement between raters regarding the partnership factors (k=0.84 (95% CI 0.81 to 0.87), p<0.0005). Effective communication, shared understanding and trust were essential. Barriers included restrictions to information sharing and incompatible data infrastructures between services.ConclusionsStronger partnerships between universities and NHS are needed to meet increasing student mental health demands. Addressing barriers and implementing strategies to develop partnerships can enhance student services.Preregistration https://osf.io/u54qk/

Purpose This paper presents two studies exploring the latent structure of item sets used in the development of the Recovering Quality of Life mental health outcome measures: ReQoL-10 and ReQoL-20. Method In study 1, 2262 participants completed an initial set of 61 items. In study 2, 4266 participants completed a reduced set of 40 items. Study 2 evaluated two formats of the questionnaires: one version where the items were intermingled and one where the positively worded and negatively worded items were presented as two separate blocks. Exploratory and confirmatory factor analyses were conducted on both datasets where models were specified using ordinal treatment of the item responses. Dimensionality based on the conceptual framework and methods effects reflecting the mixture of positively worded and negatively worded items were explored. Factor invariance was tested across the intermingled and block formats. Results In both studies, a bi-factor model (study 1: RMSEA = 0.061; CFI = 0.954; study 2: RMSEA = 0.066; CFI = 0.971) with one general factor and two local factors (positively worded questions and negatively worded questions) was preferred. The loadings on the general factor were higher than on the two local factors suggesting that the ReQoL scale scores can be understood in terms of a general factor. Insignificant differences were found between the intermingled and block formats. Conclusions The analyses confirmed that the ReQoL item sets are sufficiently unidimensional to proceed to item response theory analysis. The model was robust across different ordering of positive and negative items.

Background To provide a model for Public involvement (PI) in instrument development and other research based on lessons learnt in the co-production of a recently developed mental health patient reported outcome measure called Recovering Quality of Life (ReQoL). While service users contributed to the project as research participants, this paper focuses on the role of expert service users as research partners, hence referred to as expert service users or PI. Methods At every stage of the development, service users influenced the design, content and face validity of the measure, collaborating with other researchers, clinicians and stakeholders who were central to this research. Expert service users were integral to the Scientific Group which was the main decision-making body, and also provided advice through the Expert Service User Group . Results During the theme and item generation phase (stage 1) expert service users affirmed the appropriateness of the seven domains of the Patient Reported Outcome Measure (activity, hope, belonging and relationships, self-perception, wellbeing, autonomy, and physical health). Expert service users added an extra 58 items to the pool of 180 items and commented on the results from the face and content validity testing (stage 2) of a refined pool of 88. In the item reduction and scale generation phase (stage 3), expert service users contributed to discussions concerning the ordering and clustering of the themes and items and finalised the measures. Expert service users were also involved in the implementation and dissemination of ReQoL (stage 4). Expert service users contributed to the interpretation of findings, provided inputs at every stage of the project and were key decision-makers. The challenges include additional work to make the technical materials accessible, extra time to the project timescales, including time to achieve consensus from different opinions, sometimes strongly held, and extra costs. Conclusion This study demonstrates a successful example of how PI can be embedded in research, namely in instrument development. The rewards of doing so cannot be emphasised enough but there are challenges, albeit surmountable ones. Researchers should anticipate and address those challenges during the planning stage of the project.