Hostname: page-component-6bb9c88b65-6vlrh Total loading time: 0 Render date: 2025-07-25T07:15:46.576Z Has data issue: false hasContentIssue false
  • English
  • Français

Assessing outcomes and satisfaction in a sustained national primary care youth mental health programme: a brief multi-methods report

Published online by Cambridge University Press:  23 July 2025

Jeff Moore Open the ORCID record for Jeff Moore [Opens in a new window] ,
Anna Blix Open the ORCID record for Anna Blix [Opens in a new window] ,
Jim Lyng  and
Joseph Duffy
Jeff Moore*
Affiliation:
Jigsaw – The National Centre for Youth Mental Health, Dublin, Ireland
Anna Blix
Affiliation:
Jigsaw – The National Centre for Youth Mental Health, Dublin, Ireland
Jim Lyng
Affiliation:
Jigsaw – The National Centre for Youth Mental Health, Dublin, Ireland
Joseph Duffy
Affiliation:
Jigsaw – The National Centre for Youth Mental Health, Dublin, Ireland
*
Corresponding author: Jeff Moore; Email: jeff.moore@jigsaw.ie
Get access Rights & Permissions [Opens in a new window]

Abstract

Objectives:

Most mental health difficulties have their onset in early adolescence. Increasingly, community based primary care is recognised as a critical pathway to early intervention. Despite encouraging initial evaluations, there is an ongoing need for evidence of the outcomes of primary care youth mental health programmes delivered at scale. This brief report examines reliable improvements in psychological distress and user satisfaction data from a national primary care youth mental health programme in the sustainment phase of implementation.

Methods:

This report takes a multi-methods approach to routine evaluation data. Young people (aged 12–25; N = 8,721) completed Clinical Outcomes Routine Evaluation (CORE-10 and YP-CORE) pre- and post-treatment. Clinical cut offs and a reliable change index (based on established guidelines) were used to report rates of reliable improvement. The analysis examined differences in outcomes based on age, gender, and clinical need. Satisfaction was measured using the youth service satisfaction survey (N = 4,267). Natural language processing techniques were employed to objectively analyse qualitative user feedback.

Results:

Most young people presented in the clinical range, with almost two-thirds reporting moderate to severe distress. Statistically significant reductions in distress were observed with large effect sizes (d = 1.08–1.28). Young people in the clinical range demonstrated significantly higher rates of reliable improvement compared to those who presented in the healthy range. In line with similar evaluations, young adults were more likely to achieve improvement and report higher satisfaction. Sentiment analysis of satisfaction data indicated a strong skew towards positive sentiment, with trust, anticipation and joy being predominant. Qualitative feedback pointed to waiting times as an improvement area.

Conclusion:

The absence of a control group limits our ability to evaluate the effectiveness of the service interventions. Nonetheless after a decade of service delivery, these results indicate that large scale national youth mental health programmes can achieve satisfaction and clinical outcomes in line with international standards. Further research is needed on the predictors of reliable change, differences across demographic groups and approaches to improving waiting times in primary care.

Keywords

Primary carereliable improvementyouth mental health

Information

Type
Short Report
Information
Irish Journal of Psychological Medicine , First View , pp. 1 - 5
Copyright
© The Author(s), 2025. Published by Cambridge University Press on behalf of College of Psychiatrists of Ireland

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

References

Barkham, M, Bewick, B, Mullin, T, Gilbody, S, Connell, J, Cahill, J, Mellor-Clark, J, Richards, D, Unsworth, G, Evans, C (2013). The CORE-10: a short measure of psychological distress for routine use in the psychological therapies. Counselling and Psychotherapy Research 13, 3–13.10.1080/14733145.2012.729069CrossRefGoogle Scholar
Blackshaw, E (2017). When life gets in the way: A systematic review of life events, socioeconomic deprivation, and their impact on counselling and psychotherapy with children and adolescents (Doctoral dissertation). University of Roehampton.Google Scholar
Brand, C, Ward, F, MacDonagh, N, Cunningham, S, Timulak, L (2021). A national evaluation of the Irish public health counselling in primary care service– examination of initial effectiveness data. BMC Psychiatry 21, 227. doi:10.1186/s12888-021-03226-x.CrossRefGoogle ScholarPubMed
Connell, J, Barkham, M (2007). CORE-10 User Manual, Version 1.1. CORES system Trust & CORE Information Management Systems Ltd Google Scholar
Department of Health (2020). Sharing the vision: A mental health policy for everyone. Government of Ireland: Dublin.Google Scholar
Doyle, E, Carey, E, Rossouw, J, Booth, A, Rickwood, D, O’Reilly A (2024). Examining the psychometric properties of the headspace Youth (mental health) Service Satisfaction Scale in a mental health service in Ireland. Child Care Health and Development, 50.Google Scholar
Duncan, C, Rayment, B, Kenrick, J, Cooper, M (2020). Counselling for young people and young adults in the voluntary and community sector: An overview of the demographic profile of clients and outcomes. Psychology and Psychotherapy: Theory, Research and Practice, 93(1), 36–53. Doi: 10.1111/papt.12206.10.1111/papt.12206CrossRefGoogle Scholar
Edbrooke-Childs, J, Wolpert, M, Zamperoni, V, Napoleone, E, Bear, H (2018). Evaluation of reliable improvement rates in depression and anxiety at the end of treatment in adolescents. BJPsych Open 4, 250–255. doi:10.1192/bjo.2018.31.CrossRefGoogle ScholarPubMed
Gyani, A, Shafran, R, Layard, R, Clark, DM (2013). Enhancing recovery rates: lessons from year one of IAPT. Behaviour Research and Therapy 51, 597–606. doi:10.1016/j.brat.2013.06.004.CrossRefGoogle ScholarPubMed
Headspace National Youth Mental Health Foundation (2022). Young people snapshot report. Retrieved from https://headspace.org.au/assets/HSTC184-_-Young-People-Snapshot-Report-_-FA.pdf Google Scholar
Kessler, RC, Chiu, WT, Demler, O, Walters, EE (2005). Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Archives of General Psychiatry 62, 617–627.10.1001/archpsyc.62.6.617CrossRefGoogle ScholarPubMed
NHS Digital (2022). Improving Access to Psychological Therapies (IAPT) Key Performance Indicator (KPI) Report. NHS Digital. https://digital.nhs.uk/data-and-information/publications/statistical/improving-access-to-psychological-therapies-report Google Scholar
Nielsen, FÅ (2011). A new ANEW: evaluation of a word list for sentiment analysis in microblogs. In Proceedings of the ESWC Workshop on ’Making Sense of Microposts’. CEUR Workshop Proceedings, vol. 718. http://ceur-ws.org/Vol-718/paper_16.pdf Google Scholar
O’Keeffe, L, O’Reilly, A, O’Brien, G, Buckley, R, Illback, R (2015). Description and outcome evaluation of Jigsaw: an emergent Irish mental health early intervention programme for young people. Irish Journal of Psychological Medicine, 32(1), 71–77. doi: 10.1017/ipm.2014.86.CrossRefGoogle ScholarPubMed
O’Reilly, A, O’Brien, G, Moore, J, Duffy, J, Longmore, P, Cullinan, S, Mc Grory, S (2022). Evolution of Jigsaw – a National Youth Mental Health Service. Early Intervention in Psychiatry 16, 561–567.10.1111/eip.13218CrossRefGoogle ScholarPubMed
O’Reilly, A, Peiper, N, O’Keeffe, L, Illback, R, Clayton, R (2016). Performance of the CORE-10 and YP-CORE measures in a sample of youth engaging with a community mental health service. International Journal of Methods in Psychiatric Research 25, 324–332.10.1002/mpr.1500CrossRefGoogle Scholar
Rickwood, D, Wallace, A, Kennedy, V, O’Sullivan, S, Telford, N, Leicester, S (2019). Young people’s satisfaction with the online mental health service eheadspace: Development and implementation of a service satisfaction measure. JMIR Mental Health 6(4), e12169. doi:10.2196/12169D.CrossRefGoogle ScholarPubMed
Settipani, CA, Cleverley, K, Hawke, LD, Rice, M, Henderson, JL (2017). Essential components of integrated care for youth with mental health and addiction needs: protocol for a scoping review. BMJ Open 7, e015454. doi:10.1136/bmjopen-2016-015454.CrossRefGoogle ScholarPubMed
Tuaf, H, Orkibi, H (2023). Community-based programs for youth with mental health conditions: a scoping review and practical implications. Frontiers in Public Health 11, 1241469.10.3389/fpubh.2023.1241469CrossRefGoogle ScholarPubMed
Twigg, E, Cooper, M, Evans, C, Freire, E, Mellor-Clark, J, McInnes, B, Barkham, M (2016). Acceptability, reliability, referential distributions and sensitivity to change in the Young Person’s Clinical Outcomes in Routine Evaluation (YP-CORE) outcome measure: replication and refinement. Child and Adolescent Mental Health 21, 115–123. doi:10.1111/camh.12128.CrossRefGoogle Scholar
Uhlhaas, PJ, Davey, CG, Mehta, UM, Shah, J, Torous, J, Allen, NB et al. (2023). Towards a youth mental health paradigm: a perspective and roadmap. Molecular psychiatry 28, 3171–3181.10.1038/s41380-023-02202-zCrossRefGoogle ScholarPubMed
Wise, EA (2004). Methods for analyzing psychotherapy outcomes: a review of clinical significance, reliable change, and recommendations for future directions. Journal of personality assessment 82, 50–59. doi:10.1207/s15327752jpa8201_10.CrossRefGoogle ScholarPubMed
Wolpert, M, Jacob, J, Napoleone, E, Whale, A, Calderon, A, Edbrooke-Childs, J (2016). Child- and Parent-reported Outcomes and Experience from Child and Young People’s Mental Health Services 2011-2015. CAMHS Press: London.Google Scholar