Project Cymru

Process evaluation

Process evaluation

The trial will incorporate an embedded process evaluation. Data will be used to examine how the programme is implemented and to facilitate interpretation of outcome effects.

Trial arm implementation and context: Interviews with managers (n=6), and co-ordinators (n=5 at baseline, n=7 at follow-up), focus groups with programme facilitators (n≈60) and analysis of routine monitoring data will assess how the SFP10-14UK and normal service provision operates in each of the six delivery areas. This will include the nature and number of normal services available and, for each arm, staffing arrangements, referral routes, barriers / facilitators and integration of services. Interviews will also be conducted with key staff in the Welsh Assembly Government (n =1) and the team responsible (n=3) for providing training to new programme teams. Interviews with programme coordinators, focus groups with families and 9 month and 15 month telephone interviews will be used to map out other services available to control families, and levels of utilisation in each programme area.

Trial arm fidelity: Interviews with co-ordinators (n=5 at baseline, n=7 at follow-up), focus groups with programme facilitators (n≈60) and routine monitoring data will also assess the consistency with which the SFP10-14UK and normal service are delivered in each area, and how closely implementation matches their stated design and aims. Structured observation of 18 SFP10-14UK sessions and 12 facilitators’ team meetings will also be used to assess fidelity by area and time.

Participation, reach and dose: Routine monitoring data will be used to assess which demographic groups participate in the programme, the number of programme sessions attended and any additional services accessed. For those in the control arm, the number and nature of services accessed will be examined and demographic differences assessed.

Reception and responsiveness: Focus groups with parents (n≈60) and young people (n≈30) will assess the experiences of attending the SFP or normal service in terms of its acceptability, their assessment of its value to them as individuals and any barriers of facilitators to participation.

Link to home page