National Evaluation of the Troubled Families Programme

Resource Pack for Local Troubled families Teams

Level 2

authorities: case studies

Overview of activities:

The 10 local authorities that become Level 2 authorities will be involved in the following evaluation activities:

 

• How the programme is being delivered (the process evaluation)

• Who are the families, what problems do they face, what progress do they make (monitoring)

• What outcomes do the families achieve (the impact assessment - national dataset tracking)

• What savings the programme makes (the economic assessment)

 

The only differences between Level 1 and Level 2 involvement are that Level 2 does not involve (a) a survey of families or (b) the detailed cost benefit assessment case studies.

Evaluation activity 1: Process evaluation

Evaluation activity 2: Monitoring

Summary of activities

Implications for local teams

Summary of activities:

The process evaluation for Level 2 authorities will involve:

• Interviews with the LA/service team

• Interviews with the TF team

• Workshops with local partners. 

 

In Level 2, families involved in the in-depth interviews, and staff involved in their case will be given digital cameras and asked to keep a photographic record of their experiences throughout the evaluation.

 

There will be three ‘waves’ of data collection, one per year of the evaluation: the start of their intervention  in Summer or Autumn 2013; at the end of their intervention (and we need to talk to you about what that means, at least for the purpose of the evaluation); and 6-9 months later.

 

 

 

 

Implications for local teams:

The key implications for Local TF teams are that:

• Your key staff are available for interview.

• Some of those staff will be willing to keep a photographic record of their experiences.  

• Your help with the recruitment of families for the in-depth interviews.

• Your help in identifying the local partners and stakeholders that you work closely with to take part in the workshops.     

 

In between the fieldwork ‘waves’ we will ask TF teams to stay in touch with us via an online forum. This will operate as an online diary for each TF service to record their experiences and views at key points during the evaluation.

Summary of activities

Implications for local teams

Summary of activities:

Phase 1: We will consult with local authorities about how best to gather and input the data that you hold to date (Years 1 and part of Year 2) on your troubled families, in order to provide aggregate figures for whole of the programme.  Monitoring data will be needed for at least 10% of troubled families per authority, but up to 100% where feasible.

 

Phase 2: We will consult with local authorities on the development of the new online monitoring data collection system.  Local authorities will be asked to provide quarterly or six monthly data returns (TBC) once this system is operational, and we will aim to align this with the Management Information returns.

 

 

 

 

 

Implications for local teams:

Your help in providing access to your existing data on troubled families and work with the national evaluators to enable the secure transfer of this information, using Unique Reference Numbers (URNs) in place of personal identifying information.

 

Your support of the work of the national evaluators to identify the optimal approach for inputting to the national MI system when this is operational, including either data entry to the secure online database, or an arrangement to extract and securely transfer data-files from your existing case management system.

 

 

 

For more details on this Activity: Click Here

For more details on this Activity: Click Here

Evaluation activity 3: Impact evaluation

(national dataset tracking)

Evaluation activity 4: Economic assessment

Evaluation activity 2: Monitoring

Summary of activities

Implications for local teams

Summary of activities:

Local authorities will be asked to supply “identifiers”, like Unique Property Reference Numbers,  for individual family members (from troubled families and the comparison families) to allow them to be tracked via national datasets such as the National Pupil Database, benefit and employment records, the Police National Computer and Hospital Episode Statistics.

 

Implications for local teams:

We will work with the local teams to support them in providing some basic information on  individual family members to allow them to be identified in the national datasets, linked to the type of eligibility criteria they met (crime, ASB, education, benefits or local) and the date of first contact with the TF programme.

 

We are looking into the consent process needed for the comparison group of families, as it is possible that we will need local authorities to collect consent from families for the linking of datasets.

 

 

 

 

Summary of activities

Implications for local teams

Summary of activities:

We will draw on data collected as part of the process evaluation, monitoring and impact assessment (national dataset tracking) to compile the economic assessment.

CBA guidance and self assessment tools will be made available to enable local authorities to estimate savings.

 

 

 

Implications for local teams:

See implications for process evaluation, monitoring and impact assessment (national dataset tracking) set out above.

 

CBA guidance and tools will be provided to support self evaluation activity.

 

 

 

For more details on this Activity: Click Here

For more details on this Activity: Click Here

Evaluation activity 5: Economic assessment

What you would receive back?

 

All Level 2 authorities will receive a local evaluation report for their area that includes summaries of the results across the different components of the evaluation (including CBA where relevant). Because there will be no survey of families in these areas, the report will necessarily be less detailed than the report for Level 1 authorities.

 

The report will include a ‘digital story’ or case illustration comprising an edited collection of the photographs (with narration or soundtrack) captured by each TF service who took part in the evaluation.

 

 

 

Is your local authority suitable?

 

There will be at least 10 Level 2 authorities in total, and we need to ensure that these cover, between them, a range in terms of delivery models, areas and eligibility criteria (including local eligibility criteria). So it is probable that not all those local authorities volunteering for Level 2 will be selected for this level.