Scolaris Content Display Scolaris Content Display

Cochrane Database of Systematic Reviews Protocol - Intervention

Involving service users as service providers for adult statutory mental health services

This is not the most recent version

Collapse all Expand all

Abstract

This is a protocol for a Cochrane Review (Intervention). The objectives are as follows:

We aim to find existing evidence regarding any positive or negative effects of user employment as providers of mental health services. Evidence is sought on the outcomes of involvement for clients (those receiving services). These effects comprise health effects and psychosocial outcomes. Service provision outcomes, such as time spent by employees on various tasks, or times and locations of meetings with clients will be sought, as will data regarding service use such as drop‐out rates. Data regarding professional attitudes, when those working with user‐employees are compared with those not, will be sought. This is a secondary outcome, as the objective of employing users is not to change professional attitudes, but it is a potential effect and there is scope for a valid comparison in studies included in the review.

Background

Definitions of terms used in this review

'Service user', abbreviated to user, describes any adult who is currently using mental health services. Some publications have employed the terms 'consumer', 'customer', 'client' or 'patient' to describe service users. The term 'service user' could be seen as the most neutral definition. The term 'user' is sometimes avoided because of connotations of substance abuse (Chamberlain 1993). In this review, 'user' does not imply drug use. For this review, the term 'service user' excludes carers, potential service users and user representatives.

'Ex‐user' denotes any former user of mental health services. Some ex‐users prefer the term 'survivor' (Mental 1994), however this can have connotations of abuse survival, and some professionals have found the term insulting (Everett 1998).

'User‐employee' is applied to users acting as mental health service employees, for example users working as case managers (Solomon 1995), or as staff in a crisis assessment programme (Lyons 1996). They may be in paid or unpaid employment with the service. We use the term user‐employee to indicate the role played in the service, as an employee with declared user/ex‐user status. It does not imply any differences in demographics or mental health status between user‐employees and other service users. Alternatively, user‐employees have been referred to as consumer‐employees (Mowbray 1996), consumer‐providers (Cook 1995) or prosumers (Solomon 1998).

'Mental health professionals' refers to staff of statutory mental health services. Although some professionals will have experience of using services, they are not included as user‐employees, as user‐employees are in roles designated only for declared service users.

'Client' refers to recipients of the mental health services in the studies. They may be receiving services from user‐employees. The term client is used to avoid confusion between those service users using the service (clients) and those providing the service (user‐employees). It does not imply any differences in demographics or mental health status between user‐employees and other service users. Distinguishing between roles that service users take in a service (eg. provider or recipient) by referring to them in different terms is common practice in the literature of involving users as service providers (Solomon 1998).

'User involvement', for this review, refers to involvement in services (not in own care), and is understood to mean active involvement.

This review covers services for adults with mental health problems, including dementia or substance abuse, that are integrated within the statutory mental health system, meaning professionally‐controlled or closely tied to the professionally‐led system. The review does not include user‐controlled services, so self‐help groups are excluded. Potential clients can use this review to decide if they want to receive services from user‐employees. User‐led services would not be relevant to this aim, as clients of those services have already made that decision. This review can also be used by mental heath professionals, to decide if and how to involve service users as user‐employees. User‐led services would not be relevant to this aim, as professionals have no control over who is employed or how, in user‐led services.

Review background

Providers of mental health services, like other health service providers, are increasingly expected to involve service users. Health policies often recommend the involvement of users in services, for example the United Kingdom (UK) Department of Health has an emphasis on patient and public involvement (Department 1999; Department 2001). User involvement is often seen as intrinsically worthwhile, but it can also have measurable effects (positive or negative).

Despite the encouragement of user involvement in service planning Western Europe and North America, there are few reports in the literature of its effects (Crawford 2002). Users have been involved as user‐employees internationally, including in the UK, Australia, the United States of America (USA) and Canada (O'Donnell 1998; Perkins 1997; Mowbray 1988; Church 1989). However, apart from occasional local surveys (Crawford 2003; Geller 1998) there are few data collated on how widespread this practice is.

Users can be 'involved' in services to varying degrees, according to how much power they have over decision‐making. This has been described in the literature in terms of patient participation ladders. In such ladders the lowest level of participation is providing users with information (Hickey 1998). The next rung up is consultation (Hickey 1998; Newcastle 1998) which incorporates, for example, consumer satisfaction surveys (Poulton 1999), where collected user views may be taken into consideration by service providers when making decisions. Users have more decision‐making power when they are involved in negotiation (also known as participation or partnership) in which users and professionals work together to reach decisions (Hickey 1998; Poulton 1999). At the next rung up the patient participation ladder is the power of veto over decisions (Morris 1993). The highest level such ladders reach is user‐control or independent community initiatives (Hickey 1998; Office 1993). For this review, we look at partnership approaches to service provision, meaning service users working in partnership with mental health professionals, in user‐employee roles integrated with the usual mechanisms of mental health services. Within this there may still be varying degrees of power held by user‐employees. User‐employees may have control over their own work, or they may have a say in how the service as a whole is provided.

Involving users in mental health services has the potential to produce a number of benefits, and there is also the possibility of harmful effects from involvement. To ensure that benefits are achieved and harm avoided, the mechanism of involvement needs to be carefully considered, and practice needs to be guided by evidence on effectiveness. Such evidence can be found from comparisons of services provided by user‐employees with services provided by mental health professionals.

Users can be involved as user‐employees, providing adult mental health services. Users can be employed in roles specifically designated for them, such as peer support specialists or conducting structured clinical peer interviews (Mowbray 1996; Lecomte 1999). Users may be appointed to roles for which users or non‐users could apply, such as jobs in case management or outreach (Sherman 1991; Fisk 2000). User‐run programmes can be integrated into the mental health system, for example, user‐run drop‐in centres or social support programmes for service users discharged from hospital (Kaufmann 1993; Chinman 2001).

In studies that compare services provided by user‐employees with services provided by mental health professionals, the user‐employees are acting as the intervention. Thus, these studies allow comparison of outcomes for service provision and for clients. Mental health professionals and clients may have differing views on the importance of different types of outcome. For example, mental health professionals may place more importance on therapeutic outcomes for mental health than do clients. Clients may view other outcomes as more important, for example quality of life. We will report both of these types of outcomes.

Changes may be made to services as a result of user‐employee involvement. Differences in service provision may be shown in terms of times or locations of service provider meetings with clients. Such changes in service provision may lead to changed relationships between clients (recipients of services) and staff, or change in job satisfaction among professionals working in the service. Targeting services to different needs of clients may alter the cost‐effectiveness of those services.

Some clients may choose to receive services from user‐employees as the service could be more client‐centred. Clients may benefit from role modelling and empathy from user‐employees. However, some clients might prefer to receive services from professionals.

We aim to find existing evidence regarding any positive or negative effects for clients of user‐employees in mental health services. We will also look at service provision patterns. We will identify randomised controlled trials and other comparative studies of user‐employee involvement.

Being involved as user‐employees may benefit users personally, for example by empowering them, boosting self‐esteem or confidence, or increasing their social contacts. There may be a therapeutic value to their mental health (although most users would not see this as the main purpose of involvement, instead being concerned with their clients). There may be practical advantages, for example by enabling user‐employees to earn money, learn new skills and increase their employment prospects. However, the stress of being involved, or being around clients with similar problems to their own, may have a negative impact on their health. Studies in this review are not designed to test effects on user‐employees (as involving users as service providers is the intervention for the trial, and thus there is no comparison group of users who are not involved in service provision). However, as effects on user‐employees will be of interest to service users deciding whether to become involved in providing services, and also to the professionals deciding how to employ them, we will provide a narrative summary of these effects described in the literature. These effects may include health effects, psychosocial outcomes or skill development. We will also report evaluations of the process of involving users, for example the number of applicants for user‐employee roles.

Objectives

We aim to find existing evidence regarding any positive or negative effects of user employment as providers of mental health services. Evidence is sought on the outcomes of involvement for clients (those receiving services). These effects comprise health effects and psychosocial outcomes. Service provision outcomes, such as time spent by employees on various tasks, or times and locations of meetings with clients will be sought, as will data regarding service use such as drop‐out rates. Data regarding professional attitudes, when those working with user‐employees are compared with those not, will be sought. This is a secondary outcome, as the objective of employing users is not to change professional attitudes, but it is a potential effect and there is scope for a valid comparison in studies included in the review.

Methods

Criteria for considering studies for this review

Types of studies

Randomised controlled trials (RCTs) and controlled clinical trials (CCTs; trials with comparison between two groups, membership of which has not been determined by randomisation (trials with concurrent controls) (Cochrane NRSMG 2001)).

Types of participants

Clients of mental health services who are age 18 and over, with mental illness.
We will include trials with clients aged 17 or under if the overwhelming majority of clients are over 18, or if results are presented to allow data from those 18 and over to be extracted.
Services are understood to be specifically for mental health. If the service has some clients with other problems, for example learning difficulties, in addition to mental health problems, we will include them provided that the service is aimed at mental health. We will exclude social services and forensic services.

Types of interventions

Intervention in mental health services ‐ includes services specifically for mental health problems.

Involvement of adults with current or past use of mental health services, as user‐employees, working in statutory services, or in services that are integrated within statutory services. Evidence of integration in mental health services is counted as: mental health professionals and users working together in a team; or formal cross‐consultation (consultation between user‐employees and mental health professionals as necessary part of service); or recruitment, training, supervision or payment of user‐employees by statutory organisations. Unpaid volunteers will be included if user roles meet any of the other requirements for integration into services.

Exclusions: users as members of service planning/policy committees; users providing self‐help services which are not integrated within statutory mental health services.

The intervention group will be compared with a control group which has non‐users in similar roles, or no intervention (that is, service as usual).

Types of outcome measures

Primary outcomes

Outcomes for clients (those receiving services):
1) standardised measures of psychosocial outcomes such as quality of life;
2) standardised measures of mental health.
Client subjective descriptions could be included in a narrative description in the review if these are treated as data in the study, for example with a set proportion of participants from each group given the opportunity to comment.

Outcomes for service provision:
3) client satisfaction;
4) use of services ‐ service take‐up or drop‐out rates;
5) service provision patterns ‐ time spent by employees on various tasks, or times and locations of meetings with clients.

Secondary outcomes
Professionals' attitudes; financial costs of service provision.

Search methods for identification of studies

Searches of electronic databases will be based on the following MEDLINE (Ovid) strategy:

1 exp consumer participation/
2 exp consumer advocacy/ exp patient advocacy/
3 exp consumer organizations/
4 (consumer$ or user$ or client$ or patient$ or inpatient$ or outpatient$ or survivor$) adj2 (involv$ or participa$).tw
5 (consumer$ or user$ or client$ or patient$ or survivor$) adj (staff$ or employ$ or provid$ or work$).tw
6 (consumer$ or user$ or client$ or patient$ or survivor$) adj (run or led or managed or controlled or deliver$) adj (service$ or program$).tw
7 (democratic model$ or consumer model$ or stakeholder model$) and (consultation$ or collaboration$ or control$).tw
8 prosumer$ or anti‐psychiatry.tw
9 or/ 1‐8
10 consumer$ or user$ or client$ or patient$ or inpatient$ or outpatient$.tw
11 exp employment/
12 10 and 11
13 9 or 12
14 exp mental health services/
15 exp community mental health centers/
16 exp substance abuse treatment centers/
17 exp psychiatry/
18 exp psychotherapy/
19 exp mental health associations/
20 mental adj2 service$.tw
21 psychiatr$ adj2 service$.tw
22 (community adj2 (team$ or centre$ or center$ or treat$)) and mental$.tw
23 (care or case) adj management.tw
24 care program$ approach.tw
25 outreach adj (treatment or program$ or assertive or community).tw
26 assertive adj (treatment or community).tw
27 or/ 14‐26
28 exp mental health/
29 exp mental disorders/
30 exp Suicide, attempted/
31 exp Self‐injurious behavior/
32 exp depression/
33 exp anxiety/
34 exp panic/
35 exp Stress, psychological/
36 exp Affective symptoms/
37 (mental$ or psychiatr$) adj (ill$ or disorder$ or health).tw
38 or/ 28‐37
39 exp health services/
40 exp delivery of health care/
41 exp health facilities/
42 exp patient care/
43 exp self‐help groups/
44 exp Peer Group/
45 (peer or mutual) adj (support$ or counsel$ or specialist$).tw
46 or/ 39‐45
47 38 and 46
48 13 and 27
49 13 and 47
50 48 or 49

This search will be used in conjunction with the Highly Sensitive Search Strategy for retrieving RCTs or CCTs (Dickersin 1994; Robinson 2002).

The search strategy will be adapted for use on other databases, including the Cochrane Consumers and Communication Review Group trials register; Cochrane Central Register of Controlled Trials (CENTRAL); EMBASE; Web of Science; CINAHL; Health Management Information Consortium Databases; PsycINFO; EU‐Psi database of trials in mental health; ASSIA; and grey literature database eg. European Association for Grey Literature.

We will search the bibliographies of studies read forthe review. We will contact organisations/experts with an interest in user involvement (such as the UK organisations Involve, Mental Health Foundation, MIND, Sainsbury Centre for Mental Health, Service User Research Enterprise at the Institute of Psychiatry, Centre for Citizen Participation at Brunel University, as well as first authors of included studies) to ask them about any studies they know of, as well as requesting suggestions for other organisations/experts to contact. In the review, we will provide details of which organisations/experts were contacted.

Data collection and analysis

Inclusion of studies

The citations identified by the above search strategy will be transferred into an Endnote library and screened for inclusion using the pre‐specified criteria, initially by two of the reviewers independently. If there is no disagreement between the two reviewers after 20% of the citations have been screened, then the rest of the citations will be screened by only one of the reviewers. If there is disagreement, two reviewers will screen all citations, and where there is doubt about the relevance of a citation at this stage, it will be included. There will be no masking of author names during the screening process.

The full reports of all citations included will be located and screened for eligibility. Two of the reviewers will independently apply inclusion criteria to the studies. If there is disagreement, one other reviewer will be consulted, with the majority decision carried, and if no agreement is reached this will be reported. We will provide reasons for the exclusion of studies.

Data extraction

Data will be extracted independently by two of the reviewers onto a standardised pro forma. If there is disagreement, one other reviewer will be consulted, with the majority decision carried, and if no agreement is reached this will be reported.

The data extraction sheet will record:

  • the mechanism of involving users, including the role of the involved user and support available to the user;

  • numbers of users involved and diagnoses;

  • the service or setting of involvement, including diagnoses and demographics of clients;

  • study design including numbers of participants in comparison groups;

  • all measures of outcomes.

If necessary, we will contact study authors for further information.

Quality appraisal

Studies will not be excluded due to quality appraisal, but we will report findings on quality.
Study quality data sought will be:

  • allocation concealment, with adequacy of concealment of allocation to experimental or control groups classified as (A) adequate, (B) unclear or inadequate, or (C) not used (using the Cochrane Effective Practice and Organisation of Care Review Group data collection checklist Cochrane EPOC Cochrane EPOC 2002);

  • masking of outcome assessors in data collection for primary outcome measures classified as (A) adequate, (B) unclear or inadequate, or (C) not used (Cochrane EPOC 2002);

  • whether there was intention‐to‐treat analysis and extent of loss to follow‐up.

For these studies, masking of treatment group is not relevant, as the declared user status of users involved is part of the intervention.

Allocation might (ethically) be clients opting‐in or out of the intervention group. If this is the case, it will be reported, and although the trials may be considered to have impaired quality, they will all be included.

Analysis

Client subjective descriptions could be included in a narrative description in the review if these are treated as data in the study, for example with a set proportion of participants from each group given the opportunity to comment.

It is unlikely there will be sufficient homogeneity of intervention and outcome measures to warrant meta‐analysis.

Consumer participation

The steering group for the review will include users recruited from the User and Carer Reference Group of the Academic Unit of Psychiatry and Behavioural Sciences, University of Leeds. The steering group will read drafts of the review and comment on readability and sensitivity to service users. Individuals will have the opportunity to contribute to the review if they so wish, and their contributions will be acknowledged.
A service user (named as a co‐reviewer) will be involved in data extraction, interpretation and writing the review.