A new Subjective Quality of Life (SQoL) Instrument for inpatient and community mental health settings was developed by the interRAI research collaborative to support evaluation of quality in mental health settings from the person’s perspective. Ratings of SQoL provide important information about the quality of service and patient experience with the care they receive. This information can help staff to improve approaches to each person’s plan of care in a manner that is meaningful to the individual. This study examined the reliability of the SQoL-MH. 83 inpatients from several clinical departments in a mental health center in South Western Ontario, Canada were randomly assigned to either be interviewed or complete the assessment on his or her own. Reliability was tested using Cronbach’s Alpha. A preliminary factor analysis points to four SQoL-MH subscales with very good internal consistency, ranging from 0.83 to 0.90. Once finalized, the Subjective Quality of Life instrument will be integral to the interRAI suite of instruments used to assess persons with mental health needs. A reliable and valid SQoL-MH instrument will allow mental health service providers to shape or modify care environments in order to enhance quality of life. In addition, the SQoL-MH instrument could also benefit advocacy groups who use reports on quality of life to influence social policy development and funding decisions.
Severe mental illness may have a major, broad impact on a person’s life [
There are different approaches to quality of life measurement. One of the earliest approaches focused mostly on consideration of objective life circumstances (for example, income, employment and housing conditions). More sophisticated indicators of objective quality of life also included information on a person’s social network, and opportunities for leisure and recreation [
A new Subjective Quality of Life Instrument (SQoL) for inpatient and community mental health settings has been developed by the interRAI research group (www.interrai.org) as a complementary tool to existing assessor rated clinical assessments. interRAI is a notfor-profit collaborative network of researchers in over 30 countries committed to improving health care for vulnerable populations, including those affected by mental illness. The goal of interRAI is to promote evidenceinformed clinical practice and policy decisions through the collection and interpretation of high quality data about the characteristics and outcomes of persons served across a variety of health and social services settings. As part of their international effort to expand an integrated suite of assessment instruments that is now used extensively in Canada, interRAI has developed SQoL instruments for mental health, home and community care, and long-term care home settings [6-8]. Large-scale pilots of the home care and nursing home instruments have been conducted in several countries, including Canada. For example, a recent national survey of 48 nursing homes with a sample of over 900 residents who responded to the interRAI QoL survey for that sector [
filling, meaningful life and a positive sense of identity founded on hopefulness and self-determination”. They identified four key processes of recovery: 1) finding and maintaining hope; 2) the reestablishment of a positive identity; 3) finding meaning in life; and 4) taking responsibility for one’s life (p. 558). The concept of quality of life includes many of the same concepts referred to in the recovery literature [
Ratings of quality of life of persons receiving care in mental health inpatient care settings provide important information about the quality of service and satisfaction with the care they are receiving. Although some dimensions of quality of life are externally observable by raters other than the person, as noted before quality of life also includes subjective aspects that are unique to each individual. Therefore, self-reported ratings are important measures to include in any effort to evaluate quality of life. These measures can help staff to improve approaches to each person’s plan of care in a manner that is meaningful to the individual. In addition, quality of life information may be aggregated to provide information that may be used for benchmarking purposes at the organizational level as part of quality improvement initiatives.
From a clinical point of view, factors that are shown to be associated with poorer quality of life may be appropriate targets for change strategies aimed at improving the lives of persons receiving mental health services. On the other hand, some mental health characteristics might also be appropriate to use as risk adjusters when benchmarking the performance of diverse mental health organizations. For example, in organizations providing services to a population with more severe cognitive impairment or psychosis, quality of life ratings may be different from those in other organizations at least in part as a function of patient characteristics rather than service quality alone.
The purposes of this pilot study were to examine the reliability of the interRAI SQoL-MH instrument and to compare the data quality and response patterns for the quality of life ratings obtained via direct in person interviews with self-administered responses.
Participants are 83 inpatients from a mental health center in South Western Ontario, Canada (N = 83, 36 males, 47 females, aged 19 - 71 years old (M = 43.67SD = 11.75)), from several departments (comprehensive psychiatric care, eating disorders, alcohol and drug program, integrated mood and anxiety program, post-traumatic stress recovery program). Persons with a substitute decision maker, persons with vision and/or hearing impairments, persons with cognitive impairment (CPS score of 4 or more, RAI-MH [
The interRAI Subjective Quality of Life instrument for Mental Health (SQoL-MH) contains less than 50 items and asks respondents to rate the frequency of occurrence of different aspects of their quality of life (
Participants who had indicated their willingness to participate in the study received an information letter explaining the study purpose, procedure, and risks and benefits of participating. Once informed consent had been obtained, participants were randomly assigned to either be interviewed or to be asked to complete the form on his or her own. All interviewers were trained in the study protocol and the use of the SQoL-MH. Both the interview and the self-administration took place in a private location that allowed the participants to have an appropriate level of privacy to complete the study. The centre’s staff had no access to the person’s survey data in order to ensure that ratings about the staff would remain confidential.
Examination ofinternal consistency, descriptive analyses and factor analyses were carried out using Statistical Analysis Software (SAS® 9.1).
Full ethical clearance was obtained for this study from both the Office of Research Ethics of the University of Waterloo and the centre’s research ethics board (ORE
#16707, 10/14/2010).
A Cronbach’s alpha value of 0.70 or higher was considered to be evidence of good reliability [
A preliminary factor analysis using a principal component extraction method and a varimax rotation of the 46 SQoL-MH items points to four subscales. Factor 1, labeled staff relations, (eigenvalue = 14.11) accounted for 31% of the variance and had nine items (e.g., “Staff listen to what I have to say”, α = 0.88). Factor 2, labeled personal outlook and community engagement, (eigenvalue = 4.66) accounted 10% of the variance and consisted of eight items (e.g., “On the whole, my life is good”, α = 0.90). Factor 3, labeled interpersonal relationships, (eigenvalue = 2.70) accounted for 6% of the variance and had six items (e.g., “I am an important part of other people’s lives”, α = 0.86). Finally, factor 4, labeled meaningful activities, (eigenvalue = 2.38) accounted for 5% of the variance and had five items (e.g., “I am motivated to participate in everyday activities”, α = 0.83).
Descriptive analyses of the preliminary subscales indicate that participants rate their relations with staff higher than they rate their own lives, as shown in
Independent sample T-tests were conducted to compare administration types. There was only a marginally significant difference in scores on the meaningful active-
ties scale (t(81) = -1.96, p = 0.054) with participants who were being interviewed having slightly higher scores (M = 7.13, SD = 1.45) than those who filled out the questionnaire on their own (M = 6.43, SD = 1.63).
This pilot study showed that the interRAI-SQoL instrument has good reliability with a diverse inpatient population. In addition, the instrument yielded information that is highly relevant from the perspective of recovery from mental illness, including four subscales that provide summary measures of different aspects of quality of life.
Participants rated their relations with staff more positively than their own lives and futures. Perhaps this was to be expected, given that admission to a psychiatric facility means that one’s life may be put on hold and one depends on staff for support. However, it might also be argued that it is important that persons admitted with mental health problems are supported and empowered to finding and maintaining hope and meaning in their lives. Thus, one would have liked to see higher scores on the subscales measuring these qualities.
Comparing the methods of administration showed that participants who were being interviewed were slightly more positive about their meaningful activities then those who filled out the questionnaire on their own. This is consistent with the possibility of a social desirability bias where respondents may be more willing to be frank about their situation when responding with greater anonymity [
This pilot study suffers from several limitations. The sample size was sometimes too small to be able to do subgroup analyses. In addition, there was not sufficient variability in measures of symptoms related to cognition and psychosis, so it is not possible to determine whether this new instrument is also suitable for those with severe mental illness and/or cognitive problems. The findings of this study may therefore not be generalizable to all persons with psychotic disorders.
Since QoL measures are often used as outcome indicators of quality of care and treatment efficacy, these measures should be sensitive to changes in the clinical and social conditions of the person that are targeted by mental health services and interventions. Hansson [
The purposes of this study were to examine the reliability of the new interRAI SQoL-MH instrument in a mental health setting and to compare data quality and response patterns for the SQoL ratings obtained via direct in person interview and those obtained via self-administration. The reliability of the new instrument was quite acceptable in that the alpha values of its ten domains were moderate to high. Preliminary factor analysis points to four subscales with good internal consistency. It should be pointed out that these analyses are preliminary and provisional and more research is needed. In future research the interRAI-SQoL-MH instrument will be tested with more respondents, in more diverse settings and in different countries. A reliable and valid SQoL instrument will allow mental health service providers to shape or modify care environments in order to enhance QoL. In addition, the SQoL-MH instrument could also benefit advocacy groups who use reports on quality of life to influence social policy development and funding decisions.
The authors would like to thank Christopher Perlman, Shannon Matkovich, Leslie Eckel, Julie Koreck, Steve De Thomasis, Lizzy Kaempffer, and Sabina Staempfli who all supported this project.