Journal of Diabetes Mellitus
Vol. 2  No. 3 (2012) , Article ID: 22184 , 7 pages DOI:10.4236/jdm.2012.23047

Reliability and validity of the Arabic version of the PedsQLTM 4.0 generic ore scales and PedsQLTM 3.0 diabetes module

Majedah Abdul-Rasoul1*, Fatemah AlOtaibi1, Maria AlMahdi2, Hessa AlKandari3

1Department of Pediatrics, Faculty of Medicine, Kuwait University, Safat, State of Kuwait; *Corresponding Author: majedah.a@hsc.edu.kw

2Department of Pediatrics, Adan Hospital, Ministry of Health, Kuwait City, State of Kuwait

3Department of Pediatrics, Farwaniya Hospital, Ministry of Health, Kuwait City, State of Kuwait

Received 1 June 2012; revised 3 July 2012; accepted 12 July 2012

Keywords: Children; Quality of Life; Children and Adolescents; PedsQLTM Generic Core Score; PedsQLTM Diabetes Module; Type 1 Diabetes

ABSTRACT

Background: Health related quality of life (HRQOL) has become a field of extensive research involving children and adolescents with diabetes. There are no HRQOL instruments designed or adapted for the Arabic culture and language. The objectives of the study are to test the Arabic translated version of the PedsQLTM 4.0 Generic Core Scales (GCS) and the PedsQLTM 3.0 Diabetes Module (DM) in children and adolescents with type 1 diabetes (T1DM) in Kuwait and analyse their psychometric properties. Methods: After the process of translation, committee review and pre-testing (linguistic validation), 131 children and adolescents with and 104 without T1DM, with their parents completed the Arabic version of GCS. Those with T1DM completed the Arabic DM. Demographic and diabetes-related data were collected using specially designed questionnaires. Internal consistency was checked by Cronbach’s alpha coefficient. The intraclass correlations coefficient, celling and floor effects and construct validity were assessed to determine the psychometric properties of both instruments. Results: Cronbach’s alpha of the child self-report and parent proxy-report was greater than 0.70, for both instruments, indicating internal consistency reliability. Items of both instruments had minimal missing responses, and required a brief time (5 - 7 minutes) to finish indicating their feasibility. No floor effect was demonstrated. Ceiling effect ranged from 5.8% to 15.8%. The GCS distinguished between healthy and diabetic children. The intraclass correlation coefficient (ICC) between child self-report and parent proxy-report of GCS scores showed good to excellent agreement, p < 0.001. However, in the DM reports, the correlation was lower, but still significant. Girls reported lower HRQOL scores in worries and communication subscales of the diabetes module than boys, p < 0.05. Conclusions: The Arabic version of the PedsQL GCS and PedsQL DM showed sufficient feasibility, reliability and validity to be used for research purposes in public health setting for children 2 - 18 years old and their parents.

1. INTRODUCTION

Type 1 diabetes mellitus (T1DM) is one of the most common chronic diseases in children and adolescents. Living with the requirements related to glycemic control, insulin therapy, diet plan and physical activity may have a significant impact on the psychological functioning of not only the patients but their families as well [1]. Health-related quality of life (HRQOL) has been progressively acknowledged as an essential outcome measure in clinical trials and health service research and evaluation [2]. It is now well established, that enhancing HRQOL in children with diabetes is as important as metabolic control and prevention of long term complications [3].

A number of instruments have been developed for use to assess HRQOL in children. However, most of these measures were developed in adults, with modified versions for children [4]. The diabetes quality of life for youth (DQOLY) developed by Ingersoll et al. [5] is adapted from the adult version of the QOL measure used in the Diabetes Control and Complications Trial. It provides information about diabetes-specific QOL in adolescents but does not capture the children’s HRQOL with respect to the normal social, emotional and physiccal development to compare with healthy youth, and cannot be applied for children younger than 11 years. The PedsQLTM inventory instruments, developed by Varni et al. [6], include generic and disease-specific instruments. The PedsQLTM Generic Core Scales (GCS) distinguish between healthy children and those with acute or chronic diseases. The PedsQLTM 3.0 Diabetes Module (DM) measures disease specific HRQOL in children 2 - 18 years of age with T1DM. Both the GCS and the DM measures have child self-reports and parent proxy reports. Literature search did not identify any diabetes-specific instrument constructed or adopted for the Arab culture and language that can be used to evaluate HRQOL in children with diabetes.

The objectives of the present study are to adapt the Arabic version of the PedsQL GCS and the PedsQL DM to children and adolescents with T1DM and to determine the feasibility, reliability and validity of the child selfreport and the parent proxy-report. We hypothesized that both instruments will demonstrate satisfactory psychometric properties in the Arabic form and would differentiate between healthy childrenand those with T1DM.

2. SUBJECTS AND METHOD

2.1. Participants

Participants were 112 children aged 5 - 18 years and 131 parents/caregivers of children aged 2 - 18 years diagnosed with T1DM. They were recruited from the 6government hospitals in the country. One hundred and forty families were approached, and 93.6% agreed to participate.

The control group consisted of 104 healthy children attending clinics for their vaccines, standard check up for a sport activity or accompanying their siblings during their clinic visits.

2.2. Demographic and Diabetes Related Information Form

The demographic form contains the information on age, gender, school performance based on grade point average obtained from school report, and information required to calculate the SES [7]. The diabetes related information included age at disease diagnosis, duration of diabetes, mode of treatment and mean HbA1c over the last year.

2.3. HRQOL Measures

The PedsQL 4.0 GCS consist of four scales divided in 23 items assessing the level of physical and psychosocial functioning of children. Physical functioning consists of 8 items. Psychosocial functioning is divided into three subscales; emotional, social and school functioning, each consisting of 5 items [4]. The items for the self-report and proxy-report are essentially identical, differing in developmentally appropriate language, and first or third person tense. There are 7 forms available: child-reports for the ages 5 - 7, 8 - 12 and 13 - 18, and parent proxyreports for the ages 2 - 4, 5 - 7, 8 - 12 and 13 - 18. The instructions ask for the degree of a problem each item had been during the previous month. A five point Likert response scale is used (0 = never a problem, 4 = almost always a problem). Items are reversed-scored and linearly transformed to a 0 - 100 scale, with higher scores indicating better HRQOL. Scale scores are computed as the sum of items divided by the number of items answered (accounting for missing data).

The PedsQL 3.0 DM is the only multidimensional diabetes-specific instrument that would assess the broad age range of 2 - 18 years with both child and parent proxy-reports [6]. It encompassed five scales: 1) diabetes symptoms (11 items); 2) treatment barriers (4 items); 3) treatment adherence (7 items); 4) worry (3 items) and 5) communication (3 items). The format instructions and scoring methods are identical to the GCS.

Both instruments in their original American version showed good psychometric properties. The linguistic validation and psychometric properties of both instruments in many other languages are well documented [3, 8-12].

2.4. Procedure

Permission to translate the GCS and DM was obtained from the developer of the original English version, Dr James Varni, though Mapi Institute. The linguistic translation followed the recommended guidelines [13]. The PedsQL 3.0 DM was translated into Arabic by a clinical psychologist and a diabetes educator, both fluent in English. A single version was produced after discussion between the two translators. The first reconciled forward translation was then back-translated to the original US English by two Kuwaiti English teachers, who had no contact with the original instrument. The pre-test was conducted on 37 children and adolescents with T1DM and their parents using the cognitive interviewing technique to identify and correct errors during translation. All the results of the phases were reported to the instrument author in Mapi Research Institute.

The PedsQL 4.0 GCS had already been translated into Arabic by another team, but not validated. However, in order to use this version for the purpose of the study, a pilot study of the translated form, received from Mapi Institute, was taken on 37 children with T1DM, and 25 healthy controls. Cognitive interviewing technique was used in a similar method as for the PedsQL DM, after which the final version was produced.

The instruments were applied at the diabetes outpatient clinics in the hospitals. Children and their parents responded to the questions of the instrument while waiting for their medical assessment. The questionnaire was self-administered. Children and their parents responded to the questions separately. Trained research assistants were available to read the questions for illiterate parents, and some children in the 5 - 7 age-group.

2.5. Statistical Analysis

The feasibility of the Arabic version of the PedsQLTM GCS and the PedsQLTM DM was determined based on the percentage of missing responses for each item. Scale internal consistency reliability was assessed by measurement of Cronbach’s alpha coefficient, values equal or greater than 0.70 were considered satisfactory [12].

Agreement between child self-report and parent proxyreport was determined by using intraclass correlations coefficient (ICC). Values ≤ 0.4 are considered as poor to fair agreement, 0.41 - 0.6 moderate agreement, 0.61 - 0.8 good agreement and 0.81 - 1 excellent agreement.

Ceiling and floor effects were based on the percentage of scores at the extremes of the scaling range. Floor or ceiling effects are considered to be present if more than 15% of respondents achieve the lowest or highest possible scores, respectively [14]. Effect of size was calculated to determine the magnitude of the differences. Effect sizes for differences in means are designated as small (0.2 - 0.49), medium (0.5 - 0.79) and large (≥ 0.8) in magnitude. Construct validity was tested performing the known-groups method, which compares scale scores across groups known to differ in the health construct being assessed. We hypothesized that healthy children and adolescents will report higher scores than those with T1DM.

All statistical analyses were conducted using the Statistical Package for Social Sciences (SPSS) version 13.0. A level of significance of 0.5 was adopted.

The study was approved by the joined ethical committee of Kuwait University and Ministry of Health. Children and their parents were informed about the study, and gave signed consent and assent.

3. RESULTS

3.1. Sample Characteristics

Demographic characteristics of the diabetic and control groups are presented in Table 1. There was no significant difference between the groups. Of the respondents, 11 (8.4%) of the diabetics and 10 (9.6%) of the controls were from the low SES, 91 (69.5%), 68 (65.4%) were from the middle class, and 29 (22%), 26 (25%) were from the high class. Mean age, age at diabetes onset and duration of diabetes were 8.2 ± 4.1, 5.6 ± 3.1 and 8.7 ± 3.6 years respectively.Mean value for HbA1c was 8.0% + 1.1% (normal = 4.5 - 6). There was no statistically significant difference in HbA1c between the different age groups (p > 0.05) and between the genders (p > 0.05). Respondents of parent proxy-reports consisted of mothers (n = 97.74%), fathers (n = 20, 15.3%) and grandparents (n = 14, 10.7%).

3.2. Feasibility

The questionnaires took approximately 5 (for GCS), and 7 (DM) minutes to be completed. For parent selfreport, 9.1% of item responses were missing. All were in the 2-4 year-age group in the school functioning scale, because many of them did not go to school yet. The percentage of missing items for children self-reports was 1.1% on the GCS and 1.5% on the DM.

3.3. Internal Consistency Reliability

Internal consistency reliability coefficients are presented in Table 2. The Cronbach’s α value exceeded the minimum reliability standard of 0.70 for most domains in

Table 1. The characteristics of the diabetic and control groups.

Table 2. Scale descriptive and internal consistency reliability for PedsQL 4.0 GCS parent proxy-report and child self-report.

the PedsQL GCS and DM module except for “worry” in parents report and “treatment adherence” in children self-report in the DM module.

3.4. Range of Measurement

Table 2 presents the percentages of scores on the PedsQL GCS for healthy children and children with T1DM. There were no floor effects for both groups, with all scales demonstrating 0.0% of respondents scoring at the minimum. Ceiling effects were minimal ranging from 0.9% of diabetic children respondents for the emotional function to 15.8% of parents of healthy respondents for the total score. The ceiling effects showed the expected trend, where healthy children reporting more ceiling effects than children with T1DM. Children with diabetes reported lower scores in the emotional and psychosocial domains, higher in the social domain and had similar scores in the physical and school function domains. The mean total scale scores (self and parent-proxy reports) were 86.2 and 91.9 for healthy children, 82.5 and 81.1 for children with diabetes.

Table 3 demonstrates mean, standard deviation of item scores of the diabetes module for children with T1DM. Again, there was no floor effect in all domains, and the ceiling effects were minimal. Mean total score was 78.3 and 76.2 for the self and parent-proxy report respectively.

3.5. Construct Validity

Table 4 demonstrates the differences between healthy

Table 3. Scale descriptives and internal consistency reliability for PedsQL Diabetes Module parent proxy-report and child-self report.

children and children with T1DM. Most effect sizes were in the small to medium effect size range. The intercorrelations between the DM module and the Generic Core scales total score are shown in Table 5.

Table 4. Comparison of HRQOL between children with diabetes and healthy controls: Effect size.

Table 5. Intercorrelations among PedsQL GCS and PedsQL DM scales.

3.6. Self-Report/Proxy Report Concordance

The parent/child concordance intercorrelation matrix is shown in Table 5. Most intercorrelations of subclasses between child self-report and parent proxy were in medium to large effect size range. The result of paired sample t tests for the total sample showed that there was no significant difference between the subscale scores of selfreports and those of proxy-reports. The values of the ICCs ranged from in poor-fair and good agreement. The total scores of self-reports were higher than those of proxy-reports, both for the GCS and DM module No difference was found in GCS report of the diabetic group among different age and gender groups (p > 0.05). In the DM report, different age groups differ only in the “treatment barrier”, where the adolescents group (13 - 18 years) reported worse HRQOL than the other younger groups. Boys and girls did not demonstrate any difference in the diabetes subscale except for “communication” and “worries” subscales, where girls reported worse scores (p < 0.05).

4. DISCUSSION

Over the past few years, the assessment of HRQOL has become essential in many chronic diseases, leading to the development of various instruments. However, most of these instruments were in English [15]. No specific measure adapted to the Arabic culture and language for the evaluation of HRQOL is available. The adaptation and validation of the PedsQL DM and GCS followed the recommended guidelines [13,16]. The results indicate that both instruments are reliable in Arab children with T1DM in Kuwait. The results support the feasibility, reliability and validity of the child self-report and the parent proxy-report of both instruments.

There were minimal missing item responses, indicating good acceptability of children and their parents to PedsQL DM and PedsQL GCS. Children and adolescents with diabetes in Kuwait, reported similar HRQOL scores to those in Greece [3], USA [6], and the Netherlands [17] and higher HRQOL scores than the Iranian children [10] using the PedsQLTM 4.0 GCS and the PedsQLTM 3.0 DM.

The PedsQL GCS child and parent proxy report internal consistency reliabilities generally exceeded the minimum recommended coefficient standard of 0.70 for group comparisons. Therefore, the total scores of both reports were reliable for comparative studies. In the PedsQL DM, total score exceeded the required standard of 0.70, both in the child and proxy reports. Treatment adherence in the both reports and treatment barriers and worries subscale in the proxy-reports were less than 0.70. This was in consistence with the Greek version of the instruments [3], where the treatment barriers and treatment adherence subscales were in the 0.60 range. This level was comparable to its original version [18] as well as to other translated versions [11,12,19]. The Cronbach’s internal consistency coefficient is a conservative estimate of actual reliability, and thus the Arabic version of the PedQL DM and GCS were considered reliable instruments to assess the quality of life of children and youth with type 1 diabetes, and to conduct comparative studies with non-diabetic children. However, scales that did not achieve the 0.70 standard should be used for descriptive analyses only. The Arabic version of both instruments demonstrated internal reliability coefficient α similar to that of the original Americanversion [6], Iranian [10] and the Norwegian [11], and better than that shown in the Greek version [3].

There were no floor effects and only minimal ceiling effect was indicated in most of the subscales. This was consistent with previous studies [12,20,21], and it is expected for population of healthy children and adolescents. The PedsQL 4.0 GCS distinguished between children with diabetes and healthy controls, with most effect sizes in the large range except the social functioning subscale in the child sell-report.

Construct validity of the Arabic version of both instruments were analysed by assessing the intraclass correlation between subscales of the GCS and DM scales. The results of subscales of both instruments correlated with their total scores. This supports the validity of the Arabic version of PedsQL 3.0 DM and PedsQL 4.0 GCS for conducting HRQOL research in Arabic children.

Children responses correlated with parent responses positively and correlation coefficients were medium to large. Although parents showed high level of agreement with their children in total and majority of subscales, concordance was less for emotional and psychosocial function, and worries subscale. This is consistent with current research [3,22]. It reflects parent anxiety for children’s illness and underestimating their adjustment with diabetes, and other chronic diseases [22].

The main strengths of the current study include the high enrolment rate (>93%) and being conducted in all government hospitals with pediatric and adolescents diabetes clinics. This would make the sample representative of the study base population. The illiteracy of some parents was overcome by the availability of research assistant to assist in reading the question without further explanation. Furthermore, the age distribution was broad and included acceptable numbers in each age-group. The PedsQL was able to differentiate HRQOL between healthy and diabetic children.

5. CONCLUSION

Overall, this study showed that the Arabic version of the PedsQL GCS and PedsQL DM are understandable and feasible for use in Kuwait. Both instruments showed good psychometric properties, and they can be used to evaluate pediatric health outcomes in research and community setting. Having a HRQOL instrument with high validity and reliability is important to study the impact of diabetes on children and their parents. The assessment of quality of life must be part of the routine care of these children and has to be done at least annually. The high HRQOL in children with diabetes in Kuwait may reflect the standard of medical care for children with T1DM in the country, and the strength of the family unit, where grandparents and other family members may help in providing the support for the children to cope with the demands and the frustrations associated with the diagnosis of diabetes.

6. ACKNOWLEDGEMENTS

We express our appreciation to all the children, parents and physicians in all the hospitals who participated in this study. The contribution of LyraLavazaiz and Maire-SidonieEdieux from Mapi Research Trust Institute is gratefully appreciated. We also knowledge the help of Mrs. F. AlKhawaja, Mrs. SMurad and Mr. M. Farraj for their help in the process of translation of the instruments.

REFERENCES

  1. Kalyva, E., Malakonaki, E., Eiser, C. and Mamoulakis, D. (2011) Health-related quality of life (HRQOL) of children and adolescents with type 1 diabetes (T1DM): Self and parental perception. Pediatric Diabetes, 20, 34-40.
  2. Varni, J., Limbers, C. and Burwinkle, T. (2007) How young children can reliably and validly self-report their health-related quality of life? An analysis of 8.591 children across age-subgroups with PedsQL 4.0 generic core scales. Health Quality of Life Outcomes, 5, 1-13. doi:10.1186/1477-7525-5-1
  3. Emmanouilidou, E., Galli-Tsinopoulou, A., Karavatos, A. and Nousia-Arvanitakis, S. (2008) Quality of life of children and adolescents with diabetes of Northern Greek origin. Hippokratia, 12, 168-175.
  4. Varni, J., Seid, M. and Rode, C. (1999) The PedsQL measurement model for the pediatric quality of life inventory. Medical Care, 37, 126-139. doi:10.1097/00005650-199902000-00003
  5. Ingersoll, C. and Marrero, D. (1991) A modified quality of life measure for youth: Psychometric properties. Diabetes Care, 17, 114-118.
  6. Varni, J., Burwinkle, T., Jacobs, J., Gottschalk, M., Kaufman, F. and Jones, K. (2003) The PedsQLTM in type 1 and type 2 diabetes. Reliability and validity of the pediatric quality of life inventoryTM generic scales and type 1 diabetes module. Diabetes Care, 26, 631-637. doi:10.2337/diacare.26.3.631
  7. Shah, N., Shah, M. and Radovanovic, Z. (1998) Towards defining socioeconomic and demographic inequalities that may affect health in Kuwait. Medical Principles and Practice, 7, 33-46.
  8. Kook, S. and Varni, J. (2008) Validation of the Korean version of the pediatric quality of life inventoryTM (PedsQLTM) generic core scale in children and adolescents using the rasch model. Health and Quality of Life Outcomes, 6, 41-56.
  9. Roizen, R.S., Bauer, G., Medin, G., Bevilacqua, S. and Varni, J. (2008) Initial validation of the Argentinian Spanish version PedsQLTM 4.0 Generic Core Scales in children and adolescents with chronic diseases: Acceptability and comprehensibility in low-income settings. Health and Quality of Life Outcomes, 5, 59-94.
  10. Jafari, P., Forouzandeh, E., Bagheri, Z., Karamizadeh, Z. and Shalileh, K. (2011) Health related quality of life of Iranian children with type 1 diabetes: Reliability and validity of the Persian veriosn PedsQL core scares and diabetes module. Health and Quality of Life Outcomes, 9, 104-108.
  11. Reinfjell, T., Diseth, T., Veenstra, M. and Vikan, A. (2006) Measuring health-related quality of life in young adolescents: Reliability and validity in the Norwegian version of the pedfiatric quality of life inventory 4.0 (PedsQL) generic core scale. Health and Quality of Life Outcomes, 4, 61-70.
  12. Amiri, P., Ardekani, E., Jalali-Farhani, S., Hosseinpanah, F., Varni, J. and Ghofranipour, F. (2010) Reliability and validity of the Iranian version of the pediatric quality of life inventory 4.0 generic core scale in adolescents. Quality of Life Research, 19, 1501-1508.
  13. Varni, J. (2002) Linguistic validation of the PedsQLÔ— A quality of life questionnaire. MapiResearch Institute. http://www.mapi-research-inst.com/lvprocess.asp
  14. McHorney, C., Ware, J., Lu, J. and Sherbourne, C. (1994) The MOS 36-item short-form health survey (SF-36). Tests of data quality, scaling assumptions and reliability across diverse patient groups. Medical Care, 32, 40-66.
  15. Laffel, L., Connell, A., Vangsness, L., Goebel-Fabbri, A., Mansfield, A. and Anderson, B. (2003) General quality of life in youth with type 1 diabetes. Diabetes Care, 26, 3067-3073.
  16. Simeoni, M.C., Auquer, P., Antoniotti, S., Sapin, C. and San Marco, J.L. (2000) Validation of a French health-related quality of life instruments for adolescents: The VSP-A. Quality of Life Research, 9, 393-403. doi:10.1023/A:1008957104322
  17. Nuboer, R., Borsboom, G.J., Zoethout, J.A., Koot, H. and Burining, J. (2008) Effects of insulin pump vs. injection treatment on quality of life and impact of disease in children with diabetes in a randomized prospective comparison. Pediatric Diabetes, 28, 291-296.
  18. Varni, J., Limbers, C. and Newman, D. (2008) Factorial invariance of the PedsQL 4.0 generic core scales child self-report across gender: A multi-group confirmatory factor with 11,356 children aged 5 to 18. Applied Research in Quality of Life, 3, 137-148.
  19. Gkoltsiou, K., Dimitrakaki, C., Tzavara C, Papaevangelou, V., Varni, J. and Tountas, Y. (2008) Measuring health-related quality of life in Greek children: Psychometric properties of the Greek version of the Pediatric Quality of Life Inventory 4.0 generic core scale. Quality of Life Research, 17, 299-305.
  20. Upton, P., Eiser, C., Cheung, I., Hutchings, H., Jenney, M. and Maddocks, A. (2005) Measurement properties of UK—English version of the Pediatric Quality of Life Inventory 4.0 (PedsQL) generic core scales. Health and Quality of Life Outcomes, 3, 22-27.
  21. Chen, X., Origasa, H., Ichida, F., Kamibeppu, K. and Varni, J. (2007) Reliability and validity of the Pediatric Quality of Life Inventory (PedsQL) Short form 15 generic core scales in Japan. Quality of Life Research, 16, 1239-1249.
  22. Fedler-Puig, F.E., Proksch, K., Varvi, J., Gander, H. and Topf, R. (2004) Validation of the German version of the Pediatric Quality of Life Inventory in childhood cancer patients off treatment and children with epilepsy. Quality of Life Research, 13, 223-234.