Open Access Peer-reviewed Research Article

Measurement invariance of maternal ratings of ADHD symptoms across clinic referred children's with and without ADHD

Article Sidebar

Schematic diagram of bi-factor ADHD models
Download PDF Download HTML
Submitted   Jan 28, 2019
Published   Mar 6, 2019
Issue    Vol 1 No 1 (2019)
DOI   10.25082/ADEP.2019.01.002

Views

3025

Downloads

2254

Citations

PlumX Metrics

Main Article Content

Rapson Gomez corresponding author
School of Health and Life Sciences, Federation University Australia, Australia
Alasdair Vance
Royal Childrens Hospital and The University of Melbourne, Victoria, Australia
Vasileios Stavropoulos
Cairnmillar Institute, Australia

Abstract

The study examined the measurement invariance (configural, metric, scalar, and error variances) and factor mean scores equivalencies of a modified version of the Strengths and Weaknesses of ADHD-Symptoms and Normal Behavior Scale (SWAN-M) across ratings provided by mothers of clinic-referred children and adolescents, diagnosed with (N = 666) and without (N = 202) ADHD. Confirmatory factor analysis (CFA) of these ratings provided support for the bi-factor model of ADHD [orthogonal general and specific factors for inattention (IA) and hyperactivity/impulsivity (HI) symptoms].  Multiple-group confirmatory factor analysis (CFA) of the bi-factor model supported full measurement invariance. Findings also showed that for latent mean scores, the ADHD group had higher scores than the non-ADHD group for the ADHD general and IA specific factors. The findings indicate that observed scores (based on maternal ratings of the SWAN-M) are comparable, as they have the same measurement properties. The theoretical, psychometric and clinical implications of the findings are discussed.

Keywords
strengths and weaknesses of ADHD-Symptoms and Normal Behavior Scale, factor structure, measurement invariance, children and adolescents, mother ratings

Article Details

How to Cite
Gomez, R., Vance, A., & Stavropoulos, V. (2019). Measurement invariance of maternal ratings of ADHD symptoms across clinic referred children’s with and without ADHD. Advances in Developmental and Educational Psychology, 1(1), 7-17. https://doi.org/10.25082/ADEP.2019.01.002
Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

References

  1. American Psychiatric Association.Diagnostic and Statistical Manual of Mental Disorders (4th ed.). Washington, 1994.
  2. American Psychiatric Association. Diagnostic and statistical manual of mental disorders DSM-IV TR (Text Revision). Washington, 2000.
  3. American Psychiatric Association. Diagnostic and statistical manual of mental disorders (5th ed.). Washington, 2013. https://doi.org/10.1176/appi.books.9780890425596
  4. Gomez R and Stavropoulos V. Parent Ratings of the Strengths and Difficulties Questionnaire: What Is the Optimum Factor Model? Assessment, 2017. https://doi.org/1073191117721743
  5. Daley D. Attention deficit hyperactivity disorder: A review of the essential facts. Child Care, Health and Development, 2006, 32: 193-204. https://doi.org/10.1111/j.1365-2214.2006.00572.x
  6. Power TJ, Doherty BJ, Panichelli-Mindel SM, et al. The predictive validity of parent and teacher reports of ADHD symptoms. Journal of Psychopathology and Behavioral Assessment, 1998, 20: 57–81. https://doi.org/10.1023/A:1023035426642
  7. Gaub M and Carlson CL. Behavioral characteristics of DSM-IV ADHD subtypes in a school-based population. Journal of Abnormal Child Psychology, 1997, 25: 103-111. https://doi.org/10.1023/A:1025775311259
  8. Teegarden LA and Burns GL. 12-month stability of ADHD, opposition defiant disorder, and conduct disorder symptoms in kindergarten through fifth grade children based on a single information source: Usefulness of teacher ratings for the creation and study of the ADHD subtypes. Child & family behavior therapy, 1999, 21(3): 53-70. https://doi.org/10.1300/J019v21n03_04
  9. Aman MG and Pearson DA. Monitoring, measuring drug effects. II. Behavioral, emotional, and cognitive effects. In: J. S. Werry & Aman, M. G. (eds). Practitioner’s Guide to Psychoactive Drugs for Children and Adolescents. 1999, 99-164. New York: Plenum Press. https://doi.org/10.1007/978-1-4899-0086-9_5
  10. Gomez R, Vance A and Stavropoulos V. Test-Retest Measurement Invariance of Clinic Referred Children’s ADHD Symptoms. Journal of Psychopathology and Behavioral Assessment, 2017, 1-12. https://doi.org/10.1007/s10862-017-9636-4
  11. Swanson J, Schuck S, Mann M, et al. Categorical and dimensional definitions and evaluations of symptoms of ADHD: the SNAP and SWAN rating scales. University of California, Irvine, 2006.
  12. Gomez R, Burns GL, Walsh JA, et al. Trait, source and error variance in ADHD symptoms: A multitrait-multisource analysis with Australian and Brazilian children. Psychological Assessment, 2003, 15: 3-16. https://doi.org/10.1037/1040-3590.15.1.3
  13. Gomez R, Harvey J, Quick C, et al. DSM-IV AD/HD: Confirmatory factor models, prevalence, and gender and age differences based on parent and teacher ratings of Australian primary school children. Journal of Child Psychology and Psychiatry, 1999, 40: 265-274. https://doi.org/10.1111/1469-7610.00440
  14. Arias VB, Ponce FP and Nunez DE. Bifactor models of Attention-Deficit/Hyperactivity Disorder (ADHD): An evaluation of three necessary but underused psychometric indexes. Assessment, 2016(b). https://doi.org/10.1177/1073191116679260
  15. Gomez R, Vance A and Gomez RM. Validity of the ADHD bifactor model in general community samples of adolescents and adults, and a clinic-referred sample of children and adolescents. Journal of Attention Disorders, 2013. https://doi.org/10.1177/1087054713480034
  16. Burns GL, Walsh JA, Servera M, et al. Construct validity of ADHD/ODD rating scales: Recommendations for the evaluation of forthcoming DSM-V ADHD/ODD scales. Journal of Abnormal Child Psychology, 2013, 41: 15-26. https://doi.org/10.1007/s10802-012-9660-5
  17. Reise SP. The rediscovery of bifactor measurement models. Multivariate behavioral research, 2012, 47(5): 667-696. https://doi.org/10.1080/00273171.2012.715555
  18. Arias VB, Ponce FP, Martínez-Molina A, et al. General and specific attention-deficit/hyperactivity disorder factors of children 4 to 6 years of age: An exploratory structural equation modeling approach to assessing symptom multidimensionality. Journal of Abnormal Psychology, 2016(a), 125: 125-137. https://doi.org/10.1037/abn0000115
  19. Cohen J. Statistical power analysis. Current directions in psychological science, 1992, 1(3): 98-101. https://doi.org/10.1111/1467-8721.ep10768783
  20. Drasgow F and Kanfer R. Equivalence of psychological measurement in heterogeneous populations. Journal of Applied Psychology, 1985, 70: 662-680. https://doi.org/10.1037/0021-9010.70.4.662
  21. Pontes HM, Stavropoulos V and Griffiths MD. Measurement Invariance of the Internet Gaming Disorder Scale–Short-Form (IGDS9-SF) between the United States of America, India and the United Kingdom. Psychiatry research, 2017, 257: 472-478. https://doi.org/10.1016/j.psychres.2017.08.013
  22. Hu LT and Bentler PM. Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 1998, 3: 424-453. https://doi.org/10.1037/1082-989X.3.4.424
  23. Meredith W. Measurement invariance, factor analysis, and factorial invariance. Psychometrika, 1993, 58: 525-542. https://doi.org/10.1007/BF02294825
  24. Reise SP, Bonifay WE and Haviland MG. Scoring and modeling psychological measures in the presence of multidimensionality. Journal of personality assessment, 2013 95(2): 129-140. https://doi.org/10.1080/00223891.2012.725437
  25. DeVries LN, Hartung CM and Golden TL. Negative Halo Effects in Parent Ratings of ADHD and ODD. Journal of Psychopathology and Behavioral Assessment, 2017, 39(2): 179-188. https://doi.org/10.1007/s10862-016-9560-z
  26. Hartung CM, Lefler EK, Tempel AB, et al. Halo effects in ratings of ADHD and ODD: Identification of susceptible symptoms. Journal of Psychopathology and Behavioral Assessment, 2010, 32(1): 128-137. https://doi.org/10.1007/s10862-009-9135-3
  27. Hartun CM, Van Pelt JC, Armendariz ML, et al. Biases in ratings of disruptive behavior in children: Effects of sex and negative halos. Journal of Attention Disorders, 2006, 9(4): 620-630. https://doi.org/10.1177/1087054705284233
  28. Jackson DA and King AR. Gender differences in the effects of oppositional behavior on teacher ratings of ADHD symptoms. Journal of Abnormal Child Psychology, 2004, 32(2): 215-224. https://doi.org/10.1023/B:JACP.0000019772.71251.ff
  29. Gilmore L. Community knowledge and beliefs about ADHD. The Educational and Developmental Psychologist, 2010, 27(1): 20-30. https://doi.org/10.1375/aedp.27.1.20
  30. Faraone SV, Monuteaux MC, Biederman J, et al. Does parental ADHD bias maternal reports of ADHD symptoms in children? Journal of consulting and clinical psychology, 2003, 71(1): 168. https://doi.org/10.1037/0022-006X.71.1.168
  31. Manshadi M, Lippmann S, O’Daniel RG, et al. Alcohol abuse and attention deficit disorder. The Journal of clinical psychiatry, 1983, 44(10): 379-380.
  32. Stavropoulos V, Mastrotheodoros S, Papapetrou S, et al. Measurement invariance: The case of measuring romantic attachment in Greek and Cypriot adolescents. European Journal of Developmental Psychology, 2017(a): 1-10. https://doi.org/10.1080/17405629.2017.1414696
  33. Stavropoulos V, Beard C, Griffiths MD, et al. Measurement invariance of the Internet Gaming Disorder Scale–Short-Form (IGDS9-SF) between Australia, the USA, and the UK. International Journal of Mental Health and Addiction, 2017(b): 1-16. https://doi.org/10.1007/s11469-017-9786-3
  34. Jarrett MA, Wolff JC and Ollendick TH. Concurrent validity and informant agreement of the ADHD module of the Anxiety Disorders Interview Schedule for DSM-IV. Journal of Psychopathology and Behavioral Assessment, 2007, 29(3): 159-168. https://doi.org/10.1007/s10862-006-9041-x
  35. Silverman WK, Saavedra LM and Pina AA. Test-retest reliability of anxiety symptoms and diagnoses with anxiety disorders interview schedule for DSM-IV : Child and parent versions. Journal of the American Academy of Child and Adolescent Psychiatry, 2001, 40(8): 937-944. https://doi.org/10.1097/00004583-200108000-00016
  36. Silverman WK and Albano AM. The Anxiety Disorders Interview Schedule for DSM-IV: Child Interview Schedule. San Antonio, Texas: Psychological Corporation, 1996.
  37. Grills AE and Ollendick TH. Multiple informant agreement and the anxiety disorders interview schedule for parents and children. Journal of the American Academy of Child & Adolescent Psychiatry, 2003, 42(1): 30-40. https://doi.org/10.1097/00004583-200301000-00008
  38. Jensen PS, Rubio-Stipec M, Canino G, et al. Parent and child contributions to diagnosis of mental disorder: are both informants always necessary? Journal of the American Academy of Child & Adolescent Psychiatry, 1999, 38(12): 1569-1579. https://doi.org/10.1097/00004583-199912000-00019
  39. Achenbach TM and Rescorla L. ASEBA school-age forms & profiles, 2001.
  40. Conners CK, Pitkanen J and Rzepa SR. Conners comprehensive behavior rating scale. In Encyclopedia of clinical neuropsychology. Springer New York, 2011. https://doi.org/10.1007/978-0-387-79948-3_1536
  41. Muthén LK and Muthén BO. Mplus user’s guide. Seventh Edition. Los Angeles, CA: Muthén & Muthén, 2012.
  42. DiStefano C. The impact of categorization with confirmatory factor analysis. Structural Equation Modeling, 2002, 9: 327-346. https://doi.org/10.1207/S15328007SEM0903_2
  43. Lubke GH and Muthen BO.Applyingmultigroup confirmatory factor models for continuous outcomes to Likert scale data complicates meaningful group comparisons. Structural Equation Modeling, 2004, 11: 514-534. https://doi.org/10.1207/s15328007sem1104_2
  44. Satorra A and Bentler PM. A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 2001, 66(4): 507-514. https://doi.org/10.1007/BF02296192
  45. Cantwell DP. Attention deficit disorder: a review of the past 10 years. Journal of the American Academy of Child & Adolescent Psychiatry, 1996, 35(8): 978-987. https://doi.org/10.1097/00004583-199608000-00008
  46. Rohde LA, Szobot C, Polanczyk G, et al. Attention-deficit/hyperactivity disorder in a diverse culture: do research and clinical findings support the notion of a cultural construct for the disorder? Biological psychiatry, 2005, 57(11): 1436-1441. https://doi.org/10.1016/j.biopsych.2005.01.042
  47. Jones C. Archival data: Advantages and disadvantages for research in psychology. Social and Personality Psychology Compass, 2010, 4(11): 1008-1017. https://doi.org/10.1111/j.1751-9004.2010.00317.x
  48. Brown TA. Confirmatory factor analysis for applied research. New York: Guilford Press, 2006.