Skip to main content
SpringerLink
Log in

Assessment in Multisite Randomized Clinical Trials of Patients with Autistic Disorder: The Autism RUPP Network

  • Published:
Journal of Autism and Developmental Disorders Aims and scope Submit manuscript

Abstract

Assessment of autistic disorder (autism) symptoms, primary and secondary, poses more challenging problems than ordinarily found in multisite randomized clinical trial (RCT) assessments. For example, subjects may be uncommunicative and extremely heterogeneous in problem presentation, and current pharmacological treatments are not likely to alter most core features of autism. The Autism Research Units on Pediatric Psychopharmacology (RUPP Autism Network) resolved some of these problems during the design of a risperidone RCT in children/adolescents. The inappropriateness of the usual anchors for a Clinical Global Impression of Severity (CGI-S) was resolved by defining uncomplicated autism without secondary symptoms as a CGI-S of 3, mildly ill. The communication problems, compromising use of the patient as an informant, were addressed by several strategies, including careful questioning of care providers, rating scales, laboratory tests, and physical exams. The broad subject heterogeneity requires outcome measures sensitive to individual change over a wide spectrum of treatment response and side effects. The problems of neuropsychologically testing nonverbal, lower functioning, sometimes noncompliant subjects requires careful instrument selection/adaptation and flexible administration techniques. The problems of assessing low-end IQs, neglected by most standardized test developers, was resolved by an algorithm of test hierarchy. Scarcity of other autism-adapted cognitive and neuropsychological tests and lack of standardization required development of a new, specially adapted battery. Reliability on the Autism Diagnostic Interview (currently the most valid diagnostic instrument) and other clinician instruments required extensive cross-site training (in-person, videotape, and teleconference sessions). Definition of a treatment responder required focus on individually relevant target symptoms, synthesis of possible modest improvements in many domains, and acceptance of attainable though imperfect goals. The assessment strategy developed is implemented in a RCT of risperidone (McDougle et al., 2000) for which the design and other methodological challenges are described elsewhere (Scahill et al., 2000). Some of these problems and solutions are partially shared with RCTs of other treatments and other disorders.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

REFERENCES

  • Alpherts, W., & Aldenkamp, B. (1997, December 4). FePsy, a neuropsychological computerized battery [On line]. Available: http://www.euronet.nl/users/fepsy.

  • Alpherts, W., & Aldenkamp, A. P. (1990). Computerized neuropsychological assessment of cognitive fuctioning in children with epilepsy. Epilepsia, 31 (Suppl. 4), S35-S40.

    Google Scholar 

  • Allison, D., Mentore, J., Heo, M., Weiden, P., Cappelleri, J., & Chandler, L. (1998). Weight gain associated with conventional and newer antipsychotics (poster). Scientific Procedings of the American Psychiatric Association's Annual Meeting, Toronto, Ontario, NR 497.

  • Aman, M. G. (1996). Stimulant drugs in the developmental disabilities revisited. Journal of Developmental and Physical Disabilities, 8, 347–365.

    Google Scholar 

  • Aman, M. G., Marks, R. E., Turbott, S. H., Wilsher, C. P., & Werry, S. N. (1991). Methylphenidate and thioridazine in the treatment of intellectually subaverage children: Effects on cognitive-motor performance. Journal of the American Academy of Child and Adolescent Psychiatry, 30, 816–824.

    Google Scholar 

  • Aman, M. G., Singh, N. N., Stewart, A. W., & Field, C. J. (1985). The Aberrant Behavior Checklist: A behavior rating scale for the assessment of treatment effects. American Journal of Mental Deficiency, 89, 485–491.

    Google Scholar 

  • Aman, M. G., & Turbott, S. H. (1986). Incidental Learning, Distraction, and Sustained Attention in Hyperactive and Control Subjects. Journal of Abnormal Child Psychology, 14, 441–445.

    Google Scholar 

  • American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.

    Google Scholar 

  • Amery, W., Zuiderwijk, P., Brecher, M., Lemmens, P., & Van Baelen, B. (1997). Safety profile of risperidone. Scientific Abstracts of the American College of Neuropsychopharmacology 36th Annual Meeting. Waikoloa, HI, p 188.

  • Anderson, G. M., Freedman, D. X., Cohen, D. J., Volkmar, F. R., Hoder, E. L., & McPhedran, P. (1987). Whole blood serotonin in autistic an normal subjects. Journal of Child Psychology and Psychiatry, 28, 885–900

    Google Scholar 

  • Ando, H., & Yoshimura, I. (1979). Effects of age or communication skill levels and prevalence of maladaptive behaviors in autistic and mentally retarded children. Journal of Autism and Developmental Disorders, 9, 83–93.

    Google Scholar 

  • Bailey, A., Bolton, P., Butler, L., Le Couteur, A., Murphy, M., Scott, S., Webb, T., & Rutter, M. (1993). Prevalence of fragile XS anomaly amongst autistic twins and singletons. Journal of Child Psychology and Psychiatry, 34, 673–688.

    Google Scholar 

  • Bailey, A., Le Couteur, A., Gottesman, I., and Bolton, P. (1995). Autism as a strongly genetic disorder: Evidence from a British twin study. Psychological Medicine, 25, 63–77.

    Google Scholar 

  • Barkley, R. A. (1991). The ecological validity of laboratory and analogue assessment methods of ADHD symptoms. Journal of Abnormal Child Psychiatry 19:149–178.

    Google Scholar 

  • Barnes, T. R., & McPhillips, M. A. (1998). Novel antipsychotics, extrapyramidal side effects and tardive dyskinesia. International Clinical Psychopharmacology 13 (Suppl. 3), S49–57.

    Google Scholar 

  • Benvenga, M. J., & Leander, J. D. (1997). Increased food consumption by clozapine, but not by olanzapine, in satiated rats. Drug Development Research, 41, 48–50.

    Google Scholar 

  • Bromel, T., Blum, W. F., Ziegler, A., et al. (1998). Serum leptin levels increase rapidly after initiation of clozapine therapy. Molecular Psychiatry, 3(1), 76–80.

    Google Scholar 

  • Campbell, M., & Palij, M. (1985). Behavioral and cognitive measures used in psychopharmacological studies of infantile autism. Psychopharmacology Bulletin, 21, 1047–1053.

    Google Scholar 

  • Campbell, M., Anderson, L. T., Small, A. M., Adams, P., Gonzales, N. M., & Ernst, M. (1993). Naltrexone in autistic children: Behavioral symptoms and attentional learning. Journal of the American Academy of Child and Adolescent Psychiatry, 32, 1283–1291.

    Google Scholar 

  • Delis, C., Kramer, J., Kaplan, E., & Ober, B. (1994). California verbal learning test manual. The San Antonio, TX: Psychological Corp.

    Google Scholar 

  • Douglas, V. I., Barr, R. G., O'Neill, M. E., et al. (1986). Short term effects of methylphenidate on the cognition, learning and acedemic performance of children with attention deficit disorder in the laboratory and the classroom. Journal of Child Psychology and Psychiatry, 27, 191–211.

    Google Scholar 

  • Dunn, L. M., & Dunn, L. M. (1981). Peabody Picture Vocabulary Test-Revised. Circle Pines, MN: American Guidance Service.

    Google Scholar 

  • Feldman, H. M., Kolmen, B. K., & Gonzaga, A. M. (1999). Naltrexone and communication skills in young children with autism. Journal of the American Academy of Child and Adolescent Psychiatry, 38, 587–93

    Google Scholar 

  • Fisch, G. S. (1992). Is autism associated with the fragile X syndrome? American Journal of Medical Genetics, 43, 47–55.

    Google Scholar 

  • Folstein, S., & Rutter, M. (1977). Infantile autism: a genetic study of 21 twin pairs. Journal of Child Psychology and Psychiatry, 18, 297–321

    Google Scholar 

  • Fray, P. J., Robbins, T. W., & Sahakian, B. J. (1996). Neuropsychiatric applications of CANTAB (University of Canterbury). International Journal of Geriatric Psychiatry, 11, 329–336.

    Google Scholar 

  • Freeman, B. J., Ritvo, E. R., Needleman, R., & Yokota A. (1985a). The stability of cognitive and linguistic parameters in autism: A 5-year study. Journal of the American Academy of Child and Adolescent Psychiatry, 24, 459–464.

    Google Scholar 

  • Freeman, B. J., Ritvo, E. R., Yokota, A., & Ritvo, A. (1985b): A scale of rating symptoms of patients with the syndrome of autism in real life settings. Journal of the American Academy of Child and Adolescent Psychiatry, 25, 130–136.

    Google Scholar 

  • Geldmacher, D. S. (1998). Stimulus characteristics determine processing approach on random array letter-cancellation tasks. Brain & Cognition, 36, 346–354.

    Google Scholar 

  • Griffin, J. C., Williams, D. E., Stark, M. T., Altmeyer, B. K., & Mason, M. (1986). Self-injurious behavior: A state-wide prevalence survey of the extent and circumstances. Applied Research in Mental Retardation, 7, 105–116.

    Google Scholar 

  • Handen, B. L., Breaux, A. M., Gosling, A., et al. (1990). Efficacy of ritalin among mentally retarded children with ADHD. Pediatrics, 86, 922–930.

    Google Scholar 

  • Kaufman, A. S., Kaufman, N. L. (1983). K-ABC: Kaufman Assessment Battery for Children. Circle Pines, MN, American Guidance Service.

    Google Scholar 

  • Keefe, R. S. E., Lees-Roitman, S. E., & Dupre, R. L. (1997). Performance of patients with schizophrenia on a pen and paper visuospatial working memory task with short delay. Schizophrenia Research, 26(1), 9–14.

    Google Scholar 

  • Kelly., D. L., Conley, R. R., Love, R. C., Shorn, D. S., & Uschak, C. M. (1998). Weight gain in adolescents treated with risperidone and conventional antipsychotics over six months. Journal of Child and Adolescent Psychopharmacology, 8(3), 151–159

    Google Scholar 

  • Kumra, S., Herion, D., Jacobsen, L., Briguglia, C., & Grothe, D. (1997): Case study: Risperidone-induced hepatotoxicity in pediatric patients. Journal of the American Academy of Child and Adolescent Psychiatry, 36, 701–705.

    Google Scholar 

  • Leadbetter, R., Shutty, M., Pavalonis, D., Viewveg, V., Higgins, P., & Downs, M. (1992). Clozapine-induced weight gain: Prevalence and clinical incidence. American Journal of Psychiatry, 149, 68–72.

    Google Scholar 

  • Le Couteur, A., M. Rutter, Lord, C., Rics, P., Robertsen, S., Holdgrafer, & McLennan, J. (1989). Autism diagnostic interview: A standardized investigator-based instrument. Journal of Autism and Developmental Disorders, 19; 363–387.

    Google Scholar 

  • Lezak, M. D. (1995). Neuropsychological assessment (3rd ed.). New York: Oxford University Press.

    Google Scholar 

  • Lord, C. (1995). Follow-up of two-year-olds referred for possible autism. Journal of Child Psychology and Psychiatry, 36, 1365–1382.

    Google Scholar 

  • Lord, C., Rutter, M., G??de, S., He??msbergen, J., Jordan, H., Manhood, L., and S??h??pler, E. (1989). Autism Diagnostic Observation Schedule: A standardized observation of communicative and social behavior. Journal of Autism and Developmental Disorders, 19, 185–212.

    Google Scholar 

  • Lord, C., Rutter, M., & Le Couteur, A. M. (1994). Autism Diagnostic Interview-Revised: A revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. Journal of Autism and Developmental Disorders, 24, 659–685.

    Google Scholar 

  • Lord, C., Pickles, A., McLennan, J., Rutter, M., Bregman, J., Folstein, S., Fombonne, E., Leboyer, M., & Minshew N. (1997). Diagnosing autism: Analyses of data from the Autism Diagnostic Interview. Journal of Autism and Developmental Disorders, 27, 501–517.

    Google Scholar 

  • Mahoney, W. J., Szatmari, P., MacLean, J. E., Bryson, S. E., Bartolucci, G., Walter, S. D., Jones, M. B., & Zwaigenbaum, L. (1998). Reliability and accuracy of differentiating pervasive developmental disorder subtypes. Journal of the American Academy of Child and Adolescent Psychiatry, 37, 278–285.

    Google Scholar 

  • McDougle, C. J., Scahill, L., McCracken, J. T., Aman, M. G., Tierney, E., Arnold, L. E., Freeman, B. J., Martin, A., McGough, J. J., Cronin, P., Posey, D. J., Riddle, M. A., Ritz, L., Swiezy, N. B., Vitiello, B., Volkmar, F. R., Votolato, N. A., & Walson, P. (2000). Research Units on Pediatric Psychopharmacology (RUPP)-Autism network: Background and rationale for an initial controlled study of risperidone. Child and Adolescent Psychiatric Clinics of North America, 9(1):201–224.

    Google Scholar 

  • McDougle, C., Holmes, J., Bronson, M., Anderson, G., Volkmar, F., Price, L., & Cohen, D. (1997). Risperidone treatment of children and adolescents with pervasive developmental disorders: A prospective, open-label study. Journal of the American Academy of Child and Adolescent Psychiatry, 36, 685–693.

    Google Scholar 

  • McDougle, C. J., Holmes, J. P., Carlson, D. C., Pelton, G. H., Cohen, D. J., & Price, L. H. (1998). A double-blind, placebo-controlled study of risperidone in adults with autistic disorder and other pervasive developmental disorders. Archives of General Psychiatry, 55, 633–641

    Google Scholar 

  • McDougle, C. J., Naylor, S. T., Cohen, D. J., Volkmar, F. R., Heninger, G. R., & Price, L. (1996). A double-blind, placebocontrolled study of fluvoxamine in adults with autistic disorder. Archives of General Psychiatry, 53, 1001–1008.

    Google Scholar 

  • Minshew, N. (1991). Indices of neuronal function in autism: clinical and biological implications. Pediatrics, 31, 774–780.

    Google Scholar 

  • Mullen, E. M. (1995). Mullen Scales of Early Learning. Circle Pines, MN: American Guidance Service.

    Google Scholar 

  • Pelham, W. E., Bender, M. E., Caddell, J., et al. (1985). Methylphenidate and children with attention deficit disorder. Archives of General Psychiatry, 42, 941–952.

    Google Scholar 

  • Perry, R., Pataki, C., Munoz-SIlva, D. M., Armenteros, J., & Silva, R. R. (1997). Risperidone in children and adolescents with pervasive developmental disorder: Pilot trial and follow-up. Journal of Child and Adolescent Psychopharmacology, 7(3), 167–179.

    Google Scholar 

  • Psychopharmacology Bulletin. (1985). Special feature: Rating scales and assessment instruments for use in pediatric psychopharmacology research. Psychopharmacology Bulletin, 21(4).

  • Rapoport, J., Connors, C., & Reatig, N. (1985). Rating scales and assessment instruments for use in pediatric psychopharmacology research. Psychopharmacology Bulletin, 21, 713–1111.

    Google Scholar 

  • Robbins, T. W., & Sahakian, B. J. (1994). Computer methods of assessment of cognitive function. In J. R. M. Copeland, M. T. Abou-Saleh, & D. G. Blazer (Eds.), Principles and practice of geriatric psychiatry (pp. 205–209). Chichester: Wiley.

    Google Scholar 

  • Roid, ??. & Miller, ??. (1997). Leiter International Test of Intelligence-Revised. Dale, IL: Stoeling.

    Google Scholar 

  • Sanchez, L. E., Adams, P. B., Uysal, S., Hallin, A., Campbell, M., & Small, A. M. (1985). A comparison of live and videotape ratings: Clomipramine and haloperidol in autism. Psychopharmacology Bulletin, 31, 371–378.

    Google Scholar 

  • Scahill, L., Riddle, M. A., McSwiggin-Hardin, M., Ort, S. I., et al. (1997). Children's Yale-Brown Obsessive Compulsive Scale: Reliability and validity. Journal of the American Academy of Child and Adolescent Psychiatry, 36, 844–852.

    Google Scholar 

  • Scahill L., et al. (2000). Autism RUPP Network randomized clinical trial of risperidone: Design and methodological challenges. In preparation.

  • Simpson, G. M., & Angus, J. W. (1970). A rating scale for extrapyramidal side effects. Acta Psychiatrica Scandinavica, 212, 11–19.

    Google Scholar 

  • Sparrow, S., Balla, D., & Cicchetti, D. (1984). Vineland Adaptive Behavior Scales: Interview Edition survey form. Circle Pines, MN: American Guidance Service.

    Google Scholar 

  • Steffenburg, S., Gillberg, C., Hellgren, L., Anderson, L., Gillberg, I., Iakobsson, G., et al. (1989). A twin study of autism in Denmark, Finland, Iceland, Norway, and Sweden. Journal of Psychology and Psychiatry, 30, 405–416.

    Google Scholar 

  • Szatmari, P. (1999). Heterogeneity and the genetics of autism. Journal of Psychiatry and Neuroscience, 24, 159–165.

    Google Scholar 

  • Tecott, L. H., Sun, L. M., Akana, S. F., et al. (1995). Eating disorder and epilepsy in mice lacking the 5-HT-sub(2c) serotonin receptors. Nature, 374, 542–546.

    Google Scholar 

  • Terman, L. M., & Merril, M. A. (1982). Stanford-Binet Intelligence Scale-Form L-M. (4th ed.). Boston: Houghton Mifflin.

    Google Scholar 

  • Volkmar, F., & Nelson, I. (1990). Seizure disorder in autism. Journal of the American Academy of Child and Adolescent Psychiatry, 29, 127–129.

    Google Scholar 

  • Wechsler, D. (1991). Weschler Intelligence Scale for Children (3rd ed.) San Antonio, TX: Psychological Corp.

    Google Scholar 

  • Wirshing, D. A., Marder, S., Goldstein, D., & Wirshing, W. C. (1997).Novel antipsychotics: Comparison of weight gain liabilities. Scientific Abstracts of the American College of Neuropsychopharmacology, 36th Annual Meeting, Waikoloa, HI, p 184.

  • World Health Organization. (1993). International classification of diseases: Diagnostic criteria for research (10th ed.). Geneva: Author.

    Google Scholar 

Download references

Authors
  1. L. Eugene Arnold
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Michael G. Aman
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Andres Martin
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Angie Collier-Crespin
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Benedetto Vitiello
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Elaine Tierney
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Robert Asarnow
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Felicia Bell-Bradshaw
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Betty Jo Freeman
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Patricia Gates-Ulanet
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Ami Klin
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. James T. McCracken
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Christopher J. McDougle
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. James J. McGough
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. David J. Posey
    View author publications

    You can also search for this author in PubMed Google Scholar

  16. Lawrence Scahill
    View author publications

    You can also search for this author in PubMed Google Scholar

  17. Naomi B. Swiezy
    View author publications

    You can also search for this author in PubMed Google Scholar

  18. Louise Ritz
    View author publications

    You can also search for this author in PubMed Google Scholar

  19. Fred Vokmar
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Arnold, L.E., Aman, M.G., Martin, A. et al. Assessment in Multisite Randomized Clinical Trials of Patients with Autistic Disorder: The Autism RUPP Network. J Autism Dev Disord 30, 99–111 (2000). https://doi.org/10.1023/A:1005451304303

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1005451304303

Search

Navigation