Abstract
Assessment of autistic disorder (autism) symptoms, primary and secondary, poses more challenging problems than ordinarily found in multisite randomized clinical trial (RCT) assessments. For example, subjects may be uncommunicative and extremely heterogeneous in problem presentation, and current pharmacological treatments are not likely to alter most core features of autism. The Autism Research Units on Pediatric Psychopharmacology (RUPP Autism Network) resolved some of these problems during the design of a risperidone RCT in children/adolescents. The inappropriateness of the usual anchors for a Clinical Global Impression of Severity (CGI-S) was resolved by defining uncomplicated autism without secondary symptoms as a CGI-S of 3, mildly ill. The communication problems, compromising use of the patient as an informant, were addressed by several strategies, including careful questioning of care providers, rating scales, laboratory tests, and physical exams. The broad subject heterogeneity requires outcome measures sensitive to individual change over a wide spectrum of treatment response and side effects. The problems of neuropsychologically testing nonverbal, lower functioning, sometimes noncompliant subjects requires careful instrument selection/adaptation and flexible administration techniques. The problems of assessing low-end IQs, neglected by most standardized test developers, was resolved by an algorithm of test hierarchy. Scarcity of other autism-adapted cognitive and neuropsychological tests and lack of standardization required development of a new, specially adapted battery. Reliability on the Autism Diagnostic Interview (currently the most valid diagnostic instrument) and other clinician instruments required extensive cross-site training (in-person, videotape, and teleconference sessions). Definition of a treatment responder required focus on individually relevant target symptoms, synthesis of possible modest improvements in many domains, and acceptance of attainable though imperfect goals. The assessment strategy developed is implemented in a RCT of risperidone (McDougle et al., 2000) for which the design and other methodological challenges are described elsewhere (Scahill et al., 2000). Some of these problems and solutions are partially shared with RCTs of other treatments and other disorders.
Similar content being viewed by others
REFERENCES
Alpherts, W., & Aldenkamp, B. (1997, December 4). FePsy, a neuropsychological computerized battery [On line]. Available: http://www.euronet.nl/users/fepsy.
Alpherts, W., & Aldenkamp, A. P. (1990). Computerized neuropsychological assessment of cognitive fuctioning in children with epilepsy. Epilepsia, 31 (Suppl. 4), S35-S40.
Allison, D., Mentore, J., Heo, M., Weiden, P., Cappelleri, J., & Chandler, L. (1998). Weight gain associated with conventional and newer antipsychotics (poster). Scientific Procedings of the American Psychiatric Association's Annual Meeting, Toronto, Ontario, NR 497.
Aman, M. G. (1996). Stimulant drugs in the developmental disabilities revisited. Journal of Developmental and Physical Disabilities, 8, 347–365.
Aman, M. G., Marks, R. E., Turbott, S. H., Wilsher, C. P., & Werry, S. N. (1991). Methylphenidate and thioridazine in the treatment of intellectually subaverage children: Effects on cognitive-motor performance. Journal of the American Academy of Child and Adolescent Psychiatry, 30, 816–824.
Aman, M. G., Singh, N. N., Stewart, A. W., & Field, C. J. (1985). The Aberrant Behavior Checklist: A behavior rating scale for the assessment of treatment effects. American Journal of Mental Deficiency, 89, 485–491.
Aman, M. G., & Turbott, S. H. (1986). Incidental Learning, Distraction, and Sustained Attention in Hyperactive and Control Subjects. Journal of Abnormal Child Psychology, 14, 441–445.
American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.
Amery, W., Zuiderwijk, P., Brecher, M., Lemmens, P., & Van Baelen, B. (1997). Safety profile of risperidone. Scientific Abstracts of the American College of Neuropsychopharmacology 36th Annual Meeting. Waikoloa, HI, p 188.
Anderson, G. M., Freedman, D. X., Cohen, D. J., Volkmar, F. R., Hoder, E. L., & McPhedran, P. (1987). Whole blood serotonin in autistic an normal subjects. Journal of Child Psychology and Psychiatry, 28, 885–900
Ando, H., & Yoshimura, I. (1979). Effects of age or communication skill levels and prevalence of maladaptive behaviors in autistic and mentally retarded children. Journal of Autism and Developmental Disorders, 9, 83–93.
Bailey, A., Bolton, P., Butler, L., Le Couteur, A., Murphy, M., Scott, S., Webb, T., & Rutter, M. (1993). Prevalence of fragile XS anomaly amongst autistic twins and singletons. Journal of Child Psychology and Psychiatry, 34, 673–688.
Bailey, A., Le Couteur, A., Gottesman, I., and Bolton, P. (1995). Autism as a strongly genetic disorder: Evidence from a British twin study. Psychological Medicine, 25, 63–77.
Barkley, R. A. (1991). The ecological validity of laboratory and analogue assessment methods of ADHD symptoms. Journal of Abnormal Child Psychiatry 19:149–178.
Barnes, T. R., & McPhillips, M. A. (1998). Novel antipsychotics, extrapyramidal side effects and tardive dyskinesia. International Clinical Psychopharmacology 13 (Suppl. 3), S49–57.
Benvenga, M. J., & Leander, J. D. (1997). Increased food consumption by clozapine, but not by olanzapine, in satiated rats. Drug Development Research, 41, 48–50.
Bromel, T., Blum, W. F., Ziegler, A., et al. (1998). Serum leptin levels increase rapidly after initiation of clozapine therapy. Molecular Psychiatry, 3(1), 76–80.
Campbell, M., & Palij, M. (1985). Behavioral and cognitive measures used in psychopharmacological studies of infantile autism. Psychopharmacology Bulletin, 21, 1047–1053.
Campbell, M., Anderson, L. T., Small, A. M., Adams, P., Gonzales, N. M., & Ernst, M. (1993). Naltrexone in autistic children: Behavioral symptoms and attentional learning. Journal of the American Academy of Child and Adolescent Psychiatry, 32, 1283–1291.
Delis, C., Kramer, J., Kaplan, E., & Ober, B. (1994). California verbal learning test manual. The San Antonio, TX: Psychological Corp.
Douglas, V. I., Barr, R. G., O'Neill, M. E., et al. (1986). Short term effects of methylphenidate on the cognition, learning and acedemic performance of children with attention deficit disorder in the laboratory and the classroom. Journal of Child Psychology and Psychiatry, 27, 191–211.
Dunn, L. M., & Dunn, L. M. (1981). Peabody Picture Vocabulary Test-Revised. Circle Pines, MN: American Guidance Service.
Feldman, H. M., Kolmen, B. K., & Gonzaga, A. M. (1999). Naltrexone and communication skills in young children with autism. Journal of the American Academy of Child and Adolescent Psychiatry, 38, 587–93
Fisch, G. S. (1992). Is autism associated with the fragile X syndrome? American Journal of Medical Genetics, 43, 47–55.
Folstein, S., & Rutter, M. (1977). Infantile autism: a genetic study of 21 twin pairs. Journal of Child Psychology and Psychiatry, 18, 297–321
Fray, P. J., Robbins, T. W., & Sahakian, B. J. (1996). Neuropsychiatric applications of CANTAB (University of Canterbury). International Journal of Geriatric Psychiatry, 11, 329–336.
Freeman, B. J., Ritvo, E. R., Needleman, R., & Yokota A. (1985a). The stability of cognitive and linguistic parameters in autism: A 5-year study. Journal of the American Academy of Child and Adolescent Psychiatry, 24, 459–464.
Freeman, B. J., Ritvo, E. R., Yokota, A., & Ritvo, A. (1985b): A scale of rating symptoms of patients with the syndrome of autism in real life settings. Journal of the American Academy of Child and Adolescent Psychiatry, 25, 130–136.
Geldmacher, D. S. (1998). Stimulus characteristics determine processing approach on random array letter-cancellation tasks. Brain & Cognition, 36, 346–354.
Griffin, J. C., Williams, D. E., Stark, M. T., Altmeyer, B. K., & Mason, M. (1986). Self-injurious behavior: A state-wide prevalence survey of the extent and circumstances. Applied Research in Mental Retardation, 7, 105–116.
Handen, B. L., Breaux, A. M., Gosling, A., et al. (1990). Efficacy of ritalin among mentally retarded children with ADHD. Pediatrics, 86, 922–930.
Kaufman, A. S., Kaufman, N. L. (1983). K-ABC: Kaufman Assessment Battery for Children. Circle Pines, MN, American Guidance Service.
Keefe, R. S. E., Lees-Roitman, S. E., & Dupre, R. L. (1997). Performance of patients with schizophrenia on a pen and paper visuospatial working memory task with short delay. Schizophrenia Research, 26(1), 9–14.
Kelly., D. L., Conley, R. R., Love, R. C., Shorn, D. S., & Uschak, C. M. (1998). Weight gain in adolescents treated with risperidone and conventional antipsychotics over six months. Journal of Child and Adolescent Psychopharmacology, 8(3), 151–159
Kumra, S., Herion, D., Jacobsen, L., Briguglia, C., & Grothe, D. (1997): Case study: Risperidone-induced hepatotoxicity in pediatric patients. Journal of the American Academy of Child and Adolescent Psychiatry, 36, 701–705.
Leadbetter, R., Shutty, M., Pavalonis, D., Viewveg, V., Higgins, P., & Downs, M. (1992). Clozapine-induced weight gain: Prevalence and clinical incidence. American Journal of Psychiatry, 149, 68–72.
Le Couteur, A., M. Rutter, Lord, C., Rics, P., Robertsen, S., Holdgrafer, & McLennan, J. (1989). Autism diagnostic interview: A standardized investigator-based instrument. Journal of Autism and Developmental Disorders, 19; 363–387.
Lezak, M. D. (1995). Neuropsychological assessment (3rd ed.). New York: Oxford University Press.
Lord, C. (1995). Follow-up of two-year-olds referred for possible autism. Journal of Child Psychology and Psychiatry, 36, 1365–1382.
Lord, C., Rutter, M., G??de, S., He??msbergen, J., Jordan, H., Manhood, L., and S??h??pler, E. (1989). Autism Diagnostic Observation Schedule: A standardized observation of communicative and social behavior. Journal of Autism and Developmental Disorders, 19, 185–212.
Lord, C., Rutter, M., & Le Couteur, A. M. (1994). Autism Diagnostic Interview-Revised: A revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. Journal of Autism and Developmental Disorders, 24, 659–685.
Lord, C., Pickles, A., McLennan, J., Rutter, M., Bregman, J., Folstein, S., Fombonne, E., Leboyer, M., & Minshew N. (1997). Diagnosing autism: Analyses of data from the Autism Diagnostic Interview. Journal of Autism and Developmental Disorders, 27, 501–517.
Mahoney, W. J., Szatmari, P., MacLean, J. E., Bryson, S. E., Bartolucci, G., Walter, S. D., Jones, M. B., & Zwaigenbaum, L. (1998). Reliability and accuracy of differentiating pervasive developmental disorder subtypes. Journal of the American Academy of Child and Adolescent Psychiatry, 37, 278–285.
McDougle, C. J., Scahill, L., McCracken, J. T., Aman, M. G., Tierney, E., Arnold, L. E., Freeman, B. J., Martin, A., McGough, J. J., Cronin, P., Posey, D. J., Riddle, M. A., Ritz, L., Swiezy, N. B., Vitiello, B., Volkmar, F. R., Votolato, N. A., & Walson, P. (2000). Research Units on Pediatric Psychopharmacology (RUPP)-Autism network: Background and rationale for an initial controlled study of risperidone. Child and Adolescent Psychiatric Clinics of North America, 9(1):201–224.
McDougle, C., Holmes, J., Bronson, M., Anderson, G., Volkmar, F., Price, L., & Cohen, D. (1997). Risperidone treatment of children and adolescents with pervasive developmental disorders: A prospective, open-label study. Journal of the American Academy of Child and Adolescent Psychiatry, 36, 685–693.
McDougle, C. J., Holmes, J. P., Carlson, D. C., Pelton, G. H., Cohen, D. J., & Price, L. H. (1998). A double-blind, placebo-controlled study of risperidone in adults with autistic disorder and other pervasive developmental disorders. Archives of General Psychiatry, 55, 633–641
McDougle, C. J., Naylor, S. T., Cohen, D. J., Volkmar, F. R., Heninger, G. R., & Price, L. (1996). A double-blind, placebocontrolled study of fluvoxamine in adults with autistic disorder. Archives of General Psychiatry, 53, 1001–1008.
Minshew, N. (1991). Indices of neuronal function in autism: clinical and biological implications. Pediatrics, 31, 774–780.
Mullen, E. M. (1995). Mullen Scales of Early Learning. Circle Pines, MN: American Guidance Service.
Pelham, W. E., Bender, M. E., Caddell, J., et al. (1985). Methylphenidate and children with attention deficit disorder. Archives of General Psychiatry, 42, 941–952.
Perry, R., Pataki, C., Munoz-SIlva, D. M., Armenteros, J., & Silva, R. R. (1997). Risperidone in children and adolescents with pervasive developmental disorder: Pilot trial and follow-up. Journal of Child and Adolescent Psychopharmacology, 7(3), 167–179.
Psychopharmacology Bulletin. (1985). Special feature: Rating scales and assessment instruments for use in pediatric psychopharmacology research. Psychopharmacology Bulletin, 21(4).
Rapoport, J., Connors, C., & Reatig, N. (1985). Rating scales and assessment instruments for use in pediatric psychopharmacology research. Psychopharmacology Bulletin, 21, 713–1111.
Robbins, T. W., & Sahakian, B. J. (1994). Computer methods of assessment of cognitive function. In J. R. M. Copeland, M. T. Abou-Saleh, & D. G. Blazer (Eds.), Principles and practice of geriatric psychiatry (pp. 205–209). Chichester: Wiley.
Roid, ??. & Miller, ??. (1997). Leiter International Test of Intelligence-Revised. Dale, IL: Stoeling.
Sanchez, L. E., Adams, P. B., Uysal, S., Hallin, A., Campbell, M., & Small, A. M. (1985). A comparison of live and videotape ratings: Clomipramine and haloperidol in autism. Psychopharmacology Bulletin, 31, 371–378.
Scahill, L., Riddle, M. A., McSwiggin-Hardin, M., Ort, S. I., et al. (1997). Children's Yale-Brown Obsessive Compulsive Scale: Reliability and validity. Journal of the American Academy of Child and Adolescent Psychiatry, 36, 844–852.
Scahill L., et al. (2000). Autism RUPP Network randomized clinical trial of risperidone: Design and methodological challenges. In preparation.
Simpson, G. M., & Angus, J. W. (1970). A rating scale for extrapyramidal side effects. Acta Psychiatrica Scandinavica, 212, 11–19.
Sparrow, S., Balla, D., & Cicchetti, D. (1984). Vineland Adaptive Behavior Scales: Interview Edition survey form. Circle Pines, MN: American Guidance Service.
Steffenburg, S., Gillberg, C., Hellgren, L., Anderson, L., Gillberg, I., Iakobsson, G., et al. (1989). A twin study of autism in Denmark, Finland, Iceland, Norway, and Sweden. Journal of Psychology and Psychiatry, 30, 405–416.
Szatmari, P. (1999). Heterogeneity and the genetics of autism. Journal of Psychiatry and Neuroscience, 24, 159–165.
Tecott, L. H., Sun, L. M., Akana, S. F., et al. (1995). Eating disorder and epilepsy in mice lacking the 5-HT-sub(2c) serotonin receptors. Nature, 374, 542–546.
Terman, L. M., & Merril, M. A. (1982). Stanford-Binet Intelligence Scale-Form L-M. (4th ed.). Boston: Houghton Mifflin.
Volkmar, F., & Nelson, I. (1990). Seizure disorder in autism. Journal of the American Academy of Child and Adolescent Psychiatry, 29, 127–129.
Wechsler, D. (1991). Weschler Intelligence Scale for Children (3rd ed.) San Antonio, TX: Psychological Corp.
Wirshing, D. A., Marder, S., Goldstein, D., & Wirshing, W. C. (1997).Novel antipsychotics: Comparison of weight gain liabilities. Scientific Abstracts of the American College of Neuropsychopharmacology, 36th Annual Meeting, Waikoloa, HI, p 184.
World Health Organization. (1993). International classification of diseases: Diagnostic criteria for research (10th ed.). Geneva: Author.
Rights and permissions
About this article
Cite this article
Arnold, L.E., Aman, M.G., Martin, A. et al. Assessment in Multisite Randomized Clinical Trials of Patients with Autistic Disorder: The Autism RUPP Network. J Autism Dev Disord 30, 99–111 (2000). https://doi.org/10.1023/A:1005451304303
Issue Date:
DOI: https://doi.org/10.1023/A:1005451304303