Hostname: page-component-54dcc4c588-9xpg2 Total loading time: 0 Render date: 2025-10-04T14:57:39.048Z Has data issue: false hasContentIssue false

Creating a Community Resource for Neuropsychological Assessments After a Lead Exposure: Process and Findings

Published online by Cambridge University Press:  30 September 2025

Diana K. Haggerty
Affiliation:
Charles Stewart Mott Department of Public Health, https://ror.org/05hs6h993 Michigan State University College of Human Medicine , Flint, MI, USA https://ror.org/05hs6h993 Michigan State University–Hurley Children’s Hospital Pediatric Public Health Initiative , Flint, MI, USA
Shuting Zheng
Affiliation:
Department of Psychiatry and Behavioral Sciences, https://ror.org/043mz5j54 University of California, San Francisco , San Francisco, CA, USA
Lauren M. Tompkins
Affiliation:
Genesee Health System Center for Children’s Integrated Services Assessment Center, Flint, MI, USA
Eric D. Finegood
Affiliation:
Charles Stewart Mott Department of Public Health, https://ror.org/05hs6h993 Michigan State University College of Human Medicine , Flint, MI, USA https://ror.org/05hs6h993 Michigan State University–Hurley Children’s Hospital Pediatric Public Health Initiative , Flint, MI, USA
Jasmine Hall
Affiliation:
Charles Stewart Mott Department of Public Health, https://ror.org/05hs6h993 Michigan State University College of Human Medicine , Flint, MI, USA https://ror.org/05hs6h993 Michigan State University–Hurley Children’s Hospital Pediatric Public Health Initiative , Flint, MI, USA Now with Michigan Department of Health and Human Services, Lansing, MI, USA
Nicole Jones*
Affiliation:
Charles Stewart Mott Department of Public Health, https://ror.org/05hs6h993 Michigan State University College of Human Medicine , Flint, MI, USA https://ror.org/05hs6h993 Michigan State University–Hurley Children’s Hospital Pediatric Public Health Initiative , Flint, MI, USA Department of Pediatrics and Human Development, https://ror.org/05hs6h993 Michigan State University College of Human Medicine , Flint, MI, USA
Mona Hanna
Affiliation:
Charles Stewart Mott Department of Public Health, https://ror.org/05hs6h993 Michigan State University College of Human Medicine , Flint, MI, USA https://ror.org/05hs6h993 Michigan State University–Hurley Children’s Hospital Pediatric Public Health Initiative , Flint, MI, USA Department of Pediatrics and Human Development, https://ror.org/05hs6h993 Michigan State University College of Human Medicine , Flint, MI, USA
*
Corresponding author: Nicole Jones; Email: warnerni@msu.edu
Rights & Permissions [Opens in a new window]

Abstract

The Flint water crisis was a lead-in-water disaster that occurred in Flint, Michigan. The Center for Children’s Integrated Services Assessment Center (CISAC) was established to provide neuropsychological assessments and recommendations for exposed children. Our objective was to describe the implementation of the CISAC and report the clinical diagnoses of the first cohort of children who received comprehensive assessments. The CISAC’s eligibility criteria were broad and allowed referrals from physicians, schools, community organizations, and parents. A cross-sectional, descriptive analysis was conducted for 376 children who received initial neurodevelopmental assessments. About 60% of assessed children (ages 3-18) were diagnosed with ADHD, and 70% were diagnosed with ≥2 conditions. Most (96.8%) children received recommendations for new or continued educational, medical, and mental health services. Recognizing the implications of lead exposure and community-wide trauma on neuropsychological trajectories, the CISAC provides longitudinal assessments, secondary prevention efforts to mitigate potential sequelae, and trauma-informed treatment.

Information

Type
Concepts in Disaster Medicine
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2025. Published by Cambridge University Press on behalf of Society for Disaster Medicine and Public Health, Inc

Introduction

Between April 2014 and October 2015, 100,000 residents of the City of Flint, Michigan, experienced a manmade environmental disaster known as the Flint water crisis (FWC). Leading to the crisis, the City of Flint was experiencing loss of revenue and significant financial distress and was placed under emergency financial management by the State of Michigan under the controversial Local Financial Stability and Choice Act. 1 In order to save costs, the emergency manager switched the City of Flint water source from pretreated Great Lakes water to locally treated Flint River water. 2 The local treatment facility was ill-prepared and failed to include adequate corrosion control, resulting in the leaching of lead into residents’ tap water.Reference Pieper, Tang and Edwards 3 After a demonstration of an increase in blood lead levels in children,Reference Hanna-Attisha, LaChance and Sadler 4 a state of emergency was declared first by the city of Flint (December 2015), then by the State of Michigan (January 2016), and then by the federal government.Reference Ruckart, Ettinger and Hanna-Attisha 5 The FWC, a population-wide lead-in-water public health emergency and community-level trauma, occurred atop long-standing socioeconomic and racial inequities that also implicated the health and development of Flint children. A 2016 task force report categorized the FWC as an environmental injustice which was prolonged due to a disregard for evidence of water quality problems and a repeated failure to respond to citizen concerns. 1

Flint is a city with notable economic challenges, including an estimated poverty rate of 34.4% and a shrinking population. 6 In addition to these challenges, the FWC can be characterized as a prolonged, collective traumatic disaster for Flint,Reference Parker and Johnson-Lawrence 7 and it exposed children to lead, a known neurotoxicant.Reference Hanna-Attisha, LaChance and Sadler 4 Both lead and trauma exposures are associated with neuropsychological and cognitive challenges in children. The Agency for Toxic Substances and Disease Registry’s 2020 monograph on lead includes a comprehensive literature review on the health effects of lead exposure with a particular focus on child development, 8 and the National Toxicology Program has found sufficient evidence to implicate lead exposure in problems with child development, especially for cognition, attention, and behavior. 9 The Human Early-Life Exposome project, comprised of 6 European population-based birth cohorts, identified lead as an early childhood exposure associated with attention-deficit/hyperactivity disorder (ADHD).Reference Maitre, Julvez and López-Vicente 10 Exposure to adversity and traumatic experiences during childhood are associated with deficits in children’s executive functionReference Johnson, Policelli and Li 11 as well as low academic achievement and mental health problems in school-aged children.Reference Larson, Chapman and Spetz 12 Disasters that result in trauma are associated with long-term neuropsychological consequences for children. Human-made disasters, such as the fireworks explosion in Enschede, Netherlands, and the Boston Marathon bombings, have been associated with developmental challenges including hyperactivity and inattentionReference Boer, Smit and Morren 13 and conduct problems.Reference Crum, Cornacchio and Coxe 14 In Flint, post-water-switch education data identified declines in math achievement and increases in special education needs for the children, regardless of water service line type, which suggests that the mechanisms of injury caused by the FWC extend beyond the lead exposure.Reference Trejo, Yeomans-Maldonado and Jacob 15 The necessity of community-based resources for mental health after a disaster is well established;Reference Norris, Friedman and Watson 16 however, disasters like the FWC give rise to a need for community-accessible neuropsychological evaluation and follow-up for children exposed to a crisis.

Limitations in the capacity for the Flint Community School District to accommodate children with special education needs prior to the FWC and concerns the Flint Community Schools and Michigan Department of Education had not expanded screening and services for FWC-exposed children 17 prompted the development of a local, no-cost assessment resource to provide early identification of potential neuropsychological and behavioral problems for children exposed to the FWC. Our objective was to describe the community resource created to administer neuropsychological assessment to FWC-exposed children and to report clinical findings from the first cohort of assessed children.

Methods

Setting

The Genesee Health System Center for Children’s Integrated Services Assessment Center

In 2018, Genesee Health System (GHS)—the county mental health agency—received start-up funds from the State of Michigan as part of an American Civil Liberties Union lawsuit settlement agreement (civil action known as “D.R., et al. v. Michigan Department of Education” for systemically failing to provide ongoing screening and timely referrals for evaluations to identify students eligible for special education services pursuant to Individuals with Disabilities Education Act’s child find mandate) to rectify the insufficiency of the current neuropsychological assessment capacity and enhance it to support the children exposed to the FWC. 18 Located in Flint, Michigan, and primarily funded through Medicaid, GHS is the public community mental health entity responsible for providing specialized, intensive behavioral health services for residents of Flint and Genesee County. The existing GHS neuropsychological assessment center had historically provided autism and fetal alcohol spectrum disorder evaluations. These services were expanded through the settlement funding, and by January 2019, nearly 5 years after the onset of the FWC, the GHS Center for Children’s Integrated Services Assessment Center (CISAC; formerly known as The Neurodevelopmental Center of Excellence) was operational as a comprehensive clinical neuropsychological assessment center for children exposed to the FWC.

Eligibility criteria for CISAC services, determined by the settlement, included children ages 3 to 21 years of age who lived, attended school or day care, or worked in any geographical area serviced by the Flint water supply between April 2014 and September 2021, and who had not yet graduated from high school. Children who met these criteria but had subsequently moved out of the area were also eligible through a waiver process. Between 5 and 12% of blood lead tests among young Flint children exceeded the United States Centers for Disease Control and Prevention blood lead reference level during the water switch;Reference Hanna-Attisha, LaChance and Sadler 4 , Reference Kennedy 19 , Reference Zahran, McElmurry and Sadler 20 however, the extent of lead exposure in Flint that resulted from the FWC was unclear. 1 With no established threshold of safe exposure to lead 8 and the community-wide traumatic experience of the water crisis,Reference Parker and Johnson-Lawrence 7 the CISAC determined their services should be made widely available and estimated that about 10,000 children were potentially eligible for assessment. Patients were referred to the CISAC through multiple channels, including other GHS health services, primary care physicians and specialists, behavioral health professionals, schools, and family self-referral; families could receive referrals from more than one source. Community outreach and media-facilitated communications promoted the availability of this no-cost community resource. Hundreds of referrals were also received from the Centers for Disease Control and Prevention–supported Flint Registry as part of its public health surveillance and support process in response to the FWC.Reference Ruckart, Ettinger and Hanna-Attisha 5 The variety of referral sources and efforts to directly engage families through community outreach resulted in a large, community-referred sample of children assessed by the CISAC in the first 3 years of operation.

All referrals were responded to by phone or mail contact to confirm parent interest in proceeding with an evaluation and to determine eligibility. Children who met CISAC eligibility criteria were scheduled in the order their eligibility was determined. As Medicaid was the primary funding source for evaluations, active Medicaid verification took place, and for those without Medicaid, application support was provided if needed. School, medical, and mental health records were requested from each institution (e.g., schools, medical providers, and GHS).

Working with clinical, education, public health, and community partners while minimizing family and child assessment burden, the CISAC developed a flexible, comprehensive neuropsychological evaluation battery, with particular emphasis on assessing cognitive and neuropsychological functions known to be impacted by lead exposure, as well as academic achievement, adaptive skills and behaviors, and psychopathology. The assessment battery was administered in a structured and standardized manner and used standardized scoring methods. Overall, the battery was completed during one face-to-face session of 4 to 6 hours, with a feedback session scheduled following report writing. Simultaneous testing sessions were scheduled with multichild families when requested, and testing sessions were broken into multiple shorter sessions when needed to accommodate individual child tolerance challenges and parent schedules.

Although the expansion goal was to provide comprehensive neuropsychological evaluations within the shortest period of time possible to an estimated 10,000 children, it was not known how many children would present to complete the evaluation nor the extent of needed resources to meet the unknown demand. The CISAC relied on expansion staffing models which utilized both neuropsychologists and neuropsychologist-supervised technicians to complete assessments and connect families to services, thereby maximizing limited professional resources.Reference DeLuca and Putnam 21 All evaluations were completed in full or in part by licensed, doctoral-level psychologists with specialized training in pediatric neuropsychology. Neuropsychologist-supervised trained technicians completed administration of testing batteries when necessary. Community health workers were deployed to assist in navigating families to CISAC services and the educational, mental health, and medical resources recommended post-evaluation.

Assessment Battery

Neuropsychological assessments, which informed diagnoses and recommendations made by neuropsychologists, included both clinician-administered and, depending on patient age, parent- or child-reported measures covering five main constructs: global intellectual function, neuropsychological function, academic achievement, adaptive skills and behaviors, and psychopathology. Within each construct, selected tests measured relevant domains (see Table 1). Test instrument selection was clinically driven based on the child’s age and abilities.

Table 1. Constructs assessed by Center for Children’s Integrated Services Assessment Center (CISAC) test battery, associated measures, and source of information for each measure

Abbreviations: NEPSY, A Developmental NEuroPSYchological Assessment; ICD-10, International Classification of Diseases, Tenth Revision.

Children’s intellectual or neurodevelopmental functioning was assessed using one of the following standardized measures: Differential Abilities Scale-II-Early Years or DAS-II-School Age,Reference Dumont, Willis and Elliott 22 Wechsler Preschool and Primary Scale of Intelligence-IV,Reference Raiford and Coalson 23 Mullen Scales of Early Learning,Reference Bishop, Guthrie and Coffing 24 Wechsler Intelligence Scale for Children-V,Reference Kaufman, Raiford and Coalson 25 or Wechsler Adult Intelligence Scale-IV.Reference Weiss, Saklofske and Coalson 26 Children’s executive function and attention, language, and memory and learning were assessed using both the clinician-administered Developmental Neuropsychological Assessment-IIReference Brooks, Sherman and Iverson 27 and parent-report Behavior Rating Inventory of Executive Function-2 (BRIEF-2) or BRIEF-Preschool (P),Reference Gioia, Andrews and Isquith 28 , Reference Gioia, Isquith and Guy 29 depending on the child’s age. BRIEF-2 domains include a global composite executive function score and 3 subscales: behavioral regulation, emotional regulation, and cognitive regulation. The BRIEF-P includes a global composite executive function scale and 3 subscales: inhibitory self-control, flexibility, and emergent metacognition. Wechsler Individual Achievement Test-III/IVReference Breaux and Lichtenberger 30 was administered to gather broad-stroke evaluations of academic performances of school-aged children. Adaptive behaviors were measured using the Behavior Assessment System for Children, Third Edition (BASC-III)Reference Reynolds and Kamphaus 31 Adaptive Skills subscale or the Adaptive Behavior Assessment System, Third Edition,Reference Harrison and Oakland 32 which includes a global composite value of adaptive behavior and 3 subscales that measure conceptual, practical, and social adaptive behaviors. Psychopathology was measured using the BASC-III,Reference Reynolds and Kamphaus 31 which has subscales for externalizing symptoms, internalizing symptoms, and behavioral symptoms.

Child Demographics and History Variables

Child history and demographic data were extracted from the CISAC’s comprehensive neuropsychological reports, which included age at testing; child sex; history of special education or individualized education plan (IEP); history of one or more medical diagnoses or conditions which required hospitalization, surgery, or other substantial ongoing treatment; history of one or more mental health diagnoses and/or current or past involvement in behavioral or mental health treatment; and history of delays in one or more early developmental milestones. History variables were categorical and defined as yes, no, or unknown, and we reported frequencies of “yes” answers.

Clinical Diagnoses and Recommendations

Diagnoses were made by pediatric neuropsychologists according to criteria set by the Diagnostic and Statistical Manual of Mental Disorders – Version 5. 33 Clinical diagnoses were coded as International Classification of Diseases, tenth revision (ICD-10) diagnoses and organized into clinical categories and dichotomized into present or absent for each category (Table 2). Evaluation-based recommendations and instructions for accessing supports and services were detailed in the written report. Assessment results and recommendations were reviewed in a family feedback session and with consent, written reports are shared with educators and health care providers for purposes of postevaluation follow-up. Additionally, case management or navigator services were provided to coordinate access to recommended resources. The CISAC contacts families directly for continued neuropsychological follow-up. Recommendations for educational interventions, medical treatment, and mental health support were categorized as made, not made, and unknown.

Table 2. ICD-10 Codes used to classify diagnoses made by the Center for Children’s Integrated Services Assessment Center (CISAC) neuropsychologists

Abbreviation: ICD-10, International Classification of Diseases, Tenth Revision.

Sample

To highlight some of the efforts of the CISAC, we performed a cross-sectional, descriptive analysis of diagnoses and recommendations made for the first 376 children who were assessed by the CISAC in Flint, Michigan, from January 2019 through July 2021. Though children who were enrolled in school through the age of 21 were eligible for assessment, the initial cohort’s age range was 3-18 years old.

Statistical Analysis

We calculated frequencies (percentage) of diagnoses and recommendations made for evaluated children. Number of diagnoses made for each child was assessed by summing across the individual diagnoses and categorizing each child as having 0, 1, 2, or 3 or more diagnoses. We calculated median age (interquartile range) for each diagnosis, count of diagnoses, and recommendations. We analyzed data with SAS 9.4 (SAS Institute, Cary, NC) PROC MEANS and PROC FREQ.

Informed consent for CISAC clinical assessment data to be used for research was obtained during the GHS intake process. Michigan State University Institutional Review Board determined this analysis did not include human subjects because of the use of deidentified data.

Results

By October 2018, the CISAC started to evaluate a few children as part of a “soft opening” of GHS’s expanded services, and the CISAC was fully operational by January 2019. Initial referral volume was extremely heavy and by January 2022, 4,800 referrals had been received, of which approximately 9% had been completed. With a significant waitlist and a no-show rate of 44%, managing the valuable and limited assessment resources was a primary concern and resulted in increased phone, mail, and media-based outreach methods. As referrals were processed and outreach efforts proceeded, it was determined that a significant number of individuals were not interested in pursuing services or were unable to be reached. By 2023, assessment capacity was well aligned with service demand and wait times no longer presented a challenge.

By July of 2021, data shared by the CISAC but not available for analysis (L. Tompkins, personal communication) indicated that 54.4% of children had a reported race of Black and 72.2% of children were residing in Flint ZIP codes at the time of assessment, with 33.5% living in 2 ZIP codes that had notable overlap with the parts of Flint that experienced the highest probability of elevated blood lead levels during the switch.Reference Hanna-Attisha, LaChance and Sadler 4 , Reference Sadler 34

Analysis of the Initial Cohort (Assessed January 2019 through July 2021)

The median age of the 376 children assessed was 8.3 years (IQR: 5.8, 11.6), and 205 (54.5%) were male. Prior to CISAC assessment, 156 (41.5%) children had a history of early developmental milestone delay, 216 (57.4%) had historical educational recommendations, 111 (29.5%) had historical medical involvement, and 230 (61.2%) had existing mental health needs or support use.

Diagnoses

The most common diagnosis made after evaluation was ADHD (n = 220, 58.5%; Table 3). The median age of the children diagnosed with the specific conditions ranged from 6.1 years (IQR: 4.8, 8.0) for communication disorders to 11.9 years (IQR: 9.9, 14.4) for depression (Table 3). The most frequent mental health diagnoses were depression (n = 73, 19.4%) and post-traumatic stress disorder (n = 69, 18.4%). The majority of children were given 2 or more diagnoses (n = 262, 69.7%), and ADHD was a comorbid diagnosis for 201 (76.7%) of the children who had 2 or more diagnoses (Table 4).

Table 3. Frequencies of diagnoses and recommendations made to children evaluated by the Center for Children’s Integrated Services Assessment Center (CISAC) from January 2019-July 2021 (N = 376)

Abbreviation: Freq, frequency; q, quartile.

a There were 2 children whose recommendation status was unknown.

Table 4. Frequency of each diagnosis occurring as a diagnosis for children who had 2 or more diagnoses made during their assessment in the Center for Children’s Integrated Services Assessment Center (CISAC) (n = 262)

Treatment Recommendations

The majority of children received recommendations to obtain or continue using educational services (n = 337, 89.6%), medical services (n = 302, 80.3%), and mental health services (n = 315, 83.8%; Table 3). Many of the children who received recommendations for educational, medical, and mental health services had a history of using these services, though many children received recommendations for new services. For example, 131 (38.9%) received a new recommendation for educational services (Table 5).

Table 5. Cross-tabulations of historical recommendations and recommendations made after the Center for Children’s Integrated Services Assessment Center (CISAC) assessment

Discussion

These findings highlight how the Flint community was able to respond to an environmental disaster by expanding infrastructure to provide critical neuropsychological assessments for children. Recognizing the complex histories with which many of these children presented, CISAC evaluation outcomes emphasized a multifactor contribution (including developmental, trauma, social, and other factors) and did not make conclusions about specific causality in relation to outcomes. While other large-scale lead-in-drinking-water crises are occurring across the United States,Reference Mizelle 35 -Reference Tully, Schock and Shilling 37 the establishment of this type of community-based, city-wide resource after a water crisis is unique. Some of the challenges that had to be addressed included funding, sustainability, outreach and referral processes, developing an assessment battery, securing specially trained professional staffing resources, and partnering with community. In this case, initial start-up funding was established through a lawsuit on behalf of Flint children which relied upon educational law and funding from the State of Michigan. After the initial start-up, the center’s activities have been sustained through carve-out mental health Medicaid billing for assessment services. Additionally, a Centers for Medicare & Medicaid Services–approved Medicaid waiver for Flint greatly expanded income requirements and provided coverage to the majority of Flint’s children. 38 Long-standing partnerships with other agencies, establishment and deployment of a robust Flint-based outreach team, and multiple media and community partner educational presentations allowed an extensive number of referrals to come from community and expanded the population of children served. A significant amount of time was invested in developing a comprehensive assessment battery which was flexible across the full age span of impacted children. The sufficient and rapid securing of child-trained neuropsychology professionals presented one of the most significant challenges. Aggressive local and national recruitment efforts were made, and the use of an extender staffing model was implemented where supervised assistant-level staff were trained to conduct a portion of the testing. Still, initial service demand greatly exceeded available professional resources and because of the labor- and time-intensive training needed for extenders, this staffing model was considered to have been only partially successful in helping to meet the high and variable initial service demand.

Using cross-sectional data, we described diagnostic results from the first cohort of children. Notably, nearly 60% of children were diagnosed with ADHD and 70% were diagnosed with 2 or more conditions, demonstrating a high frequency of co-occurring conditions. Only 12% of children received no diagnoses. Recommendations were made to continue or initiate use of educational resources for about 90% of children, medical resources for 80% of children, and mental health resources for 84% of children. These results indicate that the CISAC evaluation services were reaching the children who most needed assessment for neuropsychological development in order to access educational, medical, and mental health services.

Interpretation

Among Flint children assessed by the CISAC, the frequency of ADHD diagnosis was 58.5%. Lead-exposed children have higher odds of hyperactivityReference Chandramouli, Steer and Ellis 39 and of ADHD,Reference Donzelli, Carducci and Llopis-Gonzalez 40 , Reference Froehlich, Lanphear and Auinger 41 although it is worth noting that the rate of 58.5% we observed in this sample is higher than other studies of lead-exposed children,Reference Froehlich, Lanphear and Auinger 41 , Reference Arbuckle, Davis and Boylan 42 possibly indicating the impact of lead exposure compounded by trauma and the multiple socioeconomic adversities faced by CISAC-evaluated Flint children. Especially because of the period of time after the water switch and the availability of start-up funding for the CISAC (3 years), our findings could indicate our sample represents children who were exhibiting challenges, were receiving school, medical, or mental health services that prompted referral for evaluation, or had parents and caregivers with ADHD that may have experienced more concern about their children’s behavior after the water switch and been more likely to seek evaluation for their children than parents and caregivers without.Reference Faraone, Bellgrove and Brikell 43 However, in the 2021-2022 school year, 23% of the Flint Community School District’s student population had documented disabilities, a full 10 percentage point higher frequency than the State of Michigan’s frequency, 44 indicating that the Flint schools’ children need expanded support with fewer resources as enrollment in the Flint Community School District declines. 44 Though we cannot evaluate the degree to which lead exposure or FWC-related trauma has impacted the children evaluated by the CISAC, our study demonstrates the importance of investing in the community-based center, as evidenced by the substantial need for school-based, medical, and mental health resources.

In our sample of children, about 19% were diagnosed with depression, 10% with anxiety, and 18% with post-traumatic stress disorder, which are higher than the prevalence of these conditions in the general population. In the United States, 3.8% of children had a diagnosis of depression and 8.5% had a diagnosis of anxiety in the 2018-2019 National Survey of Children’s Health. 45 Life-time prevalence of post-traumatic stress disorder among 9- and 10-year-olds in the United States was estimated to be about 2.8%.Reference Levin and Liu 46 Estimates of post-traumatic stress disorder among children by age 18 were estimated to be around 7.8% in an English and Welsh cohort.Reference Lewis, Arseneault and Caspi 47 Lead exposure has been associated with depression and anxiety in children.Reference Winter and Sampson 48 Moreover, exposure to stress and trauma in childhood is associated with a decreased ability to regulate emotion, a focus on negative thoughts,Reference Lubit, Rovine and Defrancisci 49 -Reference Vaughn-Coaxum, Wang and Kiely 52 as well as mental health disorders, including depression, anxiety, and post-traumatic stress disorder.Reference Larson, Chapman and Spetz 12 Evidence from FWC-exposed adults shows that the Flint population exposed to the FWC has persistent mental health challenges and unmet mental health treatment needs,Reference Reuben, Moreland and Abdalla 53 and our findings support the need for long-term follow-up of mental health for FWC-exposed children especially.

Limitations

There were some challenges with the CISAC protocol. Staffing resources and initially high and variable service demands resulted in long wait times between referral and service delivery. While wait time no longer presents as a challenge, it is considered to have been a barrier for children and families seeking these services. The comprehensive testing battery was long and required a substantial time commitment which may have limited completion of assessment for some children. To mitigate the long testing times, the CISAC offered flexible testing options when necessary. The validity of responses to the adult-reported questionnaires was evaluated by the testing psychologist and when reading comprehension was considered a potential problem, it was addressed by the CISAC staff. The assessment period presented herein was also complicated by the emergence of the COVID-19 pandemic, which required the CISAC to suspend assessment for about 6 months. Despite this disruption, the CISAC was able to evaluate almost 400 children during the first 3 years of operation.

When considering the diagnostic data, this study is not intended to be inclusive of the entire population of children exposed to the FWC and the results reflect a single instance of neuropsychological assessment. Ongoing monitoring is necessary to characterize the long-term neuropsychological consequences of the lead and trauma exposures resulting from the FWC and to capture potentially emerging sequelae.Reference Bellinger, Leviton and Waternaux 54 , Reference McMichael, Baghurst and Wigg 55 Although this sample was drawn from many referral sources, including parent and public health registry referrals, we are unable to determine the representativeness of the sample to the broader population of children due to privacy and data sharing restrictions. We were not able to abstract referral source, race and ethnicity, socioeconomic position, or place of residency for the children included in this study, and so we cannot evaluate the representativeness of this sample of children exposed to the FWC, and we lack a comparison group of unexposed children with comprehensive neuropsychological assessments.

FWC exposure was an eligibility criterion for CISAC assessment; however, the CISAC did not have access to individual water line type, drinking water consumption, or water or blood lead levels. Through August 2021, many of the children evaluated by the CISAC lived in Flint ZIP codes and especially 2 that had the highest risk of elevated blood levels,Reference Hanna-Attisha, LaChance and Sadler 4 , Reference Sadler 34 suggesting that recruitment strategies were reaching children most in need; however, this analysis cannot explain if or how lead or trauma exposure during the FWC and/or preexisting adversities impacted the evaluated children. It is important to note that ZIP codes represent the place children lived at the time of assessment, not the water switch, and that Flint ZIP codes do not align perfectly with the Flint municipal water system.Reference Sadler 34 The CISAC was one of many community services launched to respond to the FWC and we cannot tease apart the potentially mitigating impact of other robust secondary prevention interventions launched in Flint which may have limited deleterious developmental outcomes. These resources included trauma-informed services, nutrition assistance, Medicaid waivers, and the Flint Registry. We do not expect the children in this sample to be representative of the broader population exposed to the FWC, but this study demonstrates the implementation and utility of a community-accessible neuropsychological evaluation resource.

Conclusion

The FWC was a devastating environmental and public health disaster, exposing a population of predominantly poor and minority residents to a neurotoxin, as well as to the trauma of governmental indifference and negative national attention. While the deleterious impact of lead exposure is well known, community-accessible resources for robust clinical neuropsychological assessments of lead-exposed children are uncommon. This study highlights the necessity of free community-based neuropsychological and behavioral assessment after a public health crisis to support community recovery and underscores the critical need for investment in proactive community resources that support children’s educational, medical, and mental health needs. Current resources available to FWC-exposed individuals include the CISAC, expanded Medicaid eligibility, 38 the Flint Registry,Reference Ruckart, Ettinger and Hanna-Attisha 5 and improvements in the food network, childcare, and playgrounds. Ongoing and expanded secondary prevention resources to continue to prevent, identify, and support children with deficits are urgently needed.

Acknowledgments

The authors would like to thank Dr. Kenyetta Dotson for providing a community-engaged perspective on this manuscript.

Author contribution

DKH, SZ, LMT, EDF, JH, NJ, and MH conceptualized the manuscript. DKH, SZ, and JH analyzed data. DKH, LMT, and NJ drafted the manuscript. DKH, SZ, LMT, EDF, JH, NJ, and MH critically reviewed and edited the manuscript.

Funding statement

The Center for Children’s Integrated Services Assessment Center received start-up funds from the State of Michigan as part of an American Civil Liberties Union lawsuit settlement agreement. No external funding was secured for this study.

Competing interests

Dr. Mona Hanna is an author (What the Eyes Don’t See, Penguin Random House) and a speaker (Penguin Random House Speakers Bureau). She has also provided testimony during congressional hearings as a child health expert. The other authors have no conflicts of interest relevant to this article to disclose.

References

Flint Water Advisory Task Force. Flint Water Advisory Task Force Final Report. 2016. Accessed July 3, 2023. https://www.michigan.gov/-/media/Project/Websites/formergovernors/Folder6/FWATF_FINAL_REPORT_21March2016.pdf?rev=284b9e42c7c840019109eb73aaeedb68Google Scholar
Centers for Disease Control and Prevention. Childhood lead poisoning prevention: Flint lead exposure registry. November 3, 2021. Accessed May 8, 2023. https://www.cdc.gov/lead-prevention/success-stories-by-state/flint-lead-exposure-registry.htmlGoogle Scholar
Pieper, KJ, Tang, M, Edwards, MA. Flint water crisis caused by interrupted corrosion control: investigating “ground zero” home. Environ Sci Technol. 2017;51(4):20072014. doi:10.1021/acs.est.6b04034CrossRefGoogle ScholarPubMed
Hanna-Attisha, M, LaChance, J, Sadler, RC, et al. Elevated blood lead levels in children associated with the Flint drinking water crisis: a spatial analysis of risk and public health response. Am J Public Health. 2016;106(2):283290. doi:10.2105/AJPH.2015.303003CrossRefGoogle ScholarPubMed
Ruckart, PZ, Ettinger, AS, Hanna-Attisha, M, et al. The Flint water crisis: a coordinated public health emergency response and recovery initiative. J Public Health Manag Pract. 2019;25(Suppl 1 LEAD POISONING PREVENTION):S84S90. doi:10.1097/PHH.0000000000000871CrossRefGoogle ScholarPubMed
U.S. Census Bureau QuickFacts: Flint city, Michigan. Accessed November 15, 2022. https://www.census.gov/quickfacts/flintcitymichiganGoogle Scholar
Parker, S, Johnson-Lawrence, V. Addressing trauma-informed principles in public health through training and practice. Int J Environ Res Public Health. 2022;19(14):8437. doi:10.3390/ijerph19148437CrossRefGoogle ScholarPubMed
Agency for Toxic Substances and Disease Registry. Toxicological Profile for Lead. Published online 2020. doi:10.15620/cdc:95222CrossRefGoogle Scholar
National Toxicology Program, US Department of Health and Human Services. NTP Monograph: Health Effects of Low-Level Lead. 2012. Accessed July 27, 2023. https://ntp.niehs.nih.gov/sites/default/files/ntp/ohat/lead/final/monographhealtheffectslowlevellead_newissn_508.pdfGoogle Scholar
Maitre, L, Julvez, J, López-Vicente, M, et al. Early-life environmental exposure determinants of child behavior in Europe: a longitudinal, population-based study. Environ Int. 2021;153:106523. doi:10.1016/j.envint.2021.106523CrossRefGoogle ScholarPubMed
Johnson, D, Policelli, J, Li, M, et al. Associations of early-life threat and deprivation with executive functioning in childhood and adolescence: a systematic review and meta-analysis. JAMA Pediatr. 2021;175(11):e212511. doi:10.1001/jamapediatrics.2021.2511CrossRefGoogle ScholarPubMed
Larson, S, Chapman, S, Spetz, J, et al. Chronic childhood trauma, mental health, academic achievement, and school-based health center mental health services. J Sch Health. 2017;87(9):675686. doi:10.1111/josh.12541CrossRefGoogle Scholar
Boer, F, Smit, C, Morren, M, et al. Impact of a technological disaster on young children: a five-year postdisaster multiinformant study. J Trauma Stress. 2009;22(6):516524. doi:10.1002/jts.20461CrossRefGoogle Scholar
Crum, KI, Cornacchio, D, Coxe, S, et al. Conduct problems among Boston-area youth following the 2013 marathon bombing: the moderating role of prior violent crime exposure. J Clin Child Adolesc Psychol. 2017;46(3):343352. doi:10.1080/15374416.2015.1077450CrossRefGoogle ScholarPubMed
Trejo, S, Yeomans-Maldonado, G, Jacob, B. The effects of the Flint water crisis on the educational outcomes of school-age children. Sci Adv. 2024;10(11):eadk4737. doi:10.1126/sciadv.adk4737CrossRefGoogle ScholarPubMed
Norris, FH, Friedman, MJ, Watson, PJ. 60,000 disaster victims speak: part II. Summary and implications of the disaster mental health research. Psychiatry. 2002;65(3):240260. doi:10.1521/psyc.65.3.240.20169CrossRefGoogle ScholarPubMed
ACLU of Michigan. D.R. v. Michigan Department of Education Class Action Final Complaint. (Eastern District of Michigan). Accessed May 20, 2025. https://live-aclu-michigan.pantheonsite.io/sites/default/files/Flint_Schools_Final_Complaint.pdfGoogle Scholar
Kennedy, C. Blood lead levels among children aged <6 years — Flint, Michigan, 2013–2016. MMWR Morb Mortal Wkly Rep. 2016;65. doi:10.15585/mmwr.mm6525e1CrossRefGoogle ScholarPubMed
Zahran, S, McElmurry, SP, Sadler, RC. Four phases of the Flint water crisis: evidence from blood lead levels in children. Environ Res. 2017;157:160172. doi:10.1016/j.envres.2017.05.028CrossRefGoogle ScholarPubMed
DeLuca, JW, Putnam, SH. The professional/technician model in clinical neuropsychology: deployment characteristics and practice issues. Prof Psychol Res Pr. 1993;24(1):100106. doi:10.1037/0735-7028.24.1.100CrossRefGoogle Scholar
Dumont, R, Willis, JO, Elliott, CD. Essentials of DAS-II Assessment. John Wiley & Sons; 2008.Google Scholar
Raiford, SE, Coalson, DL. Essentials of WPPSI-IV Assessment. John Wiley & Sons; 2014.10.1002/9781394260652CrossRefGoogle Scholar
Bishop, SL, Guthrie, W, Coffing, M, et al. Convergent validity of the Mullen Scales of Early Learning and the Differential Ability Scales in children with autism spectrum disorders. Am J Intellect Dev Disabil. 2011;116(5):331343. doi:10.1352/1944-7558-116.5.331CrossRefGoogle ScholarPubMed
Kaufman, AS, Raiford, SE, Coalson, DL. Intelligent Testing with the WISC-V. John Wiley & Sons; 2016.10.1002/9781394259397CrossRefGoogle Scholar
Weiss, LG, Saklofske, DH, Coalson, D, et al. WAIS-IV Clinical Use and Interpretation: Scientist-Practitioner Perspectives. Academic Press; 2010.Google Scholar
Brooks, BL, Sherman, EMS, Iverson, GL. Healthy children get low scores too: prevalence of low scores on the NEPSY-II in preschoolers, children, and adolescents. Arch Clin Neuropsychol. 2010;25(3):182190. doi:10.1093/arclin/acq005CrossRefGoogle ScholarPubMed
Gioia, GA, Andrews, K, Isquith, PK. Behavior Rating Inventory of Executive Function-Preschool Version (BRIEF-P). Psychological Assessment Resources; 1996.Google Scholar
Gioia, GA, Isquith, PK, Guy, SC, et al. BRIEF2: Behavior Rating Inventory of Executive Function: Professional Manual. Psychological Assessment Resources; 2015.Google Scholar
Breaux, KC, Lichtenberger, EO. Essentials of KTEA-3 and WIAT-III Assessment. John Wiley & Sons; 2016.Google Scholar
Reynolds, CR, Kamphaus, RW. Behavior Assessment System for Children, Third Edition. Pearson Inc.; 2015.Google Scholar
Harrison, PL, Oakland, T. Adaptive Behavior Assessment System, Third Edition. Western Psychological Services; 2015.Google Scholar
Diagnostic and Statistical Manual of Mental Disorders: DSM-5, 5th Ed. American Psychiatric Publishing, Inc.; 2013. doi:10.1176/appi.books.9780890425596CrossRefGoogle Scholar
Sadler, RC. How ZIP codes nearly masked the lead problem in Flint. The Conversation. September 20, 2016. Accessed October 9, 2024. http://theconversation.com/how-zip-codes-nearly-masked-the-lead-problem-in-flint-65626 10.64628/AAI.an4c3fu7vCrossRefGoogle Scholar
Mizelle, RM. A slow-moving disaster — the Jackson water crisis and the health effects of racism. N Engl J Med. 2023;388(24):22122214. doi:10.1056/NEJMp2212978CrossRefGoogle ScholarPubMed
Stratton, SA, Ettinger, AS, Doherty, CL, et al. The lead and copper rule: limitations and lessons learned from Newark, New Jersey. WIREs Water. 2023;10(1):e1620. doi:10.1002/wat2.1620CrossRefGoogle ScholarPubMed
Tully, J, Schock, M, Shilling, S, et al. An evaluation of properly operated NSF/ANSI-53 Pb certified drinking water filters in Benton Harbor, MI. J Water Health. 2024;22(2):296308. doi:10.2166/wh.2024.231CrossRefGoogle ScholarPubMed
Section 1115 Waiver - Medicaid Eligibility for Flint Residents. Michigan Department of Health and Human Services. 2024. Accessed August 30, 2024. https://www.michigan.gov/mdhhs/assistance-programs/section-1115-waiver-medicaid-eligibility-for-flint-residentsGoogle Scholar
Chandramouli, K, Steer, CD, Ellis, M, et al. Effects of early childhood lead exposure on academic performance and behaviour of school age children. Arch Dis Child. 2009;94(11):844848. doi:10.1136/adc.2008.149955CrossRefGoogle ScholarPubMed
Donzelli, G, Carducci, A, Llopis-Gonzalez, A, et al. The association between lead and attention-deficit/hyperactivity disorder: a systematic review. Int J Environ Res Public Health. 2019;16(3):382. doi:10.3390/ijerph16030382CrossRefGoogle ScholarPubMed
Froehlich, TE, Lanphear, BP, Auinger, P, et al. Association of tobacco and lead exposures with attention-deficit/hyperactivity disorder. Pediatrics. 2009;124(6):e1054. doi:10.1542/peds.2009-0738CrossRefGoogle ScholarPubMed
Arbuckle, TE, Davis, K, Boylan, K, et al. Bisphenol A, phthalates and lead and learning and behavioral problems in Canadian children 6-11 years of age: CHMS 2007-2009. Neurotoxicology. 2016;54:8998. doi:10.1016/j.neuro.2016.03.014CrossRefGoogle ScholarPubMed
Faraone, SV, Bellgrove, MA, Brikell, I, et al. Attention-deficit/hyperactivity disorder. Nat Rev Dis Primers. 2024;10(1):121. doi:10.1038/s41572-024-00495-0Google ScholarPubMed
MISchoolData. Student Enrollment Counts Report. MISchoolData: Michigan’s Official Education Data Source. 2023. Accessed August 2, 2023. https://www.mischooldata.org/student-enrollment-counts-report/Google Scholar
Mental and behavioral health, 2018-2019. In: National Survey of Children’s Health Data Briefs. Health Resources and Services Administration; 2020. Accessed May 20, 2025. http://www.ncbi.nlm.nih.gov/books/NBK603011/Google Scholar
Levin, RY, Liu, RT. Post-traumatic stress disorder in a national sample of preadolescent children 9 to 10 years old: prevalence, correlates, clinical sequelae, and treatment utilization. Transl Psychiatry. 2024;14(1):16. doi:10.1038/s41398-024-02868-1CrossRefGoogle Scholar
Lewis, SJ, Arseneault, L, Caspi, A, et al. The epidemiology of trauma and post-traumatic stress disorder in a representative cohort of young people in England and Wales. The Lancet Psychiatry. 2019;6(3):247256. doi:10.1016/S2215-0366(19)30031-8CrossRefGoogle Scholar
Winter, AS, Sampson, RJ. From lead exposure in early childhood to adolescent health: a Chicago birth cohort. Am J Public Health. 2017;107(9):14961501. doi:10.2105/AJPH.2017.303903CrossRefGoogle ScholarPubMed
Lubit, R, Rovine, D, Defrancisci, L, et al. Impact of trauma on children. J Psychiatr Pract. 2003;9(2):128138. doi:10.1097/00131746-200303000-00004CrossRefGoogle ScholarPubMed
Stallard, P, Velleman, R, Baldwin, S. Prospective study of post-traumatic stress disorder in children involved in road traffic accidents. BMJ. 1998;317(7173):16191623. doi:10.1136/bmj.317.7173.1619CrossRefGoogle ScholarPubMed
Tyano, S, Iancu, I, Solomon, Z, et al. Seven-year follow-up of child survivors of a bus-train collision. J Am Acad Child Adolesc Psychiatry. 1996;35(3):365373. doi:10.1097/00004583-199603000-00019CrossRefGoogle ScholarPubMed
Vaughn-Coaxum, RA, Wang, Y, Kiely, J, et al. Associations between trauma type, timing, and accumulation on current coping behaviors in adolescents: results from a large, population-based sample. J Youth Adolesc. 2018;47(4):842858. doi:10.1007/s10964-017-0693-5CrossRefGoogle ScholarPubMed
Reuben, A, Moreland, A, Abdalla, SM, et al. Prevalence of depression and posttraumatic stress disorder in Flint, Michigan, 5 years after the onset of the water crisis. JAMA Network Open. 2022;5(9):e2232556. doi:10.1001/jamanetworkopen.2022.32556CrossRefGoogle ScholarPubMed
Bellinger, D, Leviton, A, Waternaux, C, et al. Longitudinal analyses of prenatal and postnatal lead exposure and early cognitive development. N Engl J Med. 1987;316(17):10371043. doi:10.1056/NEJM198704233161701CrossRefGoogle ScholarPubMed
McMichael, AJ, Baghurst, PA, Wigg, NR, et al. Port Pirie Cohort Study: environmental exposure to lead and children’s abilities at the age of four years. N Engl J Med. 1988;319(8):468475. doi:10.1056/NEJM198808253190803CrossRefGoogle ScholarPubMed
Figure 0

Table 1. Constructs assessed by Center for Children’s Integrated Services Assessment Center (CISAC) test battery, associated measures, and source of information for each measure

Figure 1

Table 2. ICD-10 Codes used to classify diagnoses made by the Center for Children’s Integrated Services Assessment Center (CISAC) neuropsychologists

Figure 2

Table 3. Frequencies of diagnoses and recommendations made to children evaluated by the Center for Children’s Integrated Services Assessment Center (CISAC) from January 2019-July 2021 (N = 376)

Figure 3

Table 4. Frequency of each diagnosis occurring as a diagnosis for children who had 2 or more diagnoses made during their assessment in the Center for Children’s Integrated Services Assessment Center (CISAC) (n = 262)

Figure 4

Table 5. Cross-tabulations of historical recommendations and recommendations made after the Center for Children’s Integrated Services Assessment Center (CISAC) assessment