Abstract

Objective

The purpose of this study was to evaluate relationships between multiple mild traumatic brain injuries (mTBIs) and objective and subjective clinical outcomes in a sample of combat-exposed Veterans, adjusting for psychiatric distress and combat exposure.

Method

In this cross-sectional study, 73 combat-exposed Iraq/Afghanistan Veterans were divided into three groups based on mTBI history: 0 mTBIs (n = 31), 1–2 mTBIs (n = 21), and 3+ mTBIs (n = 21). Veterans with mTBI were assessed, on average, 7.78 years following their most recent mTBI. Participants underwent neuropsychological testing and completed self-report measures assessing neurobehavioral, sleep, and pain symptoms.

Results

MANCOVAs adjusting for psychiatric distress and combat exposure showed no group differences on objective measures of attention/working memory, executive functioning, memory, and processing speed (all p’s > .05; ηp2 = .00–.06). In contrast, there were significant group differences on neurobehavioral symptoms (p’s = < .001–.036; ηp2 = .09–.43), sleep difficulties (p = .037; ηp2 = .09), and pain symptoms (p < .001; ηp2 = .21). Pairwise comparisons generally showed that the 3+ mTBI group self-reported the most severe symptoms, followed by comparable symptom reporting between the 0 and 1–2 mTBI groups.

Conclusions

History of multiple, remote mTBIs is associated with elevated subjective symptoms but not objective neuropsychological functioning in combat-exposed Veterans. These results advance understanding of the long-term consequences of repetitive mTBI in this population and suggest that Veterans with 3+ mTBIs may especially benefit from tailored treatments aimed at ameliorating specific neurobehavioral, sleep, and pain symptoms.

Introduction

As a result of significant improvements in battlefield protection over the past several decades, more military service members have survived wounds in the Iraq and Afghanistan conflicts that would have otherwise been fatal in previous wars. A consequence of this higher survival rate has been an increase in the number of military personnel sustaining traumatic brain injuries (TBI). Estimates suggest that approximately one in four or five deployed service members have sustained a TBI—the majority of which are classified as mild, and this number may be even higher in combat-exposed Veterans (Defense and Veterans Brain Injury Center, 2018; O'Neil et al., 2013; Tanielian & Jaycox, 2008; Terrio et al., 2009). Acutely, mild TBI (mTBI) is associated with objective neuropsychological dysfunction as well as numerous neurobehavioral symptoms that broadly reflect somatic, vestibular, cognitive, and affective-related sequelae (Belanger, Curtiss, Demery, Lebowitz, & Vanderploeg, 2005; Dikmen, Machamer, & Temkin, 2017; Kelly, Coldren, Parish, Dretsch, & Russell, 2012; Terrio et al., 2009; Vanderploeg et al., 2015). Although cognitive deficits and associated symptoms are generally expected to resolve within several days to weeks following mTBI (Rohling et al., 2011; Schretlen & Shapiro, 2003), some studies have shown that symptoms continue to be endorsed beyond this projected recovery window, particularly among military Veterans (Hou et al., 2012; Schwab et al., 2017; Vanderploeg, Curtiss, Luis, & Salazar, 2007; Vincent, Roebuck-Spencer, & Cernich, 2014). Identifying the factors contributing to symptoms and sequelae reported in the chronic phase of injury has been an area of active investigation, yet our understanding of such variables remains incomplete.

Comorbid psychiatric distress is one of the factors often associated with chronic deficits in the Veteran mTBI population (Chapman & Diaz-Arrastia, 2014; Lippa, Pastorek, Benge, & Thornton, 2010; Mashima et al., 2019; Polusny et al., 2011; Vanderploeg, Belanger, Curtiss, Bowles, & Cooper, 2019). Specifically, there is mounting evidence to suggest that Veterans with a history of mTBI and comorbid mental health diagnoses such as posttraumatic stress disorder (PTSD) and depression often experience numerous neurobehavioral symptoms, including cognitive dysfunction, chronically following injury (Belanger, Kretzmer, Vanderploeg, & French, 2010a; Cooper et al., 2011; Garber, Rusu, & Zamorski, 2014). Additionally, investigators have also established that deployment itself affects neuropsychological and neurobehavioral functioning (Mitchell, 2017; Vasterling et al., 2006). Still, others have raised the possibility that TBI-related injury characteristics may influence the nature, presence, and duration of post-injury sequelae (Mashima et al., 2019). Notably, service members are often faced with multiple combat deployments and may be subjected to repetitive blast exposure while deployed, which frequently results in multiple mTBIs throughout the course of one’s military career (Boyle et al., 2014; Galarneau, Woodruff, Dye, Mohrle, & Wade, 2008; MacGregor, Dougherty, Morrison, Quinn, & Galarneau, 2011; O'Neil et al., 2014; Wilk, Herrell, Wynn, Riviere, & Hoge, 2012). Although investigators have begun examining the effects of multiple mTBIs on clinical outcome, available findings are rather heterogeneous, and more research is needed to better understand the cumulative effects of mTBIs on objective and subjective functioning in military personnel.

With regard to objective neuropsychological functioning in the context of multiple mTBIs, prior research conducted on military samples has yielded disparate findings. Dretsch, Silverberg, and Iverson (2015) examined a large sample of active duty service members divided into the following four groups: 0 mTBIs, 1 mTBI, 2 mTBIs, and 3+ mTBIs. Using domain scores from the Central Nervous System Vital Signs (CNS VS) computerized neurocognitive test as primary outcomes of interest, study authors found no group differences on any of the cognitive variables across the four groups. In another study, Cooper and colleagues (2018) examined military service members divided into five groups: 1 mTBI, 2 mTBIs, 3+ mTBIs, no prior mTBIs but orthopedic injury, and no prior mTBIs but PTSD diagnosis. They evaluated cognitive performance using a composite score comprised of measures of executive functioning, processing speed, working memory, and verbal memory. Although they found no group differences across the three mTBI groups (1 mTBI, 2 mTBIs, and 3+ mTBIs), those with a history of 1 mTBI and 3+ mTBIs performed more poorly than orthopedic controls on the cognitive composite; otherwise, no other group differences were reported. Finally, Spira, Lathan, Bleiberg, & Tsao (2014) evaluated active duty military personnel using the Defense Automated Neurobehavioral Assessment (DANA), another computerized neurocognitive assessment tool, and reported reduced cognitive functioning on measures of attention and rapid discrimination in those with multiple lifetime mTBIs (defined as 3+ mTBIs) relative to those with two or fewer mTBIs. However, no associations were found between the number of lifetime mTBIs and performance on memory-related tasks in this sample.

As for the relationship between lifetime number of mTBIs and subjective neurobehavioral symptoms, some military-specific studies have demonstrated a positive association between these variables. To illustrate, Dretsch and colleagues (2015) found that service members with a history of 3+ mTBIs reported greater neurobehavioral symptoms relative to service members with no prior mTBIs, as well as those with a history of 1 and 2 mTBIs, concluding that 3+ mTBIs is a risk factor for “ongoing” symptomatology. Miller, Ivins, and Schwab (2013) and Spira and colleagues (2014) reported similar findings—that is, greater neurobehavioral symptom reporting was associated with multiple lifetime mTBIs; however, this relationship was attenuated by time since injury in Miller and colleagues’ (2013) study and was found to be dependent on, or better accounted for by, psychiatric distress and military-specific factors such as combat exposure and deployment history in the study by Spira and colleagues (2014). These findings suggest a complicated relationship between the number of mTBIs and neurobehavioral symptoms but provide evidence that the number of mTBI events may be at least one important factor associated with chronic neurobehavioral symptoms.

In a more recent investigation, Cooper and colleagues (2018), after dividing their military sample into five distinct groups including three mTBI groups (those with a history of 1, 2, and 3+ mTBIs) as well as two control groups (orthopedic and PTSD controls), found that the mTBI groups showed a nonsignificant pattern of increased symptom reporting with increasing number of mTBIs. Moreover, the PTSD group had the highest number of neurobehavioral complaints, whereas the orthopedic group had the fewest, with the mTBI groups falling between the two control groups. Finally, Bryan (2013a) evaluated military personnel with a history of 0, 1, and 2+ mTBIs and found that those with a history of 1 mTBI and 2+ mTBIs endorsed greater neurobehavioral symptoms than those without a history of mTBI, but the two mTBI groups (1 and 2+ mTBIs) did not significantly differ with respect to symptom reporting.

Beyond evaluating traditional neurobehavioral symptoms, it is well recognized that sleep disturbance and pain are also commonly experienced in Veterans with mTBI histories (Balba et al., 2018; Bosco, Murphy, & Clark, 2013; Stojanovic et al., 2016). However, relatively few studies have examined associations between multiple mTBIs and sleep and pain complaints. Whereas Dretsch and colleagues (2015) found no associations between the number of concussions and self-reported sleep symptoms in a large sample of active duty soldiers, Bryan (2013b) reported that multiple TBIs were associated with higher rates of clinical insomnia as well as more severe insomnia in active duty military personnel even when adjusting for psychiatric comorbidities and neurobehavioral symptoms. However, Bryan (2013b) included service members with all TBI severity levels, making the results difficult to generalize to Veterans with mTBI only. As for pain, Lindquist, Love, and Elbogen (2017) found that, relative to a single TBI, Veterans with a history of two or more TBIs endorsed significantly higher rates of pain. Similar to Bryan (2013b), however, Lindquist and colleagues (2017) evaluated pain across all TBI severities; thus, the relationship between multiple mTBIs and sleep and pain symptoms remains to be determined.

The primary purpose of this study was to examine the relationship between multiple mTBIs and objective neuropsychological functioning and subjective symptom reporting in a sample of combat-exposed Iraq and Afghanistan Veterans. Importantly, prior studies examining the effects of multiple mTBIs on post-injury clinical outcome have largely been conducted on active duty service members with relatively acute injuries. Moreover, previous work has inconsistently controlled for factors such as psychiatric distress and level of combat exposure—variables known to influence neuropsychological performance and symptom burden following mTBI (Hoge et al., 2008; Vasterling et al., 2006). Therefore, in the present study, we specifically sought to evaluate Veterans with remote mTBI histories (>1 year post-injury) and were particularly interested in determining the extent to which history of multiple mTBIs is associated with objective and subjective functioning independent of psychiatric distress and level of combat exposure. We hypothesized that after adjusting for psychiatric symptoms and combat exposure, that lifetime number of mTBIs would not be associated with objective cognitive functioning. In contrast, we posited that there would be a positive relationship between lifetime number of mTBIs and subjective symptom reporting, such that Veterans with a history of multiple mTBIs (i.e., 3+ mTBIs) would endorse the greatest levels of neurobehavioral symptoms, sleep disturbance, and pain, followed by those with a history of 1–2 mTBIs and those with no prior mTBIs.

Method

Participants and Procedures

Participants included 73 combat-exposed Iraq/Afghanistan Veterans divided into three groups based on mTBI history: 0 mTBIs (n = 31), 1–2 mTBIs (n = 21), and 3+ mTBIs (n = 21). Veterans were recruited between 2014 and 2017 from outpatient clinics within a large Veterans Affairs hospital as part of a larger Chronic Effects of Neurotrauma Consortium (CENC) project (Cifu, Williams, Hinds, & Agyemang, 2018; Walker et al., 2016). As part of this cross-sectional study, participants were administered a structured clinical interview to assess TBI history; a self-report measure assessing combat exposure; a comprehensive neuropsychological assessment; and several self-report questionnaires assessing psychiatric distress, neurobehavioral symptoms, and sleep and pain-related symptoms. Both performance and symptom validity measures were also included. Trained research personnel administered all study procedures under the supervision of a licensed clinical neuropsychologist. The study was approved by the local Institutional Review Board, and all participants provided informed consent prior to participating in the study.

Study inclusion criteria included being a combat-exposed Veteran who served in Iraq or Afghanistan (i.e., Operation Enduring Freedom, Operation Iraqi Freedom, and/or Operation New Dawn). Exclusion criteria included having a mental health diagnosis of bipolar disorder or schizophrenia (or another psychotic disorder); active substance dependence; recent (within the previous month) suicidal intent or attempt; and history of a moderate or severe TBI. Additionally, Veterans who did not perform within expectations on performance and symptom validity tests were excluded from analyses (see “Measures” for details), and failure to complete all study procedures was exclusionary. Finally, for Veterans with a history of mTBI, sustaining a recent mTBI was exclusionary (defined as sustaining an mTBI within 1 year of study enrollment), as we were specifically interested in addressing long-term outcomes following mTBI.

In total, 104 Veterans consented to the study; of these, 12 participants were excluded due to psychiatric/medical reasons, 4 due to history of a moderate TBI, 5 due to performance validity test failure, 2 based on symptom validity test failure, 6 for failing to complete all study procedures, and 2 for having sustained a recent mTBI. Our final sample (N = 73) was comprised of predominantly male Veterans (91.8%). On average, the sample was 34.14 years of age (SD = 6.33) and had completed 15.00 years of education (SD = 1.65). Overall, about half (56.2%) of the sample identified as “Caucasian/Middle Eastern” and about one-third (35.6%) of the sample identified as “Hispanic or Latino.” Of the 42 Veterans with a history of at least one mTBI, the average time tested post-injury was 7.78 years (SD = 5.98), and 66.7% of the mTBI sample had a history of blast-related mTBI.

Measures

Structured clinical interview

The Virginia Commonwealth University Retrospective Concussion Diagnosis Interview (rCDI) was used to evaluate Veterans’ mTBI history (Walker et al., 2015). For the purpose of this study, both the “blast” and “general” versions of the interview were administered. The rCDI gathers detailed information about previous concussive events, including the date of injury, setting in which the injury occurred, mechanism of injury, presence and duration of loss or alteration of consciousness and/or posttraumatic amnesia, and any other associated symptoms occurring at the time of injury. These details are collected for each injury reported, and the VA/DoD Clinical Practice Guideline for The Management of Concussion-mTBI Working Group (2009, 2016) criteria were used to determine whether a reported event qualified as an mTBI. According to VA/DoD guidelines, an mTBI is defined as experiencing a loss of consciousness between 0 and 30 min, an alteration of consciousness lasting up to 24 hr, and/or posttraumatic amnesia lasting no longer than 24 hr. Injuries meeting this definition were classified as an mTBI, and the total number of injuries sustained by each Veteran was calculated.

Combat exposure

The “Combat Experiences” (Section D) scale of the Deployment Risk and Resiliency Inventory-2 (DRRI-2) was used to assess combat exposure (Vogt et al., 2013). This scale is a 17-item self-report measuring comprised of questions pertaining to specific events that may have taken place during deployment (e.g., “During deployment, I went on combat patrols or missions”; “During deployment, I was injured in a combat-related incident”; etc.). Participants were asked to rate how often they experienced each event on a scale from 1 to 6, where “1” = “never” and “6” = “daily or almost daily.” A total score was computed by adding participant’s responses across the 17 items (possible range = 17–102); higher scores indicate greater exposure to combat (Vogt et al., 2013). Veterans were considered “combat-exposed” if they had a total score of > 17 on Section D of the DRRI-2 (or a score of “2” or more on at least one item of Section D).

Neuropsychological assessment

The Word Reading subtest of the Wide Range Achievement Test—Fourth Edition (WRAT4) (Wilkinson & Robertson, 2006) was used to assess premorbid intellectual functioning. Measures of attention and working memory included Digit Span Forward, Digit Span Backward, and Digit Span Sequencing from the Wechsler Adult Intelligence Scale—Fourth Edition (WAIS-IV) (Wechsler, 2008). Measures of executive functioning included the Inhibition and Inhibition/Switching conditions from the Delis-Kaplan Executive Function System (D-KEFS) Color-Word Interference Test (CWIT) (Delis, Kaplan, & Kramer, 2001), the Number-Letter Switching condition from the D-KEFS Trail Making Test (TMT) (Delis et al., 2001), and Perseverative Errors and Total Errors from the Wisconsin Card Sorting Test-64 Card Version (WCST-64) (Kongs, Thompson, Iverson, & Heaton, 2000). Measures of memory included the total recall and delayed recall trials of the Brief Visuospatial Memory Test-Revised (BVMT-R) (Benedict, 1997) and the total recall, short delay free recall, and long delay free recall trials from the California Verbal Learning Test—Second Edition (CVLT-II) (Delis, Kramer, Kaplan, & Ober, 2000). Finally, measures of processing speed included the Color Naming and Word Reading conditions from the D-KEFS CWIT (Delis et al., 2001), the Visual Scanning, Number Sequencing, Letter Sequencing, and Motor Speed conditions of the D-KEFS TMT (Delis et al., 2001), and the Symbol Search and Coding subtests from the WAIS-IV (Wechsler, 2008).

Manual-derived normative scores were calculated for each neuropsychological variable of interest; this allowed for adjustments for age, sex, and/or education (based on manual-specific guidelines) and ensured that all variables could be interpreted in a uniform direction—that is, higher scores reflect better performance across all measures. After deriving the normed scores, all variables of interest were converted to standard scores (M = 100, SD = 15) so that each variable could be interpreted on the same metric. Altogether, 21 cognitive variables were assessed in the present study (3 attention/working memory variables, 5 executive functioning variables, 5 memory variables, and 8 processing speed variables).

Self-report measures

Psychiatric distress

The PTSD Checklist for DSM-5 (PCL-5) (Weathers et al., 2013) is a 20-item self-report measure designed to assess PTSD symptoms. Participants were asked to rate the extent to which they have been bothered by each symptom over the past month using a rating scale of 0–4, where “0” reflects “not at all” and “4” reflects “extremely.” A PCL-5 total score was calculated for each Veteran by summing the selected scores from each of the 20 items (possible range: 0–80); higher scores correspond with greater PTSD symptomatology. Additionally, symptom cluster scores representing symptoms of intrusion, avoidance, cognition/mood disturbance, and arousal/reactivity were also generated for the PCL-5.

The Patient Health Questionnaire-9 (PHQ-9) (Kroenke, Spitzer, & Williams, 2001) is a 9-item self-report measure designed to assess depression symptoms. Participants were asked to rate the extent to which they have been bothered by each symptom over the past 2 weeks using a rating scale of 0–3, where “0” indicates “not at all” and “3” indicates “nearly every day.” A PHQ-9 total score was calculated for each Veteran by summing the selected scores from each of the nine items (possible range: 0–27); higher scores correspond with greater depressive symptomatology.

Neurobehavioral symptoms

The Neurobehavioral Symptom Inventory (NSI) is a 22-item self-report measure designed to assess commonly reported neurobehavioral symptoms such as feeling dizzy, headaches, poor concentration, fatigue/loss of energy, etc. (Cicerone and Kalmar, 1995). Participants were asked to rate the extent to which they have been bothered by each symptom in the last 2 weeks using a five-point rating scale ranging from “none” to “very severe,” corresponding with the following values: 0 = none, 1 = mild, 2 = moderate, 3 = severe, and 4 = very severe. An NSI total score was calculated for each Veteran by summing the ratings for the 22 items (possible range: 0–88); higher scores indicate greater neurobehavioral symptomatology. An additional summary index was also calculated from the NSI—the positive symptom total (PST) score (Derogatis, 1994), which is a measure of symptom breadth (as opposed to symptom severity). The PST was calculated by counting the total number of positively endorsed symptoms (i.e., any symptoms marked as ≥1; possible range: 0–22) (Derogatis, 1994; Merritt, Meyer, & Arnett, 2015). Finally, symptom cluster scores were also generated for the NSI based on a previous factor analysis (Vanderploeg et al., 2015): vestibular symptoms (items 1–3; possible range: 0–12), somatic/sensory symptoms (items 4–7 and 9–11; possible range: 0–28), cognitive symptoms (items 13–16; possible range: 0–16), and affective symptoms (items 17–22; possible range: 0–24).

Sleep symptoms

The Pittsburgh Sleep Quality Index (PSQI) is a 19-item self-report questionnaire designed to assess sleep quality and sleep disturbances over a 1-month interval (Buysse, Reynolds III, Monk, Berman, & Kupfer, 1989). The questionnaire gathers both qualitative and quantitative data, including information pertaining to usual bedtime and wake time, number of hours slept, number of minutes to fall asleep, and an assessment of issues that may affect or interfere with sleep. A PSQI global score was computed that reflects the number and severity of sleep-related problems (possible range: 0–21); higher scores reflect poorer sleep quality.

Pain symptoms

The Short-Form McGill Pain Questionnaire (SF-MPQ) is a 15-item self-report questionnaire designed to assess pain (Melzack, 1987). Participants are presented with pain descriptors (e.g., throbbing, sharp, aching, punishing-cruel) and are asked to rate the extent to which they have experienced each type of pain over the past month using a rating scale of 0–3, where “0” reflects “none” and “3” reflects “severe.” A SF-MPQ total score was computed by summing the responses for all 15 items (possible range: 0–45); higher scores indicate greater/more intense pain.

Performance and symptom validity tests

The Test of Memory Malingering (TOMM) (Tombaugh, 1996) and the Forced Choice Recognition subtest from the CVLT-II (Delis et al., 2000) were used to assess performance validity. Standard cutoffs (according to manual-specific guidelines) were used to define inadequate performance for each of the performance validity tests. For the purpose of this study, invalid performance was defined as failure on one or more of the following trials: TOMM Trial 2, TOMM Retention Trail, and CVLT-II Forced Choice Recognition.

The Validity-10 (Val-10), developed by Vanderploeg et al. (2014), is an embedded symptom validity scale within the NSI. The Val-10 is comprised of 10 items from the NSI that are considered to be infrequently endorsed items (Jurick et al., 2016; Vanderploeg et al., 2014); the 10 items are summed to create a total score (Vanderploeg et al., 2014). Notably, the Val-10 has been frequently utilized as a measure of symptom validity in military mTBI studies and has been validated in both active duty and Veteran samples (Armistead-Jehle et al., 2018; Ashendorf, 2019; Bodapati et al., 2019; Jurick et al., 2016; Lange, Brickell, & French, 2015a; Lange, Brickell, Lippa, & French, 2015b). Despite the Val-10 having strong empirical support, there is currently no consensus as to what the optimal cutoff should be for adequately detecting symptom exaggeration, with published cutoffs ranging from ≥13 (Lange, Brickell, & French, 2015a) to ≥33 (Armistead-Jehle et al., 2018). For the purpose of this study, we utilized a Val-10 score of > 22 as our criterion for exclusion, consistent with several prior studies using similar samples (Jurick et al., 2016; Lange, Brickell, Lippa, et al., 2015b; Lu et al., 2019; Vanderploeg et al., 2014).

Approach to Statistical Analyses

As indicated earlier, Veterans were divided into three groups based on mTBI history: 0 mTBIs, 1–2 mTBIs, and 3+ mTBIs. To evaluate whether groups differed on participant characteristics (i.e., basic demographic variables, TBI characteristics, and psychiatric measures), analyses of variance (ANOVAs), independent samples t-tests, and chi-square or Fisher’s exact tests were used, as appropriate. Next, multivariate analyses of covariance (MANCOVAs) were used to investigate group differences on neuropsychological functioning. MANCOVAs were utilized for the cognitive variables to reduce Type I error and to evaluate whether mTBI groups differed along various dimensions of cognition (e.g., executive functioning, memory, etc.) (Field, 2013). Analyses of covariance (ANCOVAs) were used to evaluate group differences on neurobehavioral symptoms, sleep disturbance, and pain. Covariates for the MANCOVAs and ANCOVAs included psychiatric distress1 and combat exposure2. Any significant omnibus test was followed up with post hoc comparisons using Tukey’s Honestly Significant Difference (HSD) tests to compare all pairs of means. Effect sizes are reported as eta-squared values for MANCOVAs and ANCOVAs (interpreted as .01 = small, .06 = medium, and .14 = large) and as Cohen’s d for all pairwise comparisons (interpreted as .20 = small, .50 = medium, and .80 = large). All analyses were conducted using the Statistical Package for the Social Sciences (SPSS), Version 26.

Results

Participant Characteristics

Table 1 displays participant characteristics—basic demographic variables, TBI characteristics, and psychiatric measures—by mTBI group. Whereas mTBI groups were generally comparable across most variables, there were significant group differences on combat exposure as represented by the DRRI-2 total score (p = .046). Post hoc comparisons revealed that Veterans with a history of 3+ mTBIs experienced more combat relative to those with a history of 0 mTBIs (p = .036), but the 3+ mTBI and 1–2 mTBI groups did not differ on combat exposure (p = .299). Additionally, although there was a nonsignificant trend of increasing PTSD symptoms with increasing number of mTBIs (p = .099) for the PCL-5 total score, the PCL-5 arousal symptom cluster did show significant group differences, such that Veterans with a history of 3+ mTBIs had greater arousal symptoms relative to those with a history of 0 mTBIs (p = .010). With regard to mTBI-specific variables, time since injury significantly differed between the 1–2 mTBI and 3+ mTBI groups (p = .013), such that Veterans with a history of 3+ mTBIs were evaluated approximately 5 years post-injury, whereas those with a history of 1–2 mTBIs were evaluated approximately 10.5 years post-injury. Finally, Veterans with a history of 3+ mTBIs endorsed experiencing a blast-related mTBI at a greater rate than those with a history of 1–2 mTBIs (p = .050).

Table 1

Participant characteristics by mTBI group

Variables0 mTBIs (n = 31)1–2 mTBIs (n = 21)3+ mTBIs (n = 21)Test result
MSDMSDMSDF or tp
Age34.616.9233.195.7234.386.180.33.718
Years of education15.261.6914.571.2915.051.881.10.339
WRAT4 reading SS104.0610.56103.5710.05103.3310.230.03.966
Years since most recent mTBI10.497.065.082.842.60.013
DRRI-2 total score32.5211.4236.1914.0642.8618.323.22.046
PCL-5 total score22.5817.5626.0016.8333.1917.202.39.099
 PCL-5 intrusion symptoms6.135.355.433.878.245.061.92.154
 PCL-5 avoidance symptoms2.612.193.002.433.862.311.86.163
 PCL-5 cognition/mood symptoms6.906.659.107.1810.007.041.39.255
 PCL-5 arousal/reactivity symptoms6.945.808.485.3911.105.383.50.036
PHQ-9 total score8.167.579.107.1310.244.640.60.522
N%N%N%χ2p
Sex
 Male2890.32095.21990.50.52.773
 Female39.714.829.5
Ethnicity
 Hispanic or Latino1341.9733.3628.62.67.616
 Not Hispanic or Latino1754.81361.91571.4
 Unknown13.214.800
Race
 Caucasian/Middle Eastern1445.21361.91466.72.75.253
 Not Caucasian/Middle Eastern1754.8838.1733.3
Currently employed
 Yes1754.81466.7838.13.49.175
 No1445.2733.31361.9
Currently in school
 Yes1858.11361.91257.10.11.945
 No1341.9838.1942.9
LOC present
 Yes1361.91571.40.43.513
 No838.1628.6
PTA present
 Yes1990.52095.20.37.545
 No29.514.8
History of blast-related mTBI
 Yes1152.31781.03.86.050
 No1047.6419.0

Notes: Analyses of variance (ANOVAs) were used to determine whether mTBI groups differed on all continuous variables, with the exception of the “years since most recent mTBI” variable, where an independent sample t-test was used given the analysis only included comparisons between the 1–2 mTBI and 3+ mTBI groups. Chi-square or Fisher’s exact tests (where cell counts were <5) were used to determine whether groups differed on all categorical variables. mTBI = mild traumatic brain injury; WRAT4 = Wide Range Achievement Test—Fourth Edition; SS = standard score; DRRI-2 = Deployment Risk and Resilience Inventory-2; PCL-5 = PTSD Checklist for DSM-5; PHQ-9 = Patient Health Questionniare-9; LOC = loss of consciousness; PTA = posttraumatic amnesia.

Objective Neuropsychological Functioning

A MANCOVA revealed a nonsignificant effect of mTBI group on measures of attention and working memory when adjusting for psychiatric distress and combat exposure, Wilks Λ = 0.95, F(6, 132) = 0.56, p = .763; ηp2 = .025. Similar nonsignificant results were found for measures of executive functioning (Wilks Λ = 0.85, F(10, 128) = 1.07, p = .387; ηp2 = .077), memory (Wilks Λ = 0.82, F(10, 128) = 1.30, p = .236; ηp2 = .092), and processing speed (Wilks Λ = 0.91, F(16, 120) = 0.36, p = .988; ηp2 = .046) when adjusting for the same covariates. Unadjusted means and standard deviations for the neuropsychological variables are reported in Table 2, and adjusted means, standard errors, and results of all univariate analyses are reported in Table 3.

Table 2

Descriptive statistics (unadjusted means and standard deviations): neuropsychological performance and symptom reporting by mTBI group

Outcome variableN0 mTBIs (n = 31)1–2 mTBIs (n = 21)3+ mTBIs (n = 21)
MSDMSDMSD
Neuropsychological Variables
Attention/Working Memory
  WAIS-IV Digit Span Forward7398.9414.7399.9614.71100.7016.98
  WAIS-IV Digit Span Backward73102.1316.3099.7415.2598.7213.81
  WAIS-IV Digit Span Sequencing7398.8614.8599.8713.47102.0116.31
Executive Functioning
  D-KEFS CWIT Inhibition73104.8410.1399.299.9096.2021.13
  D-KEFS CWIT Inhibition/Switching73102.9410.7997.7213.3398.0121.91
  D-KEFS TMT Number-Letter Switching73102.2414.0797.6517.3497.6513.58
  WCST-64 Perseverative Errors7397.5916.32100.5311.01105.4015.70
  WCST-64 Total Errors7399.0415.2298.4313.92102.5917.67
Memory
  BVMT-R Total Recall7399.0515.81100.7615.94102.0213.72
  BVMT-R Delayed Recall73100.4116.44100.9012.62100.3716.25
  CVLT-II Trials 1–5 Total Recall73101.1713.42104.2717.0796.7115.58
  CVLT-II Short Delay Free Recall73102.9014.0297.6616.8899.6315.87
  CVLT-II Long Delay Free Recall73101.9315.49101.4715.5697.5415.54
Processing Speed
  D-KEFS CWIT Color Naming72101.1012.1298.2215.61100.7016.41
  D-KEFS CWIT Word Reading73101.0614.9299.8114.7597.6315.66
  D-KEFS TMT Visual Scanning73102.2613.13100.4112.4698.3913.77
  D-KEFS TMT Number Sequencing7399.7616.21100.6816.1099.5512.96
  D-KEFS TMT Letter Sequencing73100.0311.71101.9018.1297.6415.45
  D-KEFS TMT Motor Speed73101.3512.1299.5819.5599.1011.82
  WAIS-IV Symbol Search73102.3113.6799.1016.5399.3416.87
  WAIS-IV Coding73101.0114.4598.9815.64100.3015.90
Symptom Variables
Post-Concussive Symptoms
  NSI Total Score7315.5211.6820.1913.6534.6711.62
  NSI Positive Symptom Total Score739.976.6111.815.6618.573.23
  NSI Vestibular Symptoms730.901.301.571.833.952.29
  NSI Somatosensory Symptoms733.132.684.193.479.713.78
  NSI Cognitive Symptoms733.163.064.863.536.332.46
  NSI Affective Symptoms736.814.947.905.8911.714.73
Sleep Symptoms
  PSQI Global Score728.814.199.293.6213.053.65
Pain Symptoms
  SF-MPQ Total Score738.108.8410.676.9719.389.13

Notes: mTBI = mild traumatic brain injury; WAIS-IV = Wechsler Adult Intelligence Scale—Fourth Edition; D-KEFS = Delis-Kaplan Executive Function System; CWIT = Color Word Interference Test; TMT = Trail Making Test; WCST-64 = Wisconsin Card Sorting Test-64 Card Version; BVMT-R = Brief Visuospatial Memory Test-Revised; CVLT-II = California Verbal Learning Test—Second Edition; NSI = Neurobehavioral Symptom Inventory; PSQI = Pittsburgh Sleep Quality Index; SF-MPQ = Short-Form McGill Pain Questionnaire.

Table 3

Neuropsychological performance: descriptive statistics (adjusted means and standard errors), univariate ANCOVA results, and effect sizes

Neuropsychological Variables0 mTBIs (n = 31)1–2 mTBIs (n = 21)3+ mTBIs (n = 21)Test result
M (SE)M (SE)M (SE)Fpηp2
Attention/Working Memory
 WAIS-IV Digit Span Forward98.60 (2.88)99.92 (3.40)101.25 (3.57)0.16.854.01
 WAIS-IV Digit Span Backward101.89 (2.86)99.70 (3.38)99.12 (3.54)0.21.811.01
 WAIS-IV Digit Span Sequencing98.64 (2.76)99.82 (3.26)102.39 (3.42)0.34.710.01
Executive Functioning
 D-KEFS CWIT Inhibition104.64 (2.60)99.24 (3.07)96.56 (3.22)1.97.148.06
 D-KEFS CWIT Inhibition/Switching102.29 (2.80)97.60 (3.31)99.10 (3.47)0.62.540.02
 D-KEFS TMT Number-Letter Switching101.58 (2.72)97.54 (3.22)98.73 (3.37)0.50.612.01
 WCST-64 Perseverative Errors97.00 (2.73)100.44 (3.22)106.38 (3.38)2.18.121.06
 WCST-64 Total Errors97.65 (2.82)98.25 (3.33)104.83 (3.49)1.36.265.04
Memory
 BVMT-R Total Recall99.05 (2.84)100.74 (3.36)102.04 (3.52)0.21.808.01
 BVMT-R Delayed Recall100.48 (2.88)100.90 (3.40)100.28 (3.56)0.01.991.00
 CVLT-II Trials 1–5 Total Recall100.91 (2.76)104.19 (3.26)97.18 (3.42)1.10.339.03
 CVLT-II Short Delay Free Recall102.48 (2.77)97.56 (3.28)100.35 (3.44)0.66.520.02
 CVLT-II Long Delay Free Recall102.06 (2.86)101.46 (3.38)97.38 (3.54)0.54.584.02
Processing Speed
 D-KEFS CWIT Color Naming101.04 (2.70)98.24 (3.19)100.76 (3.43)0.26.776.01
 D-KEFS CWIT Word Reading101.53 (2.79)99.90 (3.29)97.53 (3.54)0.37.693.01
 D-KEFS TMT Visual Scanning102.83 (2.46)100.47 (2.90)97.80 (3.12)0.76.472.02
 D-KEFS TMT Number Sequencing100.95 (2.79)100.84 (3.30)98.19 (3.55)0.20.816.01
 D-KEFS TMT Letter Sequencing100.58 (2.74)102.00 (3.23)97.24 (3.48)0.52.600.02
 D-KEFS TMT Motor Speed102.39 (2.66)99.73 (3.14)97.74 (3.38)0.57.566.02
 WAIS-IV Symbol Search102.58 (2.84)99.19 (3.35)99.75 (3.61)0.35.709.01
 WAIS-IV Coding101.28 (2.74)99.09 (3.24)100.30 (3.49)0.13.875.00

Notes: Results are adjusted for psychiatric distress (PCL-5 total score) and level of combat exposure (DRRI-2 total score). Eta-squared (ηp2) effect size interpretation = small (.01), medium (.06), large (.14). mTBI = mild traumatic brain injury; WAIS-IV = Wechsler Adult Intelligence Scale—Fourth Edition; D-KEFS = Delis-Kaplan Executive Function System; CWIT = Color Word Interference Test; TMT = Trail Making Test; WCST-64 = Wisconsin Card Sorting Test-64 Card Version; BVMT-R = Brief Visuospatial Memory Test-Revised; CVLT-II = California Verbal Learning Test—Second Edition.

Subjective Symptom Reporting

With regard to neurobehavioral symptoms, ANCOVAs adjusting for psychiatric distress and combat exposure revealed a significant effect of mTBI group across all NSI variables, including the NSI total score, NSI PST score, and each NSI symptom cluster (p’s ≤ .001–.036, ηp2 = .09–.43). Unadjusted means and standard deviations for the NSI variables are reported in Table 2, and adjusted means, standard errors, and results of all univariate analyses are reported in Table 4. Given the significant omnibus tests, Tukey’s post hoc tests were used to evaluate all pairwise comparisons; results of pairwise comparisons and associated effect sizes for the NSI variables are reported in Table 5. As indicated in the table, Veterans with a history of 3+ mTBIs endorsed significantly greater symptoms (across all NSI variables, including the NSI total score, NSI PST score, and each NSI symptom cluster) than both the 0 mTBI and 1–2 mTBI groups, and effect sizes were large. The only exception was on the cognitive symptom cluster, where the 3+ mTBI and 1–2 mTBI groups did not significantly differ from each other. As for comparisons between Veterans with 0 mTBIs and those with 1–2 mTBIs, no significant differences were found on any of the NSI symptom scores.

Table 4

Symptom reporting: descriptive statistics (adjusted means and standard errors), univariate ANCOVA results, and effect sizes

Symptom Variables0 mTBIs (n = 31)1–2 mTBIs (n = 21)3+ mTBIs (n = 21)Test result
M (SE)M (SE)M (SE)Fpηp2
Post-Concussive Symptoms
 NSI Total Score17.10 (1.80)20.45 (2.12)32.07 (2.23)13.30<.001.28
 NSI Positive Symptom Total Score10.63 (0.88)11.91 (1.04)17.49 (1.09)11.87<.001.26
 NSI Vestibular Symptoms0.89 (0.30)1.58 (0.36)3.97 (0.37)20.00<.001.37
 NSI Somatosensory Symptoms3.47 (0.51)4.25 (0.60)9.16 (0.63)25.53<.001.43
 NSI Cognitive Symptoms3.57 (0.50)4.91 (0.60)5.67 (0.62)3.49.036.09
 NSI Affective Symptoms7.45 (0.75)8.01 (0.89)10.66 (0.94)3.57.033.10
Sleep Symptoms
 PSQI Global Score9.42 (0.64)9.38 (0.75)11.99 (0.82)3.47.037.09
Pain Symptoms
 SF-MPQ Total Score8.72 (1.40)10.78 (1.65)18.34 (1.73)9.16<.001.21

Notes: Results are adjusted for psychiatric distress (PCL-5 total score) and level of combat exposure (DRRI-2 total score). Eta-squared (ηp2) effect size interpretation = small (.01), medium (.06), large (.14). mTBI = mild traumatic brain injury; NSI = Neurobehavioral Symptom Inventory; PSQI = Pittsburgh Sleep Quality Index; SF-MPQ = Short-Form McGill Pain Questionnaire.

Table 5

Symptom reporting: pairwise comparisons and associated effect sizes by mTBI group

Symptom Variables0 mTBIs vs. 1–2 mTBIs0 mTBIs vs. 3+ mTBIs1–2 mTBIs vs. 3+ mTBIsPairwise comparisons
pdpdpd
Post-Concussive Symptoms
 NSI Total Score.2330.48<.0011.97<.0011.493+ > 1–2 and 0 mTBIs
 NSI PST Score.3490.39<.0011.81<.0011.423+ > 1–2 and 0 mTBIs
 NSI Vestibular Symptoms.1430.41<.0011.87<.0011.463+ > 1–2 and 0 mTBIs
 NSI Somatosensory Symptoms.3210.39 <.0012.41 <.0012.023+ > 1–2 and 0 mTBIs
 NSI Cognitive Symptoms.0880.62.0131.16.3830.543+ > 0 mTBIs
 NSI Affective Symptoms.6310.27.0121.20.0450.933+ > 1–2 and 0 mTBIs
Sleep Symptoms
 PSQI Global Score.9860.14.0201.23.0231.093+ > 1–2 and 0 mTBIs
Pain Symptoms
 SF-MPQ Total Score.3430.34<.0011.49.0021.153+ > 1–2 and 0 mTBIs

Notes: Cohen’s d effect size interpretation = small (.20), medium (.50), large (.80). mTBI = mild traumatic brain injury; NSI = Neurobehavioral Symptom Inventory; PSQI = Pittsburgh Sleep Quality Index; SF-MPQ = Short-Form McGill Pain Questionnaire.

As for sleep and pain symptoms, ANCOVAs adjusting for psychiatric distress and combat exposure revealed a significant effect of mTBI group on both the PSQI global score and SF-MPQ total score (p’s ≤  .001–.037; ηp2 = .09–.21). Unadjusted means and standard deviations for the sleep and pain symptoms are reported in Table 2, and adjusted means, standard errors, and results of all univariate analyses are reported in Table 4. Given the significant omnibus tests, Tukey’s post hoc tests were used to evaluate all pairwise comparisons; results of pairwise comparisons and associated effect sizes for the sleep and pain symptoms are reported in Table 5. As shown in the table, Veterans with a history of 3+ mTBIs endorsed significantly greater sleep and pain symptoms relative to the 0 mTBI and 1–2 mTBI groups, and effect sizes were large. In contrast, no significant differences were found between Veterans with 0 mTBIs and those with 1–2 mTBIs on sleep and pain symptoms.

Secondary Analyses

Given that the 1–2 and 3+ mTBI groups differed on time since injury and history of blast-related mTBI (see Table 1), we conducted follow-up analyses controlling for these additional variables. Specifically, ANCOVAs adjusting for psychiatric distress, combat exposure, time since injury, and history of blast-related mTBI were used to compare the 1–2 and 3+ mTBI groups on neurobehavioral symptoms, sleep disturbance, and pain (i.e., those variables found to differ in the earlier analyses). As before, ANCOVAs revealed a significant effect of mTBI group across all NSI variables (NSI total score, NSI PST score, and NSI symptom clusters), sleep symptoms, and pain, such that the 3+ mTBI group endorsed significantly greater symptoms than the 1–2 mTBI groups (p’s ≤  .001–.036; ηp2 = .12–.32). Consistent with the earlier findings, the only exception to this was on the NSI cognitive symptom cluster, where the 3+ mTBI and 1–2 mTBI groups did not significantly differ from each other (p = .662; ηp2 = .05).

Discussion

The purpose of this study was to evaluate relationships between multiple mTBIs and objective and subjective clinical outcomes in a sample of combat-exposed military Veterans, adjusting for psychiatric distress and level of combat exposure. We specifically focused on military Veterans with remote histories of mTBI (>1 year) to improve understanding of the long-term effects associated with repetitive injury. Consistent with our hypotheses, mTBI groups (0 mTBIs, 1–2 mTBIs, and 3+ mTBIs) demonstrated comparable performance on objective measures of attention/working memory, executive functioning, memory, and processing speed. In contrast, we found group differences with regard to symptom reporting, such that Veterans with a history of 3+ mTBIs endorsed significantly greater neurobehavioral symptoms, sleep difficulties, and pain relative to Veterans with a history of 0 mTBIs and 1–2 mTBIs; however, when comparing the 0 mTBI and 1–2 mTBI groups, no group differences were found on symptom reporting. These findings suggest that multiple (3+) remote mTBIs may be uniquely associated with enduring subjective symptomatology but not objective cognitive functioning when controlling for psychiatric distress and combat exposure. These results advance understanding of the long-term consequences of repetitive mTBI in this population and suggest that Veterans with three or more mTBIs may especially benefit from tailored treatments that are aimed at ameliorating specific neurobehavioral symptoms, sleep disturbance, and pain.

With regard to the relationship between lifetime number of mTBIs and objective neuropsychological functioning in the context of military mTBI, our findings suggest that when controlling for psychiatric distress and combat exposure, a history of multiple mTBIs does not confer risk for worse cognitive performance in the years following injury. Consistent with our findings, both Dretsch and colleagues (2015) and Nelson and colleagues (2019) reported a lack of association between recurrent mTBI and cognitive performance in their respective military samples. However, others have shown an inverse relationship between the number of mTBIs and cognitive functioning (Cooper et al., 2018; Spira et al., 2014). Although the earlier studies all examined military personnel and specifically evaluated cognitive outcomes following mild TBI, it is notable that studies varied with regard to mTBI chronicity (or timing from most recent injury to study participation), sample demographics (e.g., history of combat exposure/deployment history, degree of psychiatric comorbidities, etc.), control group characteristics, and neuropsychological variables assessed. Certainly, these methodological differences may account for the observed inconsistencies across studies.

To reduce methodological concerns in our study, we explicitly set out to evaluate Veterans with remote mTBIs and adjusted for psychiatric distress and military-specific factors such as combat exposure, which have been shown to influence clinical outcomes. Taking this approach, our findings add to the current literature by establishing that the number of lifetime mTBIs does not appear to be linked to objective cognitive functioning in combat-exposed Veterans in the chronic phase following mTBI (i.e., several years post-injury) and further corroborates findings from the broader mTBI literature showing relatively rapid resolution of cognitive dysfunction (Rohling et al., 2011; Schretlen & Shapiro, 2003). Moreover, our findings are consistent with a meta-analysis conducted on concussed athletes showing a minimal impact of multiple mTBIs on neuropsychological functioning (Belanger, Spiegel, & Vanderploeg, 2010b). Nevertheless, our findings will need to be replicated using larger samples, and future studies may consider using more novel approaches to evaluate cognitive functioning such as calculating cognitive impairment scores or examining patterns of intraindividual cognitive variability, as these approaches may be more sensitive to potentially subtle group differences in cognitive functioning (Merritt et al., 2018). Furthermore, given the controversy regarding the relationship between repetitive mTBIs and susceptibility to neurodegenerative disorders in late life (DeKosky & Asken, 2017; Fields, Didehbani, Hart, & Cullum, 2019; Stern et al., 2011; Zhang et al., 2019), longitudinal studies are needed to better understand associations between the number of mTBIs and cognitive functioning in the context of aging Veterans.

As for associations between lifetime number of mTBIs and neurobehavioral symptoms, our findings indicated a significant positive relationship between these variables, consistent with several prior military mTBI studies (Bryan, 2013a; Cooper et al., 2018; Dretsch et al., 2015; Miller et al., 2013; Spira et al., 2014). Specifically, when controlling for psychiatric distress and combat exposure, we found that Veterans with a history of 3+ mTBIs endorsed more severe neurobehavioral symptoms (as reflected by the NSI total score) and experienced a greater breadth of symptoms (as reflected by the NSI PST score) than Veterans with 1–2 or no prior mTBIs. Likewise, we showed significant associations between mTBI history and all NSI symptom clusters—vestibular, somatosensory, cognitive, and affective—such that Veterans with 3+ mTBIs endorsed greater symptoms relative to the 1–2 and 0 mTBI groups. The only exception to this was for the cognitive symptom cluster which did not significantly differ between the 3+ and 1–2 mTBI groups. However, the 3+ mTBI group reported more cognitive symptoms relative to the 0 mTBI group despite the absence of any differences in objective neuropsychological performance, adding further evidence to suggest that objective and subjective cognitive functioning are often incongruent with one another (French, Lange, and Brickell, 2014; Karr et al., 2019; Spencer, Drag, Walker, & Bieliauskas, 2010).

It is also noteworthy that when evaluating the NSI variables in the three-group (omnibus) analyses, the vestibular and somatosensory symptom clusters demonstrated the greatest effect sizes, suggesting that these specific symptoms may be particularly prominent in the context of repetitive injury. Although speculative, it is possible that these symptoms are more “neurologically based” and that Veterans with repetitive mTBI may be particularly vulnerable to developing these types of symptoms in the chronic phase of injury. Finally, as for sleep and pain-related symptoms, we showed that Veterans with a history of 3+ mTBIs also endorsed greater difficulties with sleep and pain relative to those with a history of 1–2 and 0 prior mTBIs. Interestingly, though, neurobehavioral symptoms, sleep dysfunction, and pain symptoms did not significantly differ between Veterans with a history of 1–2 mTBIs and the group with no prior mTBIs. Taken together, these results add to the growing body of research showing that there appears to be a threshold at which increasing number of mTBIs may confer substantially greater risk for persisting symptoms and potentially poorer long-term outcomes in military service members and Veterans (Dretsch et al., 2015; Spira et al., 2014).

Similar to the neuropsychological literature, prior studies examining the relationship between mTBI history and symptom reporting have utilized varying methodologies and have inconsistently controlled for potentially important contributing variables such as psychiatric distress and combat exposure. Whereas our findings generally align with the results of prior military studies that have examined mTBI burden and symptom reporting, it is important to appreciate that our findings are independent of psychiatric distress and combat exposure and thus suggest that there may be an important link between greater mTBI burden and elevated subjective symptoms that is not accounted for by psychiatric overlay or combat experiences. Furthermore, we conducted follow-up analyses controlling for additional factors including time since injury and blast-related mTBI, and all results held. Unlike some prior studies, it is also worth mentioning that we excluded Veterans who likely engaged in symptom over-reporting (as reflected by the Val-10), thus underscoring the significance of the observed group differences. While additional research is needed to confirm these findings, our results indicate that Veterans with three or more prior mTBIs may be more likely to experience clinically significant sequelae and may especially benefit from individualized interventions aimed at targeting their specific constellation of symptoms. Recent work by Kontos et al. (2018) established that a precision medicine intervention called “Targeted Evaluation, Action, and Monitoring of TBI” (or “TEAM-TBI”) was effective in reducing post-concussive symptoms as well as other post-injury sequelae in a sample of Veterans and civilians with remote mTBI; though promising, future research is necessary to ensure that interventions such as TEAM-TBI and other multidisciplinary approaches are advantageous to specific patient populations such as those with multiple, remote mTBIs.

Strengths and Limitations

Notable strengths of the current study include a focus on combat-exposed Veterans with remote (>1 year) mTBI histories to improve understanding of the long-term effects associated with repetitive injury. Moreover, we controlled for both psychiatric distress and level of combat exposure—variables known to influence clinical outcome following mTBI—so that we could determine the independent effects of multiple mTBIs on objective and subjective functioning. We also excluded Veterans who obtained invalid scores on performance and symptom validity measures and utilized rigorous and well-validated neuropsychological and self-report measures. Nevertheless, our study is not without its limitations. First, consistent with other prior studies, mTBI history was based on participant self-report and therefore may be subject to recall bias or other inaccuracies. However, a well-validated, structured clinical interview administered by trained research personnel was utilized in the present study to reduce concerns related to recall bias and accuracy of TBI details. Second, although we statistically adjusted for psychiatric distress, some items on the PCL-5, for example, overlap with items on the NSI, a primary outcome of interest. Stated differently, there is inherent overlap between symptoms of psychiatric distress and neurobehavioral symptoms, and teasing apart the etiology of these overlapping symptoms remains an ongoing challenge. Third, caution should be taken when generalizing our findings to other populations such as sports-related concussion and non-sport civilian samples. Additionally, our sample included predominantly male Veterans; thus, our findings may not extrapolate to the female Veteran population. Moving forward, it will be essential for studies to specifically establish whether females are at greater risk for experiencing poor clinical outcomes with increasing number of mTBIs. Beyond issues of generalizability, our data are cross-sectional, and thus we are unable to make inferences regarding cause and effect relationships. Finally, our sample size was relatively small, and replication of findings in a larger sample is necessary.

Conclusions

In summary, the present study highlights that history of multiple, remote mTBIs is associated with elevated subjective neurobehavioral symptoms, sleep difficulties, and pain, but is not associated with objective neuropsychological functioning in military Veterans when controlling for psychiatric distress and combat exposure. These results advance understanding of the long-term consequences of multiple mTBIs in this population and suggest that Veterans with three or more mTBIs may be at elevated risk for experiencing persisting sequelae in the years following their most recent mTBI. Future research should replicate these findings and focus on targeted interventions that may benefit Veterans with remote histories of multiple mTBIs.

Funding

This work was supported by grant funding from the Department of Defense, Chronic Effects of Neurotrauma Consortium (CENC) Award [W81XWH-13-2-0095] and the Department of Veterans Affairs CENC Award [I01 CX001135]. Additionally, Victoria Merritt received salary support during this work from a Career Development Award [IK2 CX001952] from the VA Clinical Science Research & Development Service, and Laura Crocker received salary support during this work from a Career Development Award [IK2 RX002459] from the VA Rehabilitation Research & Development Service.

Conflict of Interest

None declared.

Acknowledgements

The views, opinions, and/or findings contained in this article are those of the authors and should not be construed as an official Veterans Affairs or Department of Defense position, policy, or decision unless so designated by other official documentation.

Footnotes

1

Given high intercorrelations between measures of psychiatric distress (i.e., PCL-5 and PHQ-9), only one measure of psychiatric distress (PCL-5) was utilized as a covariate in our primary analyses. However, we also conducted follow-up analyses that included the PHQ-9 in lieu of the PCL-5, and results held. Finally, we simultaneously evaluated both measures of psychiatric distress (PCL-5 and PHQ-9) as covariates, and similar results were obtained.

2

The DRRI-2 (Section D) total score was used to reflect level of combat exposure.

References

Armistead-Jehle
,
P.
,
Cooper
,
D. B.
,
Grills
,
C. E.
,
Cole
,
W. R.
,
Lippa
,
S. M.
,
Stegman
,
R. L.
, et al. (
2018
).
Clinical utility of the mBIAS and NSI validity-10 to detect symptom over-reporting following mild TBI: A multicenter investigation with military service members
.
Journal of Clinical and Experimental Neuropsychology
,
40
(
3
),
213
223
.

Ashendorf
,
L.
(
2019
).
Neurobehavioral symptom validity in US Department of Veterans Affairs (VA) mild traumatic brain injury evaluations
.
Journal of Clinical and Experimental Neuropsychology
,
41
(
4
),
432
441
.

Balba
,
N. M.
,
Elliott
,
J. E.
,
Weymann
,
K. B.
,
Opel
,
R. A.
,
Duke
,
J. W.
,
Oken
,
B. S.
, et al. (
2018
).
Increased sleep disturbances and pain in veterans with comorbid traumatic brain injury and posttraumatic stress disorder
.
Journal of Clinical Sleep Medicine
,
14
(
11
),
1865
1878
.

Belanger
,
H. G.
,
Curtiss
,
G.
,
Demery
,
J. A.
,
Lebowitz
,
B. K.
, &
Vanderploeg
,
R. D.
(
2005
).
Factors moderating neuropsychological outcomes following mild traumatic brain injury: A meta-analysis
.
Journal of the International Neuropsychological Society
,
11
(
3
),
215
227
.

Belanger
,
H. G.
,
Kretzmer
,
T.
,
Vanderploeg
,
R. D.
, &
French
,
L. M.
(
2010a
).
Symptom complaints following combat-related traumatic brain injury: Relationship to traumatic brain injury severity and posttraumatic stress disorder
.
Journal of the International Neuropsychological Society
,
16
(
1
),
194
199
.

Belanger
,
H. G.
,
Spiegel
,
E.
, &
Vanderploeg
,
R. D.
(
2010b
).
Neuropsychological performance following a history of multiple self-reported concussions: A meta-analysis
.
Journal of the International Neuropsychological Society
,
16
(
2
),
262
267
.

Benedict
,
R. H. B.
(
1997
).
Brief Visuospatial Memory Test-Revised: Professional Manual
.
Odessa, FL
:
Psychological Assessment Resources
.

Bodapati
,
A. S.
,
Combs
,
H. L.
,
Pastorek
,
N. J.
,
Miller
,
B.
,
Troyanskaya
,
M.
,
Romesser
,
J.
, et al. (
2019
).
Detection of symptom over-reporting on the neurobehavioral symptom inventory in OEF/OIF/OND veterans with history of mild TBI
.
The Clinical Neuropsychologist
,
33
(
3
),
539
556
.

Bosco
,
M. A.
,
Murphy
,
J. L.
, &
Clark
,
M. E.
(
2013
).
Chronic pain and traumatic brain injury in OEF/OIF service members and veterans
.
Headache: The Journal of Head and Face Pain
,
53
(
9
),
1518
1522
.

Boyle
,
E.
,
Cancelliere
,
C.
,
Hartvigsen
,
J.
,
Carroll
,
L. J.
,
Holm
,
L. W.
, &
Cassidy
,
J. D.
(
2014
).
Systematic review of prognosis after mild traumatic brain injury in the military: Results of the international collaboration on mild traumatic brain injury prognosis
.
Archives of Physical Medicine and Rehabilitation
,
95
(
3
),
S230
S237
.

Bryan
,
C. J.
(
2013a
).
Multiple traumatic brain injury and concussive symptoms among deployed military personnel
.
Brain Injury
,
27
(
12
),
1333
1337
.

Bryan
,
C. J.
(
2013b
).
Repetitive traumatic brain injury (or concussion) increases severity of sleep disturbance among deployed military personnel
.
Sleep
,
36
(
6
),
941
946
.

Buysse
,
D.
,
Reynolds
,
C.
, III
,
Monk
,
T.
,
Berman
,
S.
, &
Kupfer
,
D.
(
1989
).
The Pittsburgh sleep quality index: A new instrument for psychiatric research and practice
.
Psychiatry research
,
28
(
2
),
193
213
.

Chapman
,
J. C.
, &
Diaz-Arrastia
,
R.
(
2014
).
Military traumatic brain injury: A review
.
Alzheimer's & Dementia
,
10
(
3
),
S97
S104
.

Cicerone
,
K.
, &
Kalmar
,
K.
(
1995
).
Persistent postconcussion syndrome: The structure of subjective complaints after mild traumatic brain injury
.
Journal of Head Trauma Rehabilitation
,
10
(
3
),
1
17
.

Cifu
,
D. X.
,
Williams
,
R.
,
Hinds
,
S. R.
, &
Agyemang
,
A. A.
(
2018
).
Chronic effects of neurotrauma consortium: A combined comparative analysis of six studies—Introduction to special edition of brain injury
.
Brain Injury
,
32
(
10
),
1149
1155
.

Cooper
,
D. B.
,
Curtiss
,
G.
,
Armistead-Jehle
,
P.
,
Belanger
,
H. G.
,
Tate
,
D. F.
,
Reid
,
M.
, et al. (
2018
).
Neuropsychological performance and subjective symptom reporting in military service members with a history of multiple concussions: Comparison with a single concussion, posttraumatic stress disorder, and orthopedic trauma
.
Journal of Head Trauma Rehabilitation
,
33
(
2
),
81
90
.

Cooper
,
D. B.
,
Kennedy
,
J. E.
,
Cullen
,
M. A.
,
Critchfield
,
E.
,
Amador
,
R. R.
, &
Bowles
,
A. O.
(
2011
).
Association between combat stress and post-concussive symptom reporting in OEF/OIF service members with mild traumatic brain injuries
.
Brain Injury
,
25
(
1
),
1
7
.

Defense and Veterans Brain Injury Center
(
2018
).
DoD Worldwide Numbers for TBI
.
Falls Church, VA
:
Defense and Veterans Brain Injury Center
.

DeKosky
,
S. T.
, &
Asken
,
B. M.
(
2017
).
Injury cascades in TBI-related neurodegeneration
.
Brain Injury
,
31
(
9
),
1177
1182
.

Delis
,
D.
,
Kaplan
,
E.
, &
Kramer
,
J.
(
2001
).
Delis-Kaplan Executive Function System (D-KEFS)
.
San Antonio, TX
:
The Psychological Corporation
.

Delis
,
D.
,
Kramer
,
J.
,
Kaplan
,
E.
, &
Ober
,
B.
(
2000
).
California Verbal Learning Test: Adult version manual
( 2nd ed.).
San Antonio, TX
:
The Psychological Corporation
.

Derogatis
,
L. R.
(
1994
).
SCL-90-R Administration, Scoring, and Procedures Manual
( 3rd ed.).
Minneapolis, MN
:
National Computer Systems
.

Dikmen
,
S.
,
Machamer
,
J.
, &
Temkin
,
N.
(
2017
).
Mild traumatic brain injury: Longitudinal study of cognition, functional status, and post-traumatic symptoms
.
Journal of Neurotrauma
,
34
(
8
),
1524
1530
.

Dretsch
,
M. N.
,
Silverberg
,
N. D.
, &
Iverson
,
G. L.
(
2015
).
Multiple past concussions are associated with ongoing post-concussive symptoms but not cognitive impairment in active-duty army soldiers
.
Journal of Neurotrauma
,
32
(
17
),
1301
1306
.

Field
,
A.
(
2013
).
Discovering Statistics Using IBM SPSS Statistics
( 4th ed.).
London
:
SAGE
.

Fields
,
L.
,
Didehbani
,
N.
,
Hart
,
J.
, &
Cullum
,
C. M.
(
2019
).
No linear association between number of concussions or years played and cognitive outcomes in retired NFL players
.
Archives of Clinical Neuropsychology
,
[epub ahead of print]
.

French
,
L. M.
,
Lange
,
R. T.
, &
Brickell
,
T. A.
(
2014
).
Subjective cognitive complaints and neuropsychological test performance following military-related traumatic brain injury
.
Journal of Rehabilitation Research and Development
,
51
(
6
),
933
950
.

Galarneau
,
M. R.
,
Woodruff
,
S. I.
,
Dye
,
J. L.
,
Mohrle
,
C. R.
, &
Wade
,
A. L.
(
2008
).
Traumatic brain injury during operation Iraqi freedom: Findings from the United States Navy–Marine Corps Combat Trauma Registry
.
Journal of Neurosurgery
,
108
(
5
),
950
957
.

Garber
,
B. G.
,
Rusu
,
C.
, &
Zamorski
,
M. A.
(
2014
).
Deployment-related mild traumatic brain injury, mental health problems, and post-concussive symptoms in Canadian Armed Forces personnel
.
BMC Psychiatry
,
14
(
1
),
325
.

Hoge
,
C. W.
,
McGurk
,
D.
,
Thomas
,
J. L.
,
Cox
,
A. L.
,
Engel
,
C. C.
, &
Castro
,
C. A.
(
2008
).
Mild traumatic brain injury in US soldiers returning from Iraq
.
New England Journal of Medicine
,
358
(
5
),
453
463
.

Hou
,
R.
,
Moss-Morris
,
R.
,
Peveler
,
R.
,
Mogg
,
K.
,
Bradley
,
B. P.
, &
Belli
,
A.
(
2012
).
When a minor head injury results in enduring symptoms: A prospective investigation of risk factors for postconcussional syndrome after mild traumatic brain injury
.
Journal of Neurology, Neurosurgery, and Psychiatry
,
83
(
2
),
217
223
.

Jurick
,
S. M.
,
Twamley
,
E. W.
,
Crocker
,
L. D.
,
Hays
,
C. C.
,
Orff
,
H. J.
,
Golshan
,
S.
, et al. (
2016
).
Postconcussive symptom overreporting in Iraq/Afghanistan veterans with mild traumatic brain injury
.
Journal of Rehabilitation Research & Development
,
53
(
5
),
571
584
.

Karr
,
J. E.
,
Rau
,
H. K.
,
Shofer
,
J. B.
,
Hendrickson
,
R. C.
,
Peskind
,
E. R.
, &
Pagulayan
,
K. F.
(
2019
).
Variables associated with subjective cognitive change among Iraq and Afghanistan war veterans with blast-related mild traumatic brain injury
.
Journal of Clinical and Experimental Neuropsychology
,
[epub ahead of print]
.

Kelly
,
M. P.
,
Coldren
,
R. L.
,
Parish
,
R. V.
,
Dretsch
,
M. N.
, &
Russell
,
M. L.
(
2012
).
Assessment of acute concussion in the combat environment
.
Archives of Clinical Neuropsychology
,
27
(
4
),
375
388
.

Kongs
,
S. K.
,
Thompson
,
L. L.
,
Iverson
,
G. L.
, &
Heaton
,
R.
(
2000
).
Wisconsin Card Sorting Test-64 Card Version (WCST-64)
.
Odessa, FL
:
Psychological Assessment Resources
.

Kontos
,
A. P.
,
Collins
,
M. W.
,
Holland
,
C. L.
,
Reeves
,
V. L.
,
Edelman
,
K.
,
Benso
,
S.
, et al. (
2018
).
Preliminary evidence for improvement in symptoms, cognitive, vestibular, and oculomotor outcomes following targeted intervention with chronic mTBI patients
.
Military Medicine
,
183
,
333
338
.

Kroenke
,
K.
,
Spitzer
,
R. L.
, &
Williams
,
J. B.
(
2001
).
The PHQ-9: Validity of a brief depression severity measure
.
Journal of General Internal Medicine
,
16
(
9
),
606
613
.

Lange
,
R. T.
,
Brickell
,
T. A.
, &
French
,
L. M.
(
2015a
).
Examination of the mild brain injury atypical symptom scale and the Validity-10 scale to detect symptom exaggeration in US military service members
.
Journal of Clinical and Experimental Neuropsychology
,
37
(
3
),
325
337
.

Lange
,
R. T.
,
Brickell
,
T. A.
,
Lippa
,
S. M.
, &
French
,
L. M.
(
2015b
).
Clinical utility of the neurobehavioral symptom inventory validity scales to screen for symptom exaggeration following traumatic brain injury
.
Journal of Clinical and Experimental Neuropsychology
,
37
(
8
),
853
862
.

Lindquist
,
L. K.
,
Love
,
H. C.
, &
Elbogen
,
E. B.
(
2017
).
Traumatic brain injury in Iraq and Afghanistan veterans: New results from a national random sample study
.
The Journal of Neuropsychiatry and Clinical Neurosciences
,
29
(
3
),
254
259
.

Lippa
,
S. M.
,
Pastorek
,
N. J.
,
Benge
,
J. F.
, &
Thornton
,
G. M.
(
2010
).
Postconcussive symptoms after blast and nonblast-related mild traumatic brain injuries in Afghanistan and Iraq war veterans
.
Journal of the International Neuropsychological Society
,
16
(
5
),
856
866
.

Lu
,
L. H.
,
Cooper
,
D. B.
,
Reid
,
M. W.
,
Khokhar
,
B.
,
Tsagaratos
,
J. E.
, &
Kennedy
,
J. E.
(
2019
).
Symptom reporting patterns of US military service members with a history of concussion according to duty status
.
Archives of Clinical Neuropsychology
,
34
(
2
),
236
242
.

MacGregor
,
A. J.
,
Dougherty
,
A. L.
,
Morrison
,
R. H.
,
Quinn
,
K. H.
, &
Galarneau
,
M. R.
(
2011
).
Repeated concussion among US military personnel during operation Iraqi freedom
.
Journal of Rehabilitation Research & Development
,
48
,
1269
1278
.

Mashima
,
P.
,
Waldron-Perrine
,
B.
,
Seagly
,
K.
,
Milman
,
L.
,
Ashman
,
T.
,
Mudar
,
R.
, et al. (
2019
).
Looking beyond test results: Interprofessional collaborative management of persistent mild traumatic brain injury symptoms
.
Topics in Language Disorders
,
39
(
3
),
293
312
.

Melzack
,
R.
(
1987
).
The short-form McGill pain questionnaire
.
Pain
,
30
(
2
),
191
197
.

Merritt
,
V. C.
,
Clark
,
A. L.
,
Crocker
,
L. D.
,
Sorg
,
S. F.
,
Werhane
,
M. L.
,
Bondi
,
M. W.
, et al. (
2018
).
Repetitive mild traumatic brain injury in military veterans is associated with increased neuropsychological intra-individual variability
.
Neuropsychologia
,
119
,
340
348
.

Merritt
,
V. C.
,
Meyer
,
J. E.
, &
Arnett
,
P. A.
(
2015
).
A novel approach to classifying postconcussion symptoms: The application of a new framework to the post-concussion symptom scale
.
Journal of Clinical and Experimental Neuropsychology
,
37
(
7
),
764
775
.

Miller
,
K. J.
,
Ivins
,
B. J.
, &
Schwab
,
K. A.
(
2013
).
Self-reported mild TBI and postconcussive symptoms in a peacetime active duty military population: Effect of multiple TBI history versus single mild TBI
.
The Journal of Head Trauma Rehabilitation
,
28
(
1
),
31
38
.

Mitchell
,
K. L.
(
2017
).
Nonpathologic postdeployment transition symptoms in combat National Guard members and reservists
.
Federal Practitioner
,
34
(
7
),
16
22
.

Nelson
,
N.
,
Disner
,
S.
,
Anderson
,
C.
,
Doane
,
B.
,
McGuire
,
K.
,
Lamberty
,
G.
, et al. (
2019
).
Blast concussion and posttraumatic stress as predictors of postcombat neuropsychological functioning in OEF/OIF/OND veterans
.
Neuropsychology
,
[epub ahead of print]
.

O'Neil
,
M. E.
,
Carlson
,
K. F.
,
Storzbach
,
D.
,
Brenner
,
L.
,
Freeman
,
M.
,
Quinones
,
A.
, et al. (
2013
).
Complications of Mild Traumatic Brain Injury in Veterans and Military Personnel: A Systematic Review
.
Washington, DC
:
Department of Veterans Affairs
.

O'Neil
,
M. E.
,
Carlson
,
K. F.
,
Storzbach
,
D.
,
Brenner
,
L. A.
,
Freeman
,
M.
,
Quiñones
,
A. R.
, et al. (
2014
).
Factors associated with mild traumatic brain injury in veterans and military personnel: A systematic review
.
Journal of the International Neuropsychological Society
,
20
(
3
),
249
261
.

Polusny
,
M. A.
,
Kehle
,
S. M.
,
Nelson
,
N. W.
,
Erbes
,
C. R.
,
Arbisi
,
P. A.
, &
Thuras
,
P.
(
2011
).
Longitudinal effects of mild traumatic brain injury and posttraumatic stress disorder comorbidity on postdeployment outcomes in National Guard soldiers deployed to Iraq
.
Archives of General Psychiatry
,
68
(
1
),
79
89
.

Rohling
,
M. L.
,
Binder
,
L. M.
,
Demakis
,
G. J.
,
Larrabee
,
G. J.
,
Ploetz
,
D. M.
, &
Langhinrichsen-Rohling
,
J.
(
2011
).
A meta-analysis of neuropsychological outcome after mild traumatic brain injury: Re-analyses and reconsiderations of Binder et al., Frencham et al., and Pertab et al.
The Clinical Neuropsychologist
,
25
(
4
),
608
623
.

Schretlen
,
D. J.
, &
Shapiro
,
A. M.
(
2003
).
A quantitative review of the effects of traumatic brain injury on cognitive functioning
.
International Review of Psychiatry
,
15
(
4
),
341
349
.

Schwab
,
K.
,
Terrio
,
H. P.
,
Brenner
,
L. A.
,
Pazdan
,
R. M.
,
McMillan
,
H. P.
,
MacDonald
,
M.
, et al. (
2017
).
Epidemiology and prognosis of mild traumatic brain injury in returning soldiers: A cohort study
.
Neurology
,
88
(
16
),
1571
1579
.

Spencer
,
R. J.
,
Drag
,
L. L.
,
Walker
,
S. J.
, &
Bieliauskas
,
L. A.
(
2010
).
Self-reported cognitive symptoms following mild traumatic brain injury are poorly associated with neuropsychological performance in OIF/OEF veterans
.
Journal of Rehabilitation Research & Development
,
47
(
6
),
521
530
.

Spira
,
J. L.
,
Lathan
,
C. E.
,
Bleiberg
,
J.
, &
Tsao
,
J. W.
(
2014
).
The impact of multiple concussions on emotional distress, post-concussive symptoms, and neurocognitive functioning in active duty United States marines independent of combat exposure or emotional distress
.
Journal of Neurotrauma
,
31
(
22
),
1823
1834
.

Stern
,
R. A.
,
Riley
,
D. O.
,
Daneshvar
,
D. H.
,
Nowinski
,
C. J.
,
Cantu
,
R. C.
, &
McKee
,
A. C.
(
2011
).
Long-term consequences of repetitive brain trauma: Chronic traumatic encephalopathy
.
PM&R
,
3
(
10
),
S460
S467
.

Stojanovic
,
M. P.
,
Fonda
,
J.
,
Fortier
,
C. B.
,
Higgins
,
D. M.
,
Rudolph
,
J. L.
,
Milberg
,
W. P.
, et al. (
2016
).
Influence of mild traumatic brain injury (TBI) and posttraumatic stress disorder (PTSD) on pain intensity levels in OEF/OIF/OND veterans
.
Pain Medicine
,
17
(
11
),
2017
2025
.

Tanielian
,
T.
, &
Jaycox
,
L. H.
(
2008
).
Invisible Wounds of War: Psychological and Cognitive Injuries, Their Consequences, and Services to Assist Recovery
.
Santa Monica, CA
:
Rand Corporation
.

Terrio
,
H.
,
Brenner
,
L. A.
,
Ivins
,
B. J.
,
Cho
,
J. M.
,
Helmick
,
K.
,
Schwab
,
K.
, et al. (
2009
).
Traumatic brain injury screening: Preliminary findings in a US Army Brigade Combat Team
.
The Journal of Head Trauma Rehabilitation
,
24
(
1
),
14
23
.

The Management of Concussion/mTBI Working Group
(
2009
).
VA/DoD clinical practice guideline for the management of concussion/mild traumatic brain injury (mTBI): Guideline summary.
Washington, DC
:
Department of Veterans Affairs, Department of Defense
.

The Management of Concussion/mTBI Working Group
(
2016
).
VA/DoD clinical practice guideline for the management of concussion/mild traumatic brain injury (mtbi): guideline summary
.
Washington, DC
:
Department of Veterans Affairs, Department of Defense
.

Tombaugh
,
T. N.
(
1996
).
Test of Memory Malingering: TOMM
.
Tonawanda, NY
:
Multi-Health Systems North
.

Vanderploeg
,
R. D.
,
Belanger
,
H. G.
,
Curtiss
,
G.
,
Bowles
,
A. O.
, &
Cooper
,
D. B.
(
2019
).
Reconceptualizing rehabilitation of individuals with chronic symptoms following mild traumatic brain injury
.
Rehabilitation Psychology
,
64
(
1
),
1
12
.

Vanderploeg
,
R. D.
,
Cooper
,
D. B.
,
Belanger
,
H. G.
,
Donnell
,
A. J.
,
Kennedy
,
J. E.
,
Hopewell
,
C. A.
, et al. (
2014
).
Screening for postdeployment conditions: Development and cross-validation of an embedded validity scale in the neurobehavioral symptom inventory
.
The Journal of Head Trauma Rehabilitation
,
29
(
1
),
1
10
.

Vanderploeg
,
R. D.
,
Curtiss
,
G.
,
Luis
,
C. A.
, &
Salazar
,
A. M.
(
2007
).
Long-term morbidities following self-reported mild traumatic brain injury
.
Journal of Clinical and Experimental Neuropsychology
,
29
(
6
),
585
598
.

Vanderploeg
,
R. D.
,
Silva
,
M. A.
,
Soble
,
J. R.
,
Curtiss
,
G.
,
Belanger
,
H. G.
,
Donnell
,
A. J.
, et al. (
2015
).
The structure of postconcussion symptoms on the neurobehavioral symptom inventory: A comparison of alternative models
.
Journal of Head Trauma Rehabilitation
,
30
(
1
),
1
11
.

Vasterling
,
J. J.
,
Proctor
,
S. P.
,
Amoroso
,
P.
,
Kane
,
R.
,
Heeren
,
T.
, &
White
,
R. F.
(
2006
).
Neuropsychological outcomes of Army personnel following deployment to the Iraq war
.
JAMA
,
296
(
5
),
519
529
.

Vincent
,
A. S.
,
Roebuck-Spencer
,
T. M.
, &
Cernich
,
A.
(
2014
).
Cognitive changes and dementia risk after traumatic brain injury: Implications for aging military personnel
.
Alzheimer's & Dementia
,
10
(
3
),
S174
S187
.

Vogt
,
D.
,
Smith
,
B. N.
,
King
,
L. A.
,
King
,
D. W.
,
Knight
,
J.
, &
Vasterling
,
J. J.
(
2013
).
Deployment risk and resilience inventory-2 (DRRI-2): An updated tool for assessing psychosocial risk and resilience factors among service members and veterans
.
Journal of Traumatic Stress
,
26
(
6
),
710
717
.

Walker
,
W. C.
,
Carne
,
W.
,
Franke
,
L.
,
Nolen
,
T.
,
Dikmen
,
S.
,
Cifu
,
D.
, et al. (
2016
).
The chronic effects of neurotrauma consortium (CENC) multi-centre observational study: Description of study and characteristics of early participants
.
Brain Injury
,
30
(
12
),
1469
1480
.

Walker
,
W. C.
,
Cifu
,
D. X.
,
Hudak
,
A. M.
,
Goldberg
,
G.
,
Kunz
,
R. D.
, &
Sima
,
A. P.
(
2015
).
Structured interview for mild traumatic brain injury after military blast: Inter-rater agreement and development of diagnostic algorithm
.
Journal of Neurotrauma
,
32
(
7
),
464
473
.

Weathers
,
F. W.
,
Litz
,
B. T.
,
Keane
,
T. M.
,
Palmieri
,
P. A.
,
Marx
,
B. P.
, &
Schnurr
,
P. P.
(
2013
).
The PTSD Checklist for DSM-5 (PCL-5)
.
National Center for PTSD
.

Wechsler
,
D.
(
2008
).
Wechsler Adult Intelligence Scale–Fourth Edition (WAIS–IV)
.
San Antonio, TX
:
NCS Pearson
.

Wilk
,
J. E.
,
Herrell
,
R. K.
,
Wynn
,
G. H.
,
Riviere
,
L. A.
, &
Hoge
,
C. W.
(
2012
).
Mild traumatic brain injury (concussion), posttraumatic stress disorder, and depression in US soldiers involved in combat deployments: Association with postdeployment symptoms
.
Psychosomatic Medicine
,
74
(
3
),
249
257
.

Wilkinson
,
G. S.
, &
Robertson
,
G.
(
2006
).
Wide Range Achievement Test 4 (WRAT4)
.
Lutz, FL
:
Psychological Assessment Resources, Inc.

Zhang
,
Y.
,
Ma
,
Y.
,
Chen
,
S.
,
Liu
,
X.
,
Kang
,
H. J.
,
Nelson
,
S.
, et al. (
2019
).
Long-term cognitive performance of retired athletes with sport-related concussion: A systematic review and meta-analysis
.
Brain Sciences
,
9
(
8
),
199
.

This work is written by US Government employees and is in the public domain in the US.