Abstract

Background

A better understanding of long-term health effects after severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection has become one of the health care priorities in the current pandemic. We analyzed a large and diverse patient cohort to study health effects related to SARS-CoV-2 infection occurring >1 month postinfection.

Methods

We analyzed 17 487 patients who received diagnoses for SARS-CoV-2 infection in a total of 122 health care facilities in the United States before April 14, 2022. Patients were propensity score–matched with patients diagnosed with the common cold, influenza, or viral pneumonia from March 1, 2020, to April 1, 2021. For each outcome, SARS-CoV-2 was compared with a generic viral respiratory infection (VRI) by predicting diagnoses in the period between 30 and 365 days postinfection. Both coronavirus disease 2019 (COVID-19) and VRI patients were propensity score–matched with patients with no record of COVID-19 or VRI, and the same methodology was applied. Diagnoses where COVID-19 infection was a significant positive predictor in both COVID-19 vs VRI and COVID-19 vs control comparisons were considered COVID-19-specific effects.

Results

Compared with common VRIs, SARS-CoV-2 was associated with diagnoses of palpitations, hair loss, fatigue, chest pain, dyspnea, joint pain, and obesity in the postinfectious period.

Conclusions

We identify that some diagnoses commonly described as “long COVID” do not appear significantly more frequent post–COVID-19 infection compared with other common VRIs. We also identify sequelae that are specifically associated with a prior SARS-CoV-2 infection.

Since the beginning of the pandemic in 2020, a growing number of patients infected with the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) virus have reported persistent, long-lasting symptoms that continue long beyond the normal duration of SARS-CoV-2 infection. Some of these symptoms are widely reported, such as fatigue [1–7], brain fog [4, 8–10], and shortness of breath [1, 3, 10, 11], but many other long-term health effects of SARS-CoV-2 infection remain underexplored. Beyond the obvious potential for long-term respiratory effects, many cardiovascular, neurological, gastrointestinal, musculoskeletal, metabolic, and immune-mediated effects have been suggested to persist long after the infectious period of SARS-CoV-2 [1–3, 8, 9, 11–21]. These effects range from non-life-threatening conditions, such as excessive eating [16] or hair loss [17], in post–coronavirus disease 2019 (COVID-19) patients to significantly increased risk of serious medical events associated with a substantial risk of mortality, such as myocarditis [15]. A better understanding of the long-term effects of SARS-CoV-2 infection is critical for public health. Furthermore, other respiratory viruses including influenza have been noted to have long-term implications, elucidating the need to identify specific long-term effects of COVID-19. Due to the complex multisystem nature of COVID-19, it is also necessary to account for the widest possible array of possible confounders in the form of comorbidities and past medical history. Aggregated electronic health record (EHR) data allow for large-scale studies into diverse patient populations using recent data, which makes EHR data ideal in many ways for studying the ongoing pandemic. The quantity and diversity of patients allow for the study of effects of infection on even relatively uncommon conditions, which would be too rare to study in smaller general-purpose EHR data sets. Due to the widespread nature of SARS-CoV-2 infections, it has become important to determine what health conditions infection is associated with in the long-term. It is also necessary to estimate how much the risk of developing these long-term effects is increased by SARS-CoV-2 infection specifically, increased risk that is not associated with other common respiratory viruses. Previous work has briefly investigated the differences in outcomes between hospitalized COVID-19 and influenza patients [22]. Our work provides additional information on this subject by analyzing a larger and more diverse patient cohort, including other common viral respiratory infections, and examining outcomes in patient cohorts not limited to patients hospitalized for the initial infection.

METHODS

This study is focused on identifying long-term, persistent effects of COVID-19. In some cases, COVID-19 patients may remain infectious for up to 21 days [23] after symptom onset, and normal recovery from the illness may take additional time. We excluded diagnoses within the first 30 days after the index encounter to ensure that diagnoses observed to be associated with an earlier COVID-19 infection represented truly long-term effects of the illness.

Patients

We analyzed data from the Cerner Real-World Data data set extracted from the electronic medical records of health care facilities that have a data use agreement with Cerner Corporation [24].

The methodological aspects of the data set are available in other publications [25, 26]. The Cerner Real-World Data–COVID–March 2022 version of the data included data from 122 contributing Cerner Real-World Data health systems in United States. Encounters may include pharmacy, clinical, microbiology laboratory, admission, and billing information from affiliated patient care locations. All admissions, medication orders and dispensing, laboratory orders, and specimens are date- and time-stamped, providing a temporal relationship between treatment patterns and clinical information. Cerner Corporation has established Health Insurance Portability and Accountability Act–compliant operating policies to establish de-identification for Cerner Real-World Data. The data are based on electronic medical records before April 14, 2022. The data set, as part of the de-identification procedure, does not provide an identifier for the medical institution, nor does it provide its precise geographical location.

Our analysis identified COVID-19 patients using International Classification of Diseases, Tenth Revision, Clinical Modification (ICD-10-CM), codes. Index encounters for COVID-19 and non-COVID-19 patients were sampled from medical encounters between March 1, 2020, and April 1, 2021, to ensure that all patients had up to 365 days after their index encounter to receive new diagnoses. Patients under the age of 18 were excluded from this analysis. The index encounter for COVID-19-positive patients was identified as the first medical encounter for each patient containing the ICD-10 code for pneumonia due to COVID-19 (J12.82) or COVID-19 (U07.1). The index encounter for the viral respiratory infection (VRI) population data was identified from patients diagnosed with the common cold (J00), influenza (J09-J11), or viral pneumonia (J12) and defined as the first medical encounter for each patient containing any of the VRI ICD-10 codes within the study period. Patients diagnosed with COVID-19 at any point were excluded from this VRI population. A third population without any record of COVID-19 or VRI was also extracted from the same time period. The index encounter for this group was defined as a random encounter from within the same time period as the index encounters for the COVID-19 and VRI groups. To ensure completeness of records, all patients analyzed in this study were required to have ≥2 medical encounters of any type in the year before their index encounter and ≥2 medical encounters of any type in the year following their index encounter. Patient demographic information consisting of age, sex, and race was extracted for all patients. Clinical event covariates, defined using ICD-10 codes (shown in Table 1), were extracted for all patients and were categorized into past history (>1 year before index encounter), recent history (<1 year before index encounter), index encounter (occurred during index encounter), and postencounter (occurred 30–365 days after index encounter). Each clinical covariate is a true/false value representing whether each patient in the data set experienced that specific clinical event during the specified time period. For example, a patient for whom the variable “index encounter fever” has the value of “true” was diagnosed with a fever during their index encounter.

Table 1.

ICD-10 Codes Used to Define Diagnoses

DiagnosisICD-10 Codes
Hair LossL65
HeadacheR51/G44/G43
MyocarditisI40/I41/I51.4/I09.0
Heart FailureI09.81/I11.0/I50
TachycardiaI47/R00.0
ObesityE66.0/E66.1/E66.2/E66.8/E66.9/Z68.3/Z68.4
PalpitationsR00.2
FatigueR53.8/G93.3
WeaknessR53.1/M62.81/R26.89
CoughR05
DyspneaR06.0
MyalgiaM79.1/M60
TinnitusH93.1
Chest PainR07.1/R07.8/R07.9
Joint PainM25.5
AnosmiaR43.0
Unspecified AnemiaD64.9
FeverR50
DiarrheaK59.1/R19.7
HypoxemiaR09.02
PneumoniaJ12-J18
Dependence on Respirator or OxygenZ99.81
CKDN18
ARDSJ80
COPDJ44
AsthmaJ45
Other Respiratory FailureJ96
Pulmonary EmbolismI26
Septic ShockR65.21
Ischemic StrokeI63/I65/I66
Intracerebral HemorrhageI61
Subarachnoid HemorrhageI60
Acute Myocardial InfarctionI21/I22/I25.2
Unstable AnginaI20.0
HyperlipidemiaE78
HypertensionI10/O10.0/O10.9/I16/I6.74
Type 1 DiabetesE10
Type 2 DiabetesE11
Nicotine Dependence/Tobacco UseF17/Z72.0
Atrial FibrillationI48
Alcohol Use or AbuseF10
Cognitive ImpairmentR40/R41/R48/G93.40/G31.84/G30/F01/F02/F03/F05/F06.8/G30/G31.0/G31.83
Rheumatoid ArthritisM05/M06
LupusM32
Anxiety/DepressionF30-/F48
Unspecified PainG89/R52
Peripheral NeuropathyG60–G65
DiagnosisICD-10 Codes
Hair LossL65
HeadacheR51/G44/G43
MyocarditisI40/I41/I51.4/I09.0
Heart FailureI09.81/I11.0/I50
TachycardiaI47/R00.0
ObesityE66.0/E66.1/E66.2/E66.8/E66.9/Z68.3/Z68.4
PalpitationsR00.2
FatigueR53.8/G93.3
WeaknessR53.1/M62.81/R26.89
CoughR05
DyspneaR06.0
MyalgiaM79.1/M60
TinnitusH93.1
Chest PainR07.1/R07.8/R07.9
Joint PainM25.5
AnosmiaR43.0
Unspecified AnemiaD64.9
FeverR50
DiarrheaK59.1/R19.7
HypoxemiaR09.02
PneumoniaJ12-J18
Dependence on Respirator or OxygenZ99.81
CKDN18
ARDSJ80
COPDJ44
AsthmaJ45
Other Respiratory FailureJ96
Pulmonary EmbolismI26
Septic ShockR65.21
Ischemic StrokeI63/I65/I66
Intracerebral HemorrhageI61
Subarachnoid HemorrhageI60
Acute Myocardial InfarctionI21/I22/I25.2
Unstable AnginaI20.0
HyperlipidemiaE78
HypertensionI10/O10.0/O10.9/I16/I6.74
Type 1 DiabetesE10
Type 2 DiabetesE11
Nicotine Dependence/Tobacco UseF17/Z72.0
Atrial FibrillationI48
Alcohol Use or AbuseF10
Cognitive ImpairmentR40/R41/R48/G93.40/G31.84/G30/F01/F02/F03/F05/F06.8/G30/G31.0/G31.83
Rheumatoid ArthritisM05/M06
LupusM32
Anxiety/DepressionF30-/F48
Unspecified PainG89/R52
Peripheral NeuropathyG60–G65

Abbreviations: ARDS, acute respiratory distress syndrome; CKD, chronic kidney disease; COPD, chronic obstructive pulmonary disease; ICD-10, International Classification of Diseases, Tenth Revision.

Table 1.

ICD-10 Codes Used to Define Diagnoses

DiagnosisICD-10 Codes
Hair LossL65
HeadacheR51/G44/G43
MyocarditisI40/I41/I51.4/I09.0
Heart FailureI09.81/I11.0/I50
TachycardiaI47/R00.0
ObesityE66.0/E66.1/E66.2/E66.8/E66.9/Z68.3/Z68.4
PalpitationsR00.2
FatigueR53.8/G93.3
WeaknessR53.1/M62.81/R26.89
CoughR05
DyspneaR06.0
MyalgiaM79.1/M60
TinnitusH93.1
Chest PainR07.1/R07.8/R07.9
Joint PainM25.5
AnosmiaR43.0
Unspecified AnemiaD64.9
FeverR50
DiarrheaK59.1/R19.7
HypoxemiaR09.02
PneumoniaJ12-J18
Dependence on Respirator or OxygenZ99.81
CKDN18
ARDSJ80
COPDJ44
AsthmaJ45
Other Respiratory FailureJ96
Pulmonary EmbolismI26
Septic ShockR65.21
Ischemic StrokeI63/I65/I66
Intracerebral HemorrhageI61
Subarachnoid HemorrhageI60
Acute Myocardial InfarctionI21/I22/I25.2
Unstable AnginaI20.0
HyperlipidemiaE78
HypertensionI10/O10.0/O10.9/I16/I6.74
Type 1 DiabetesE10
Type 2 DiabetesE11
Nicotine Dependence/Tobacco UseF17/Z72.0
Atrial FibrillationI48
Alcohol Use or AbuseF10
Cognitive ImpairmentR40/R41/R48/G93.40/G31.84/G30/F01/F02/F03/F05/F06.8/G30/G31.0/G31.83
Rheumatoid ArthritisM05/M06
LupusM32
Anxiety/DepressionF30-/F48
Unspecified PainG89/R52
Peripheral NeuropathyG60–G65
DiagnosisICD-10 Codes
Hair LossL65
HeadacheR51/G44/G43
MyocarditisI40/I41/I51.4/I09.0
Heart FailureI09.81/I11.0/I50
TachycardiaI47/R00.0
ObesityE66.0/E66.1/E66.2/E66.8/E66.9/Z68.3/Z68.4
PalpitationsR00.2
FatigueR53.8/G93.3
WeaknessR53.1/M62.81/R26.89
CoughR05
DyspneaR06.0
MyalgiaM79.1/M60
TinnitusH93.1
Chest PainR07.1/R07.8/R07.9
Joint PainM25.5
AnosmiaR43.0
Unspecified AnemiaD64.9
FeverR50
DiarrheaK59.1/R19.7
HypoxemiaR09.02
PneumoniaJ12-J18
Dependence on Respirator or OxygenZ99.81
CKDN18
ARDSJ80
COPDJ44
AsthmaJ45
Other Respiratory FailureJ96
Pulmonary EmbolismI26
Septic ShockR65.21
Ischemic StrokeI63/I65/I66
Intracerebral HemorrhageI61
Subarachnoid HemorrhageI60
Acute Myocardial InfarctionI21/I22/I25.2
Unstable AnginaI20.0
HyperlipidemiaE78
HypertensionI10/O10.0/O10.9/I16/I6.74
Type 1 DiabetesE10
Type 2 DiabetesE11
Nicotine Dependence/Tobacco UseF17/Z72.0
Atrial FibrillationI48
Alcohol Use or AbuseF10
Cognitive ImpairmentR40/R41/R48/G93.40/G31.84/G30/F01/F02/F03/F05/F06.8/G30/G31.0/G31.83
Rheumatoid ArthritisM05/M06
LupusM32
Anxiety/DepressionF30-/F48
Unspecified PainG89/R52
Peripheral NeuropathyG60–G65

Abbreviations: ARDS, acute respiratory distress syndrome; CKD, chronic kidney disease; COPD, chronic obstructive pulmonary disease; ICD-10, International Classification of Diseases, Tenth Revision.

In addition to specific clinical and demographic variables, we attempted to adjust for the frequency and intensity of pre–index encounter medical care by categorizing prior medical encounters into emergency, inpatient, outpatient, and other and recording the number of each available in each patient's records. Using these demographic and clinical variables, patients from the 3 cohorts were matched using propensity score matching to form 3 separate matched cohorts for comparison, COVID-19 vs VRI, COVID-19 vs noninfected, and VRI vs noninfected. Propensity scores were estimated with a logistic regression model using data for each patient from before or during their index encounter. Populations were propensity score–matched to ensure that the distributions of demographics and comorbidities were similar between the populations, as shown in Table 2. The full list of covariates, outcomes, and their frequencies in each comparison group is available in Supplementary Table 1.

Table 2.

Demographics of Study Population

COVID vs VRICOVID vs No InfectionVRI vs No Infection
CharacteristicsPatients With SARS-CoV-2, No. (%)Patients With VRI, No. (%)PPatients With SARS-CoV-2, No. (%)Patients With No Infection, No. (%)PPatients With VRI, No. (%)Patients With No Infection No. (%)P
Total17 487 (100.0)17 487 (100.0)-15 694 (100.0)15 694 (100.0)15 694 (100.0)15 694 (100.0)
Demographics
Age
 18–24 y1871 (10.7)1764 (10.1).06081436 (9.1)1609 (10.3).0011578 (10.1)1609 (10.3).5624
 25–34 y2534 (14.5)2572 (14.7).5652190 (14.0)2290 (14.6).10662288 (14.6)2290 (14.6).9745
 35–49 y3717 (21.3)3797 (21.7).29763394 (21.6)3346 (21.3).50943409 (21.7)3346 (21.3).3869
 50–64 y4525 (25.9)4655 (26.6).11414207 (26.8)4130 (26.3).32514192 (26.7)4130 (26.3).4279
 65–80 y3839 (22.0)3701 (21.2).07273540 (22.6)3342 (21.3).00693349 (21.3)3342 (21.3).9231
 >80 y1001 (5.7)998 (5.7).9449927 (5.9)977 (6.2).2371878 (5.6)977 (6.2).0178
Sex
 Sex: male5919 (33.8)5921 (33.9).9825362 (34.2)5108 (32.5).00245278 (33.6)5108 (32.5).0414
 Sex: female11 560 (66.1)11 561 (66.1).99110 324 (65.8)10 581 (67.4).002110 411 (66.3)10 581 (67.4).0415
Race/ethnicity
 Race: White12 816 (73.3)12 802 (73.2).865711 353 (72.3)11 578 (73.8).004211 533 (73.5)11 578 (73.8).5643
 Race: Black1794 (10.3)1723 (9.9).20681591 (10.1)1479 (9.4).03331520 (9.7)1479 (9.4).4311
 Race: Hispanic720 (4.1)737 (4.2).6491699 (4.5)504 (3.2)<.0001598 (3.8)504 (3.2).0039
 Race: Asian273 (1.6)254 (1.5).4043244 (1.6)239 (1.5).8187239 (1.5)239 (1.5)1
 Race: other1884 (10.8)1971 (11.3).13741807 (11.5)1894 (12.1).12781804 (11.5)1894 (12.1).1151
COVID vs VRICOVID vs No InfectionVRI vs No Infection
CharacteristicsPatients With SARS-CoV-2, No. (%)Patients With VRI, No. (%)PPatients With SARS-CoV-2, No. (%)Patients With No Infection, No. (%)PPatients With VRI, No. (%)Patients With No Infection No. (%)P
Total17 487 (100.0)17 487 (100.0)-15 694 (100.0)15 694 (100.0)15 694 (100.0)15 694 (100.0)
Demographics
Age
 18–24 y1871 (10.7)1764 (10.1).06081436 (9.1)1609 (10.3).0011578 (10.1)1609 (10.3).5624
 25–34 y2534 (14.5)2572 (14.7).5652190 (14.0)2290 (14.6).10662288 (14.6)2290 (14.6).9745
 35–49 y3717 (21.3)3797 (21.7).29763394 (21.6)3346 (21.3).50943409 (21.7)3346 (21.3).3869
 50–64 y4525 (25.9)4655 (26.6).11414207 (26.8)4130 (26.3).32514192 (26.7)4130 (26.3).4279
 65–80 y3839 (22.0)3701 (21.2).07273540 (22.6)3342 (21.3).00693349 (21.3)3342 (21.3).9231
 >80 y1001 (5.7)998 (5.7).9449927 (5.9)977 (6.2).2371878 (5.6)977 (6.2).0178
Sex
 Sex: male5919 (33.8)5921 (33.9).9825362 (34.2)5108 (32.5).00245278 (33.6)5108 (32.5).0414
 Sex: female11 560 (66.1)11 561 (66.1).99110 324 (65.8)10 581 (67.4).002110 411 (66.3)10 581 (67.4).0415
Race/ethnicity
 Race: White12 816 (73.3)12 802 (73.2).865711 353 (72.3)11 578 (73.8).004211 533 (73.5)11 578 (73.8).5643
 Race: Black1794 (10.3)1723 (9.9).20681591 (10.1)1479 (9.4).03331520 (9.7)1479 (9.4).4311
 Race: Hispanic720 (4.1)737 (4.2).6491699 (4.5)504 (3.2)<.0001598 (3.8)504 (3.2).0039
 Race: Asian273 (1.6)254 (1.5).4043244 (1.6)239 (1.5).8187239 (1.5)239 (1.5)1
 Race: other1884 (10.8)1971 (11.3).13741807 (11.5)1894 (12.1).12781804 (11.5)1894 (12.1).1151

P values were calculated using a 2-tailed chi-square test.

Abbreviations: SARS-CoV-2, severe acute respiratory syndrome coronavirus 2; VRI, viral respiratory infection.

Table 2.

Demographics of Study Population

COVID vs VRICOVID vs No InfectionVRI vs No Infection
CharacteristicsPatients With SARS-CoV-2, No. (%)Patients With VRI, No. (%)PPatients With SARS-CoV-2, No. (%)Patients With No Infection, No. (%)PPatients With VRI, No. (%)Patients With No Infection No. (%)P
Total17 487 (100.0)17 487 (100.0)-15 694 (100.0)15 694 (100.0)15 694 (100.0)15 694 (100.0)
Demographics
Age
 18–24 y1871 (10.7)1764 (10.1).06081436 (9.1)1609 (10.3).0011578 (10.1)1609 (10.3).5624
 25–34 y2534 (14.5)2572 (14.7).5652190 (14.0)2290 (14.6).10662288 (14.6)2290 (14.6).9745
 35–49 y3717 (21.3)3797 (21.7).29763394 (21.6)3346 (21.3).50943409 (21.7)3346 (21.3).3869
 50–64 y4525 (25.9)4655 (26.6).11414207 (26.8)4130 (26.3).32514192 (26.7)4130 (26.3).4279
 65–80 y3839 (22.0)3701 (21.2).07273540 (22.6)3342 (21.3).00693349 (21.3)3342 (21.3).9231
 >80 y1001 (5.7)998 (5.7).9449927 (5.9)977 (6.2).2371878 (5.6)977 (6.2).0178
Sex
 Sex: male5919 (33.8)5921 (33.9).9825362 (34.2)5108 (32.5).00245278 (33.6)5108 (32.5).0414
 Sex: female11 560 (66.1)11 561 (66.1).99110 324 (65.8)10 581 (67.4).002110 411 (66.3)10 581 (67.4).0415
Race/ethnicity
 Race: White12 816 (73.3)12 802 (73.2).865711 353 (72.3)11 578 (73.8).004211 533 (73.5)11 578 (73.8).5643
 Race: Black1794 (10.3)1723 (9.9).20681591 (10.1)1479 (9.4).03331520 (9.7)1479 (9.4).4311
 Race: Hispanic720 (4.1)737 (4.2).6491699 (4.5)504 (3.2)<.0001598 (3.8)504 (3.2).0039
 Race: Asian273 (1.6)254 (1.5).4043244 (1.6)239 (1.5).8187239 (1.5)239 (1.5)1
 Race: other1884 (10.8)1971 (11.3).13741807 (11.5)1894 (12.1).12781804 (11.5)1894 (12.1).1151
COVID vs VRICOVID vs No InfectionVRI vs No Infection
CharacteristicsPatients With SARS-CoV-2, No. (%)Patients With VRI, No. (%)PPatients With SARS-CoV-2, No. (%)Patients With No Infection, No. (%)PPatients With VRI, No. (%)Patients With No Infection No. (%)P
Total17 487 (100.0)17 487 (100.0)-15 694 (100.0)15 694 (100.0)15 694 (100.0)15 694 (100.0)
Demographics
Age
 18–24 y1871 (10.7)1764 (10.1).06081436 (9.1)1609 (10.3).0011578 (10.1)1609 (10.3).5624
 25–34 y2534 (14.5)2572 (14.7).5652190 (14.0)2290 (14.6).10662288 (14.6)2290 (14.6).9745
 35–49 y3717 (21.3)3797 (21.7).29763394 (21.6)3346 (21.3).50943409 (21.7)3346 (21.3).3869
 50–64 y4525 (25.9)4655 (26.6).11414207 (26.8)4130 (26.3).32514192 (26.7)4130 (26.3).4279
 65–80 y3839 (22.0)3701 (21.2).07273540 (22.6)3342 (21.3).00693349 (21.3)3342 (21.3).9231
 >80 y1001 (5.7)998 (5.7).9449927 (5.9)977 (6.2).2371878 (5.6)977 (6.2).0178
Sex
 Sex: male5919 (33.8)5921 (33.9).9825362 (34.2)5108 (32.5).00245278 (33.6)5108 (32.5).0414
 Sex: female11 560 (66.1)11 561 (66.1).99110 324 (65.8)10 581 (67.4).002110 411 (66.3)10 581 (67.4).0415
Race/ethnicity
 Race: White12 816 (73.3)12 802 (73.2).865711 353 (72.3)11 578 (73.8).004211 533 (73.5)11 578 (73.8).5643
 Race: Black1794 (10.3)1723 (9.9).20681591 (10.1)1479 (9.4).03331520 (9.7)1479 (9.4).4311
 Race: Hispanic720 (4.1)737 (4.2).6491699 (4.5)504 (3.2)<.0001598 (3.8)504 (3.2).0039
 Race: Asian273 (1.6)254 (1.5).4043244 (1.6)239 (1.5).8187239 (1.5)239 (1.5)1
 Race: other1884 (10.8)1971 (11.3).13741807 (11.5)1894 (12.1).12781804 (11.5)1894 (12.1).1151

P values were calculated using a 2-tailed chi-square test.

Abbreviations: SARS-CoV-2, severe acute respiratory syndrome coronavirus 2; VRI, viral respiratory infection.

Statistical Analysis

The effect of SARS-CoV-2 infection was assessed using a logistic regression analysis to test the influence of SARS-CoV-2 infection on the probability of developing each outcome in the period between 30 and 365 days after the index encounter. In addition to demographic factors and infection status, the presence of diagnoses/clinical events that occurred in the previously specified time intervals for past history, recent history, and during the index encounter was used as a predictor to predict diagnoses in the postencounter period. All P values are 2-tailed.

Due to the large number of outcomes being tested, P values for the effect of SARS-CoV-2 infection were adjusted for false discovery rate using the Benjamini-Hochberg Procedure [27] with an alpha of .01. Separate statistical analyses were carried out using the same methodology to assess the long-term effects of both COVID-19 infections and generic VRIs in comparison with the noninfected control group. We consider COVID-19 infection specifically to be associated with an outcome if its predicted effect is positive, with P < .05 in both the comparison against the noninfected control group and against patients with generic VRIs.

RESULTS

Compared with generic VRIs, SARS-CoV-2 infection during the index encounter was a significant positive predictor for receiving diagnoses of palpitations (OR, 1.32; 95% CI, 1.17–1.49), hair loss (OR, 1.32; 95% CI, 1.05–1.67), fatigue (OR, 1.13; 95% CI, 1.05–1.22), chest pain (OR, 1.1; 95% CI, 1.02–1.18), dyspnea (OR, 1.09; 95% CI, 1.01–1.16), joint pain (OR, 1.08; 95% CI, 1.02–1.15), and obesity (OR, 1.08; 95% CI, 1.01–1.15) in the time period between 30 and 365 days after the index encounter. The full list of effect estimates is shown in Figure 1, with exact values available in Table 3.

Effect of index encounter infection on the probability of receiving each diagnosis 30–365 days postinfection. Comparison of COVID-19 and generic respiratory virus using noninfected controls (left). Comparison of COVID vs generic respiratory viral infection (right). aDiagnoses that are significant in both COVID vs no infection and COVID vs VRI comparisons. Abbreviations: COVID-19, coronavirus 2019; VRI, viral respiratory infection.
Figure 1.

Effect of index encounter infection on the probability of receiving each diagnosis 30–365 days postinfection. Comparison of COVID-19 and generic respiratory virus using noninfected controls (left). Comparison of COVID vs generic respiratory viral infection (right). aDiagnoses that are significant in both COVID vs no infection and COVID vs VRI comparisons. Abbreviations: COVID-19, coronavirus 2019; VRI, viral respiratory infection.

Table 3.

Effect of Infection on Probability of Receiving Each Diagnosis 30–365 Days Postinfection

COVID vs VRICOVID vs No InfectionVRI vs No Infection
OutcomeOdds Ratio (95% CI)POdds Ratio (95% CI)POdds Ratio (95% CI)P
Type 1 diabetes1.71 (1.2–2.44).00281.0 (0.69–1.46).9980.48 (0.32–0.73).0004
ARDS1.63 (0.45–5.84).4530.67 (0.09–4.7).6840.53 (0.07–3.96).538
Palpitations1.42 (1.27–1.6)<.00011.32 (1.17–1.49)<.00010.95 (0.84–1.08).467
Pulmonary embolism1.36 (1.07–1.74).01290.84 (0.66–1.08).1730.64 (0.49–0.83).0009
Hair loss1.35 (1.08–1.67).00711.32 (1.05–1.67).01971.03 (0.8–1.31).831
Hypoxemia1.3 (1.13–1.51).00030.97 (0.83–1.13).6980.72 (0.61–0.85).0001
Tachycardia1.28 (1.15–1.42)<.00011.03 (0.92–1.16).5610.81 (0.72–0.91).0003
Other respiratory failure1.27 (1.12–1.44).00020.81 (0.71–0.92).00160.61 (0.53–0.71)<.0001
Dependence on respirator or oxygen1.26 (1.05–1.51).0140.94 (0.77–1.15).5450.72 (0.59–0.89).0026
Rheumatoid arthritis1.2 (0.95–1.52).1291.01 (0.79–1.3).9150.82 (0.64–1.06).131
Dyspnea1.19 (1.11–1.27)<.00011.09 (1.01–1.16).02060.93 (0.86–1.0).0442
Weakness1.19 (1.09–1.31).00021.02 (0.93–1.13).6380.86 (0.78–0.96).0044
Type 2 diabetes1.19 (1.08–1.32).00051.09 (0.98–1.21).1070.94 (0.84–1.05).242
Tinnitus1.18 (0.93–1.51).1811.01 (0.78–1.3).9330.95 (0.74–1.23).718
Obesity1.17 (1.1–1.25)<.00011.08 (1.01–1.15).02770.92 (0.86–0.99).0206
Pneumonia1.15 (1.04–1.28).0060.99 (0.89–1.11).9060.84 (0.75–0.95).0051
Unspecified anemia1.15 (1.06–1.25).00090.92 (0.85–1.0).05250.81 (0.74–0.89)<.0001
Peripheral neuropathy1.14 (1.0–1.31).04880.95 (0.83–1.09).4550.86 (0.75–0.99).038
Heart failure1.14 (1.01–1.29).03420.87 (0.77–1.0).04270.77 (0.67–0.88).0001
Cognitive impairment1.13 (1.03–1.24).01241.03 (0.93–1.14).5880.9 (0.81–1.0).0502
Joint pain1.13 (1.07–1.19)<.00011.08 (1.02–1.15).01030.96 (0.91–1.02).217
Hypertension1.1 (1.03–1.17).00571.07 (1.0–1.15).05530.97 (0.91–1.05).479
Chest pain1.09 (1.02–1.16).01421.1 (1.02–1.18).01131.02 (0.95–1.09).609
Alcohol use or abuse1.09 (0.91–1.3).3590.89 (0.73–1.08).2320.87 (0.72–1.05).15
Fatigue1.09 (1.02–1.17).01171.13 (1.05–1.22).00071.03 (0.95–1.11).473
Hyperlipidemia1.07 (1.0–1.14).03811.06 (0.99–1.13).08460.99 (0.92–1.06).726
General pain1.07 (0.99–1.15).09010.92 (0.85–1.0).03760.87 (0.81–0.94).0007
Asthma1.05 (0.96–1.15).2990.93 (0.85–1.03).1550.9 (0.81–0.98).0223
Atrial fibrillation1.04 (0.9–1.2).5870.9 (0.77–1.04).1580.84 (0.72–0.98).0264
CKD1.04 (0.92–1.17).560.86 (0.76–0.98).01910.82 (0.72–0.93).0018
Ischemic stroke1.02 (0.87–1.2).7640.9 (0.76–1.06).2130.87 (0.74–1.03).105
Acute myocardial infarction1.02 (0.87–1.2).7830.84 (0.71–0.99).03630.82 (0.69–0.97).0192
Intracerebral hemorrhage1.02 (0.54–1.93).9541.93 (0.86–4.35).1132.16 (1.0–4.63).0491
COPD1.01 (0.9–1.15).8160.71 (0.62–0.82)<.00010.7 (0.62–0.8)<.0001
Myalgia0.99 (0.88–1.12).910.95 (0.83–1.08).3970.98 (0.86–1.11).709
Anxiety/depression0.98 (0.93–1.04).5540.94 (0.89–1.0).05210.95 (0.89–1.01).0822
Septic shock0.98 (0.73–1.29).8610.94 (0.69–1.27).6780.87 (0.64–1.19).38
Headache0.97 (0.91–1.04).4080.98 (0.91–1.05).4951.02 (0.95–1.09).66
Insomnia0.97 (0.88–1.07).4981.0 (0.9–1.11).9861.0 (0.9–1.1).927
Diarrhea0.95 (0.87–1.04).2360.94 (0.85–1.03).1771.03 (0.94–1.13).545
Unstable angina0.89 (0.51–1.55).6760.67 (0.35–1.26).211.23 (0.7–2.15).47
Cough0.87 (0.82–0.93)<.00010.91 (0.85–0.97).00561.08 (1.01–1.16).0199
Subarachnoid hemorrhage0.87 (0.39–1.93).7311.32 (0.47–3.67).61.66 (0.62–4.43).311
Anosmia0.85 (0.58–1.24).4051.67 (1.05–2.64).02871.62 (1.03–2.55).0358
Lupus0.84 (0.54–1.29).4171.2 (0.75–1.91).4551.37 (0.86–2.18).186
Nicotine dependence/tobacco use0.83 (0.76–0.91).00010.77 (0.7–0.85)<.00010.93 (0.85–1.03).151
Fever0.8 (0.73–0.88)<.00010.93 (0.83–1.04).1881.25 (1.12–1.38)<.0001
COVID vs VRICOVID vs No InfectionVRI vs No Infection
OutcomeOdds Ratio (95% CI)POdds Ratio (95% CI)POdds Ratio (95% CI)P
Type 1 diabetes1.71 (1.2–2.44).00281.0 (0.69–1.46).9980.48 (0.32–0.73).0004
ARDS1.63 (0.45–5.84).4530.67 (0.09–4.7).6840.53 (0.07–3.96).538
Palpitations1.42 (1.27–1.6)<.00011.32 (1.17–1.49)<.00010.95 (0.84–1.08).467
Pulmonary embolism1.36 (1.07–1.74).01290.84 (0.66–1.08).1730.64 (0.49–0.83).0009
Hair loss1.35 (1.08–1.67).00711.32 (1.05–1.67).01971.03 (0.8–1.31).831
Hypoxemia1.3 (1.13–1.51).00030.97 (0.83–1.13).6980.72 (0.61–0.85).0001
Tachycardia1.28 (1.15–1.42)<.00011.03 (0.92–1.16).5610.81 (0.72–0.91).0003
Other respiratory failure1.27 (1.12–1.44).00020.81 (0.71–0.92).00160.61 (0.53–0.71)<.0001
Dependence on respirator or oxygen1.26 (1.05–1.51).0140.94 (0.77–1.15).5450.72 (0.59–0.89).0026
Rheumatoid arthritis1.2 (0.95–1.52).1291.01 (0.79–1.3).9150.82 (0.64–1.06).131
Dyspnea1.19 (1.11–1.27)<.00011.09 (1.01–1.16).02060.93 (0.86–1.0).0442
Weakness1.19 (1.09–1.31).00021.02 (0.93–1.13).6380.86 (0.78–0.96).0044
Type 2 diabetes1.19 (1.08–1.32).00051.09 (0.98–1.21).1070.94 (0.84–1.05).242
Tinnitus1.18 (0.93–1.51).1811.01 (0.78–1.3).9330.95 (0.74–1.23).718
Obesity1.17 (1.1–1.25)<.00011.08 (1.01–1.15).02770.92 (0.86–0.99).0206
Pneumonia1.15 (1.04–1.28).0060.99 (0.89–1.11).9060.84 (0.75–0.95).0051
Unspecified anemia1.15 (1.06–1.25).00090.92 (0.85–1.0).05250.81 (0.74–0.89)<.0001
Peripheral neuropathy1.14 (1.0–1.31).04880.95 (0.83–1.09).4550.86 (0.75–0.99).038
Heart failure1.14 (1.01–1.29).03420.87 (0.77–1.0).04270.77 (0.67–0.88).0001
Cognitive impairment1.13 (1.03–1.24).01241.03 (0.93–1.14).5880.9 (0.81–1.0).0502
Joint pain1.13 (1.07–1.19)<.00011.08 (1.02–1.15).01030.96 (0.91–1.02).217
Hypertension1.1 (1.03–1.17).00571.07 (1.0–1.15).05530.97 (0.91–1.05).479
Chest pain1.09 (1.02–1.16).01421.1 (1.02–1.18).01131.02 (0.95–1.09).609
Alcohol use or abuse1.09 (0.91–1.3).3590.89 (0.73–1.08).2320.87 (0.72–1.05).15
Fatigue1.09 (1.02–1.17).01171.13 (1.05–1.22).00071.03 (0.95–1.11).473
Hyperlipidemia1.07 (1.0–1.14).03811.06 (0.99–1.13).08460.99 (0.92–1.06).726
General pain1.07 (0.99–1.15).09010.92 (0.85–1.0).03760.87 (0.81–0.94).0007
Asthma1.05 (0.96–1.15).2990.93 (0.85–1.03).1550.9 (0.81–0.98).0223
Atrial fibrillation1.04 (0.9–1.2).5870.9 (0.77–1.04).1580.84 (0.72–0.98).0264
CKD1.04 (0.92–1.17).560.86 (0.76–0.98).01910.82 (0.72–0.93).0018
Ischemic stroke1.02 (0.87–1.2).7640.9 (0.76–1.06).2130.87 (0.74–1.03).105
Acute myocardial infarction1.02 (0.87–1.2).7830.84 (0.71–0.99).03630.82 (0.69–0.97).0192
Intracerebral hemorrhage1.02 (0.54–1.93).9541.93 (0.86–4.35).1132.16 (1.0–4.63).0491
COPD1.01 (0.9–1.15).8160.71 (0.62–0.82)<.00010.7 (0.62–0.8)<.0001
Myalgia0.99 (0.88–1.12).910.95 (0.83–1.08).3970.98 (0.86–1.11).709
Anxiety/depression0.98 (0.93–1.04).5540.94 (0.89–1.0).05210.95 (0.89–1.01).0822
Septic shock0.98 (0.73–1.29).8610.94 (0.69–1.27).6780.87 (0.64–1.19).38
Headache0.97 (0.91–1.04).4080.98 (0.91–1.05).4951.02 (0.95–1.09).66
Insomnia0.97 (0.88–1.07).4981.0 (0.9–1.11).9861.0 (0.9–1.1).927
Diarrhea0.95 (0.87–1.04).2360.94 (0.85–1.03).1771.03 (0.94–1.13).545
Unstable angina0.89 (0.51–1.55).6760.67 (0.35–1.26).211.23 (0.7–2.15).47
Cough0.87 (0.82–0.93)<.00010.91 (0.85–0.97).00561.08 (1.01–1.16).0199
Subarachnoid hemorrhage0.87 (0.39–1.93).7311.32 (0.47–3.67).61.66 (0.62–4.43).311
Anosmia0.85 (0.58–1.24).4051.67 (1.05–2.64).02871.62 (1.03–2.55).0358
Lupus0.84 (0.54–1.29).4171.2 (0.75–1.91).4551.37 (0.86–2.18).186
Nicotine dependence/tobacco use0.83 (0.76–0.91).00010.77 (0.7–0.85)<.00010.93 (0.85–1.03).151
Fever0.8 (0.73–0.88)<.00010.93 (0.83–1.04).1881.25 (1.12–1.38)<.0001

P values were calculated using a 2-tailed chi-square test.

Abbreviations: ARDS, acute respiratory distress syndrome; CKD, chronic kidney disease; COPD, chronic obstructive pulmonary disease; COVID, coronavirus disease; VRI, viral respiratory infection.

Table 3.

Effect of Infection on Probability of Receiving Each Diagnosis 30–365 Days Postinfection

COVID vs VRICOVID vs No InfectionVRI vs No Infection
OutcomeOdds Ratio (95% CI)POdds Ratio (95% CI)POdds Ratio (95% CI)P
Type 1 diabetes1.71 (1.2–2.44).00281.0 (0.69–1.46).9980.48 (0.32–0.73).0004
ARDS1.63 (0.45–5.84).4530.67 (0.09–4.7).6840.53 (0.07–3.96).538
Palpitations1.42 (1.27–1.6)<.00011.32 (1.17–1.49)<.00010.95 (0.84–1.08).467
Pulmonary embolism1.36 (1.07–1.74).01290.84 (0.66–1.08).1730.64 (0.49–0.83).0009
Hair loss1.35 (1.08–1.67).00711.32 (1.05–1.67).01971.03 (0.8–1.31).831
Hypoxemia1.3 (1.13–1.51).00030.97 (0.83–1.13).6980.72 (0.61–0.85).0001
Tachycardia1.28 (1.15–1.42)<.00011.03 (0.92–1.16).5610.81 (0.72–0.91).0003
Other respiratory failure1.27 (1.12–1.44).00020.81 (0.71–0.92).00160.61 (0.53–0.71)<.0001
Dependence on respirator or oxygen1.26 (1.05–1.51).0140.94 (0.77–1.15).5450.72 (0.59–0.89).0026
Rheumatoid arthritis1.2 (0.95–1.52).1291.01 (0.79–1.3).9150.82 (0.64–1.06).131
Dyspnea1.19 (1.11–1.27)<.00011.09 (1.01–1.16).02060.93 (0.86–1.0).0442
Weakness1.19 (1.09–1.31).00021.02 (0.93–1.13).6380.86 (0.78–0.96).0044
Type 2 diabetes1.19 (1.08–1.32).00051.09 (0.98–1.21).1070.94 (0.84–1.05).242
Tinnitus1.18 (0.93–1.51).1811.01 (0.78–1.3).9330.95 (0.74–1.23).718
Obesity1.17 (1.1–1.25)<.00011.08 (1.01–1.15).02770.92 (0.86–0.99).0206
Pneumonia1.15 (1.04–1.28).0060.99 (0.89–1.11).9060.84 (0.75–0.95).0051
Unspecified anemia1.15 (1.06–1.25).00090.92 (0.85–1.0).05250.81 (0.74–0.89)<.0001
Peripheral neuropathy1.14 (1.0–1.31).04880.95 (0.83–1.09).4550.86 (0.75–0.99).038
Heart failure1.14 (1.01–1.29).03420.87 (0.77–1.0).04270.77 (0.67–0.88).0001
Cognitive impairment1.13 (1.03–1.24).01241.03 (0.93–1.14).5880.9 (0.81–1.0).0502
Joint pain1.13 (1.07–1.19)<.00011.08 (1.02–1.15).01030.96 (0.91–1.02).217
Hypertension1.1 (1.03–1.17).00571.07 (1.0–1.15).05530.97 (0.91–1.05).479
Chest pain1.09 (1.02–1.16).01421.1 (1.02–1.18).01131.02 (0.95–1.09).609
Alcohol use or abuse1.09 (0.91–1.3).3590.89 (0.73–1.08).2320.87 (0.72–1.05).15
Fatigue1.09 (1.02–1.17).01171.13 (1.05–1.22).00071.03 (0.95–1.11).473
Hyperlipidemia1.07 (1.0–1.14).03811.06 (0.99–1.13).08460.99 (0.92–1.06).726
General pain1.07 (0.99–1.15).09010.92 (0.85–1.0).03760.87 (0.81–0.94).0007
Asthma1.05 (0.96–1.15).2990.93 (0.85–1.03).1550.9 (0.81–0.98).0223
Atrial fibrillation1.04 (0.9–1.2).5870.9 (0.77–1.04).1580.84 (0.72–0.98).0264
CKD1.04 (0.92–1.17).560.86 (0.76–0.98).01910.82 (0.72–0.93).0018
Ischemic stroke1.02 (0.87–1.2).7640.9 (0.76–1.06).2130.87 (0.74–1.03).105
Acute myocardial infarction1.02 (0.87–1.2).7830.84 (0.71–0.99).03630.82 (0.69–0.97).0192
Intracerebral hemorrhage1.02 (0.54–1.93).9541.93 (0.86–4.35).1132.16 (1.0–4.63).0491
COPD1.01 (0.9–1.15).8160.71 (0.62–0.82)<.00010.7 (0.62–0.8)<.0001
Myalgia0.99 (0.88–1.12).910.95 (0.83–1.08).3970.98 (0.86–1.11).709
Anxiety/depression0.98 (0.93–1.04).5540.94 (0.89–1.0).05210.95 (0.89–1.01).0822
Septic shock0.98 (0.73–1.29).8610.94 (0.69–1.27).6780.87 (0.64–1.19).38
Headache0.97 (0.91–1.04).4080.98 (0.91–1.05).4951.02 (0.95–1.09).66
Insomnia0.97 (0.88–1.07).4981.0 (0.9–1.11).9861.0 (0.9–1.1).927
Diarrhea0.95 (0.87–1.04).2360.94 (0.85–1.03).1771.03 (0.94–1.13).545
Unstable angina0.89 (0.51–1.55).6760.67 (0.35–1.26).211.23 (0.7–2.15).47
Cough0.87 (0.82–0.93)<.00010.91 (0.85–0.97).00561.08 (1.01–1.16).0199
Subarachnoid hemorrhage0.87 (0.39–1.93).7311.32 (0.47–3.67).61.66 (0.62–4.43).311
Anosmia0.85 (0.58–1.24).4051.67 (1.05–2.64).02871.62 (1.03–2.55).0358
Lupus0.84 (0.54–1.29).4171.2 (0.75–1.91).4551.37 (0.86–2.18).186
Nicotine dependence/tobacco use0.83 (0.76–0.91).00010.77 (0.7–0.85)<.00010.93 (0.85–1.03).151
Fever0.8 (0.73–0.88)<.00010.93 (0.83–1.04).1881.25 (1.12–1.38)<.0001
COVID vs VRICOVID vs No InfectionVRI vs No Infection
OutcomeOdds Ratio (95% CI)POdds Ratio (95% CI)POdds Ratio (95% CI)P
Type 1 diabetes1.71 (1.2–2.44).00281.0 (0.69–1.46).9980.48 (0.32–0.73).0004
ARDS1.63 (0.45–5.84).4530.67 (0.09–4.7).6840.53 (0.07–3.96).538
Palpitations1.42 (1.27–1.6)<.00011.32 (1.17–1.49)<.00010.95 (0.84–1.08).467
Pulmonary embolism1.36 (1.07–1.74).01290.84 (0.66–1.08).1730.64 (0.49–0.83).0009
Hair loss1.35 (1.08–1.67).00711.32 (1.05–1.67).01971.03 (0.8–1.31).831
Hypoxemia1.3 (1.13–1.51).00030.97 (0.83–1.13).6980.72 (0.61–0.85).0001
Tachycardia1.28 (1.15–1.42)<.00011.03 (0.92–1.16).5610.81 (0.72–0.91).0003
Other respiratory failure1.27 (1.12–1.44).00020.81 (0.71–0.92).00160.61 (0.53–0.71)<.0001
Dependence on respirator or oxygen1.26 (1.05–1.51).0140.94 (0.77–1.15).5450.72 (0.59–0.89).0026
Rheumatoid arthritis1.2 (0.95–1.52).1291.01 (0.79–1.3).9150.82 (0.64–1.06).131
Dyspnea1.19 (1.11–1.27)<.00011.09 (1.01–1.16).02060.93 (0.86–1.0).0442
Weakness1.19 (1.09–1.31).00021.02 (0.93–1.13).6380.86 (0.78–0.96).0044
Type 2 diabetes1.19 (1.08–1.32).00051.09 (0.98–1.21).1070.94 (0.84–1.05).242
Tinnitus1.18 (0.93–1.51).1811.01 (0.78–1.3).9330.95 (0.74–1.23).718
Obesity1.17 (1.1–1.25)<.00011.08 (1.01–1.15).02770.92 (0.86–0.99).0206
Pneumonia1.15 (1.04–1.28).0060.99 (0.89–1.11).9060.84 (0.75–0.95).0051
Unspecified anemia1.15 (1.06–1.25).00090.92 (0.85–1.0).05250.81 (0.74–0.89)<.0001
Peripheral neuropathy1.14 (1.0–1.31).04880.95 (0.83–1.09).4550.86 (0.75–0.99).038
Heart failure1.14 (1.01–1.29).03420.87 (0.77–1.0).04270.77 (0.67–0.88).0001
Cognitive impairment1.13 (1.03–1.24).01241.03 (0.93–1.14).5880.9 (0.81–1.0).0502
Joint pain1.13 (1.07–1.19)<.00011.08 (1.02–1.15).01030.96 (0.91–1.02).217
Hypertension1.1 (1.03–1.17).00571.07 (1.0–1.15).05530.97 (0.91–1.05).479
Chest pain1.09 (1.02–1.16).01421.1 (1.02–1.18).01131.02 (0.95–1.09).609
Alcohol use or abuse1.09 (0.91–1.3).3590.89 (0.73–1.08).2320.87 (0.72–1.05).15
Fatigue1.09 (1.02–1.17).01171.13 (1.05–1.22).00071.03 (0.95–1.11).473
Hyperlipidemia1.07 (1.0–1.14).03811.06 (0.99–1.13).08460.99 (0.92–1.06).726
General pain1.07 (0.99–1.15).09010.92 (0.85–1.0).03760.87 (0.81–0.94).0007
Asthma1.05 (0.96–1.15).2990.93 (0.85–1.03).1550.9 (0.81–0.98).0223
Atrial fibrillation1.04 (0.9–1.2).5870.9 (0.77–1.04).1580.84 (0.72–0.98).0264
CKD1.04 (0.92–1.17).560.86 (0.76–0.98).01910.82 (0.72–0.93).0018
Ischemic stroke1.02 (0.87–1.2).7640.9 (0.76–1.06).2130.87 (0.74–1.03).105
Acute myocardial infarction1.02 (0.87–1.2).7830.84 (0.71–0.99).03630.82 (0.69–0.97).0192
Intracerebral hemorrhage1.02 (0.54–1.93).9541.93 (0.86–4.35).1132.16 (1.0–4.63).0491
COPD1.01 (0.9–1.15).8160.71 (0.62–0.82)<.00010.7 (0.62–0.8)<.0001
Myalgia0.99 (0.88–1.12).910.95 (0.83–1.08).3970.98 (0.86–1.11).709
Anxiety/depression0.98 (0.93–1.04).5540.94 (0.89–1.0).05210.95 (0.89–1.01).0822
Septic shock0.98 (0.73–1.29).8610.94 (0.69–1.27).6780.87 (0.64–1.19).38
Headache0.97 (0.91–1.04).4080.98 (0.91–1.05).4951.02 (0.95–1.09).66
Insomnia0.97 (0.88–1.07).4981.0 (0.9–1.11).9861.0 (0.9–1.1).927
Diarrhea0.95 (0.87–1.04).2360.94 (0.85–1.03).1771.03 (0.94–1.13).545
Unstable angina0.89 (0.51–1.55).6760.67 (0.35–1.26).211.23 (0.7–2.15).47
Cough0.87 (0.82–0.93)<.00010.91 (0.85–0.97).00561.08 (1.01–1.16).0199
Subarachnoid hemorrhage0.87 (0.39–1.93).7311.32 (0.47–3.67).61.66 (0.62–4.43).311
Anosmia0.85 (0.58–1.24).4051.67 (1.05–2.64).02871.62 (1.03–2.55).0358
Lupus0.84 (0.54–1.29).4171.2 (0.75–1.91).4551.37 (0.86–2.18).186
Nicotine dependence/tobacco use0.83 (0.76–0.91).00010.77 (0.7–0.85)<.00010.93 (0.85–1.03).151
Fever0.8 (0.73–0.88)<.00010.93 (0.83–1.04).1881.25 (1.12–1.38)<.0001

P values were calculated using a 2-tailed chi-square test.

Abbreviations: ARDS, acute respiratory distress syndrome; CKD, chronic kidney disease; COPD, chronic obstructive pulmonary disease; COVID, coronavirus disease; VRI, viral respiratory infection.

Pulmonary Effects

Dyspnea and chest pain were the only pulmonary diagnosis found to be significantly elevated in both comparisons between COVID-19 and VRI patients and COVID-19 and control patients. Pulmonary embolism, hypoxemia, other respiratory failure, dependence on oxygen, and pneumonia were significantly more frequent in COVID-19 patients compared with VRI patients but were not significantly more frequent in COVID-19 patients compared with control patients.

Neurological Effects

SARS-CoV-2 infection was not uniquely associated with any long-term neurological symptoms in this analysis. Anosmia appeared significantly elevated in both COVID-19 and generic VRI patients, but the difference between the groups was not found to be significant. This lack of significant difference in rates of persistent anosmia is precedented, as previous work has linked influenza viral infections to damaged olfactory nerves in a subset of cases [28]. Although previous studies [29, 30] have suggested that symptoms such as peripheral neuropathy and tinnitus may be long COVID symptoms, we did not observe a significant relationship in this study in either comparison. Long-term negative impacts of COVID-19 infection on mental health through anxiety and mood disorders have also been reported [13], but we found no significant relationship between infection and anxiety/depression in either comparison. Rates of cognitive impairment were also observed to be elevated in COVID-19 patients relative to VRI patients, but this relationship was not observed when compared with the control group.

Cardiovascular Effects

SARS-CoV-2 infection was uniquely associated with an increased risk of receiving a diagnosis for heart palpitations. Tachycardia, unspecified anemia, heart failure, hypertension, and hyperlipidemia were more frequent in COVID-19 patients relative to generic VRI patients but were not significantly elevated in COVID-19 patients compared with the control groups. Lasting thrombotic effects of SARS-CoV-2 infection have previously been suggested [31] to be risk factors that could increase the probability of stroke or intracerebral hemorrhage post-COVID-19, but no significant relationship between index SARS-CoV-2 infection and an increased risk of stroke or cerebral hemorrhage post-COVID-19 was observed. Relationships between index SARS-CoV-2 infection and heart failure and atrial fibrillation were not significant in our analysis.

Musculoskeletal Effects

Fatigue and joint pain were specifically associated with an index encounter SARS-CoV-2 infection. Muscle weakness was significantly more frequent in COVID-19 patients compared with VRI patients but was not significantly elevated when COVID-19 patients were compared with controls.

Immune Effects

Increased risk of immune-mediated conditions as a result of SARS-CoV-2 infection has also previously been suggested in relation to lupus, rheumatoid arthritis [32, 33], and type 1 diabetes [21]. Our analysis observed no significant relationships between COVID-19 infection and these diagnoses. Diagnoses of type 1 diabetes were significantly more frequent in COVID-19 patients compared with VRI patients, but no significant relationship was observed when comparing COVID-19 and control patients.

Duration of Symptoms

Figure 2 shows the approximate duration of symptoms for selected diagnoses where COVID-19 infection had a large predicted effect size. The frequencies of some symptoms converge to baseline rates over time, while others show persistent over-representation in the COVID-19 population. The distribution of final hair loss diagnoses shows that COVID-19-associated hair loss peaks roughly 100 days after the initial infection, before declining roughly to baseline levels after 250 days. Supplementary Table 2 shows the average number of days between the index encounter and the date when the symptom was last recorded for each comparison group. Compared with VRI patients, the average dates of the last recorded fatigue (P = .0001) and joint pain (P = .0359) diagnoses were significantly earlier in COVID-19 patients, suggesting recovery to baseline levels may occur during the study period of 1 year postinfection.

Overlayed histograms of number of days between index encounter and last recorded diagnosis for long COVID symptom for COVID vs non-COVID VRI patients for selected symptoms. Abbreviations: COVID-19, coronavirus 2019; VRI, viral respiratory infection.
Figure 2.

Overlayed histograms of number of days between index encounter and last recorded diagnosis for long COVID symptom for COVID vs non-COVID VRI patients for selected symptoms. Abbreviations: COVID-19, coronavirus 2019; VRI, viral respiratory infection.

DISCUSSION

Our analysis attempts to provide additional information regarding how unique long COVID symptoms are to COVID-19 infections. We make use of a large de-identified EHR data set with the goal of capturing a large and diverse cohort of patients. Our patient cohort was limited primarily by the number of adult patients diagnosed with generic VRIs during the pandemic period. Females were over-represented in this population, making up roughly 66% of eligible adult patients with generic VRIs. Using this study population, we were able to identify 7 diagnoses for which SARS-CoV-2 infection during the index encounter acted as a significant positive predictor for diagnosis 30–365 days after the index encounter when compared with both index encounters with a generic respiratory viral infection and to control patients. Our analysis also identified that differences in symptom duration exist between common VRIs and COVID-19. However, the granularity of these temporal data is limited, as information was only recorded when patients were seen by clinicians during medical encounters. Studying how the long-term implications of each infection type vary over time presents an opportunity for future research.

The persistent pulmonary, cardiovascular, and musculoskeletal symptoms observed to be specifically associated with COVID-19 have the potential to seriously impact quality of life for affected patients. It is possible that the COVID-19-associated increase in obesity diagnoses observed in these data may be a result of reduced physical activity due to lingering effects of COVID-19 infection. However, a definitive relationship cannot be established from the available data, and additional research is needed.

The core symptoms we report as being COVID-specific have been repeatedly found to be associated with earlier COVID-19 in large-scale studies of EHR data [34]. Diagnoses indicating fatigue, body pain, and continuing respiratory problems most commonly characterize this condition. These core symptoms are also prevalent in studies that apply different methodologies to identify and study patient cohorts. For example, large-scale studies of long COVID symptoms through surveys targeted toward users of online long COVID support groups have been conducted as an alternative to EHR studies [35]. These studies have the benefit of allowing for the collection of much more detailed information than is commonly available through EHR data while retaining large sample sizes. However, patients participating in such communities consist of individuals who seek out and continuously participate in discussions about the health implications of COVID-19. These individuals represent a highly self-selecting subset of the general population, and findings may not generalize to more typical patients. Self-selection in testing, treatment, and reporting of symptoms remains a major confounder when attempting to study the long-term implications of COVID-19 in large-scale studies. Additional scrutiny is necessary when attempting to determine which long-term symptoms are truly distinct to SARS-CoV-2 infection.

Clinical Implications

June 2022 data from the Census Bureau and the Center for Disease Control and Prevention's National Center for Health Statistics reveal that >40% of adults in the United States report having been infected with COVID-19 in the past, and nearly one-fifth of those adults who have had COVID-19 report that they are currently still experiencing symptoms of “long COVID.” Overall, this means that up to 7.5% of adult Americans may have long COVID-19 symptoms, defined as symptoms not experienced before the COVID-19 infection and lasting for ≥3 months after first being infected. Interestingly, certain subgroups (eg, by geography [KY, AL, TN, SD], age [middle > elderly], ethnicity (Hispanic, gender [women], gender identity [transgender], and sexual orientation [bisexual]) tend to report higher percentages of long COVID-19 symptoms. Understanding the population and subgroup risks for long COVID associated with outcomes, including lingering and chronic never-before-experienced symptoms and new medical diagnoses such as those reported here, is important for clinicians and researchers, so that clinical guidelines for treatments and symptom management can be more appropriately developed for the growing number of adults affected by COVID-19. The long-term clinical implications of SARS-CoV-2 infection are complex and will have ongoing significant impacts on quality of life and patient care. A better understanding of these implications will be important for patient care in the coming period due to the widespread and persistent nature of COVID-19 infection and the growing number of persons who have been infected.

Limitations

This study does not cover the post-Omicron period of the pandemic as a full year of post-Omicron data were not present in the available data due to the recency of the Omicron wave. As additional post-Omicron data become available, it may become possible to study the long-term effects of the Omicron variant. However, any future studies will be complicated by the extremely widespread nature of Omicron infections, which may not be documented.

Our data are limited to diagnoses documented in EHR systems through billing codes at medical institutions that are part of the Cerner Learning Health Network. It is not possible to exclude all patients who have COVID-19 or generic VRIs from the study populations if there are no records of the infection. Furthermore, it is not possible to conclusively verify that patients were never infected with SARS-CoV-2 during the year after their index encounter using these data. Confirming a persistent lack of infection would require rigorous patient surveillance, which is not available in a data set consisting of medical records derived from routine medical care. COVID-19 testing procedures may also vary by institution and by time period. Underdiagnosis of COVID-19 would be expected to reduce the significance of differences observed when comparing COVID-19 and non-COVID-19 groups. COVID-19 vaccination status was not reliably available in these data as they consist of medical records, not insurance records, and presumably a large proportion of individuals may have received their COVID-19 vaccines outside of medical institutions.

The consistency of available records did not allow for in-depth studies regarding the effects of medications potentially being used to treat COVID-19. Heterogeneity between institutions regarding what prescriptions were documented and how they were documented reduced the quality of medication-related data. Due to this data limitation and lack of perfectly comparable medications also being used to treat generic VRIs, we chose not to include potential COVID-related medications in this study.

Variations in when patients were infected and in the geographic location of those patients are also a source of potential bias in results, as these are not necessarily uniform between groups. Differences in geographic location and phase of the pandemic could affect health care procedures, which has the potential to impact long-term care and outcomes. It was not possible to adjust for these factors due to the lack of location information as a result of data anonymization.

This analysis examined only patients with ≥2 medical encounters in the year before their index encounter and ≥2 medical encounters in the following year. This was necessary to ensure adequate screening for ascertainment of comorbidities and events but did introduce a degree of bias into the patient selection criteria, as patients with a higher number of encounters were over-represented. However, as outpatient encounters were included in our criteria, we do not think that having 2 outpatient encounters per year necessarily represents poor health in the study sample disproportionate to the health status of general public.

Propensity score matching and regression using linear models are not capable of adjusting for nonlinear relationships between variables. Though these methods are effective in adjusting for most confounding factors, some differences in the underlying relationships between covariates may continue to persist.

An inherent limitation of EHR data is that they consist of a nonrandom self-selecting population. Patients who are less likely or less able to seek care are inherently underrepresented. This may affect the generalizability of results attained from EHR data. The diagnostic process is not necessarily clear, and thus it is necessary to rely on diagnoses assigned by clinicians. Depending on the condition and the medical scrutiny a patient receives, chronic conditions can go undiagnosed for significant periods of time. Incomplete or inaccurate diagnoses have the potential to reduce the accuracy of results attained.

Due to heterogeneity in data recording between institutions, it is not possible to unambiguously confirm the presence or nonpresence of SARS-CoV-2 infection in patients with respiratory infections beyond the diagnosis assigned by clinicians. Misclassification of patients would be expected to reduce the statistical power of any differences observed when comparing COVID-19 patients with generic VRI patients. We expect a high level of accuracy due to rigorous criteria for screening established at each medical facility during the COVID-19 pandemic.

EHR data obtained from many different institutions contain significant heterogeneity regarding what was recorded and how it was recorded. The nature of the data also makes it challenging to determine with certainty when patients stopped experiencing certain symptoms. Patients may not receive billing codes for all symptoms or conditions at every medical encounter and may go significant periods between medical encounters. Providers may prioritize and code the more urgent, acute, or new medical diagnoses at a given encounter. This limits our findings regarding the duration of long COVID symptoms, as we are largely relying on the presence of diagnoses, rather than exactly when they occurred.

COVID-19, VRI, and noninfected populations within EHR data sets consistently represent noticeably different distributions of patients. Attempts to select similar patient populations through propensity score matching and to control for confounders using regression analyses are useful, but it is challenging to fully adjust for every possible confounder because many important factors are not recorded in the medical data. Furthermore, influenza and other VRIs had a significantly decreased incidence early in the pandemic during quarantine and other COVID-19 control measures [36], which may have skewed the data set toward long COVID symptoms. In addition, the postviral symptoms studied here were not widely known before the COVID-19 pandemic, limiting the time period for patient selection.

Supplementary Data

Supplementary materials are available at Open Forum Infectious Diseases online. Consisting of data provided by the authors to benefit the reader, the posted materials are not copyedited and are the sole responsibility of the authors, so questions or comments should be addressed to the corresponding author.

Acknowledgments

Financial support. This work was supported by the National Institutes of Health (grant number: 5T32LM012410) to William Baskett and by the Shumaker Endowment to Chi-Ren Shyu.

Disclaimer. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Patient consent. Patient consent and institutional review board approval were not required for this study due to the deidentified nature of the medical records.

References

1

Raveendran
A
,
Jayadevan
R
,
Sashidharan
S
.
Long COVID: an overview
.
Diabetes Metab Syndr
2021
;
15
:
869
75
.

2

Lancet
T
.
Facing up to long COVID
.
Lancet
2020
;
396
:
1861
.

3

Sudre
CH
,
Murray
B
,
Varsavsky
T
, et al.
Attributes and predictors of long COVID
.
Nat Med
2021
;
27
:
626
31
.

4

Ceban
F
,
Ling
S
,
Lui
LM
, et al.
Fatigue and cognitive impairment in post-COVID-19 syndrome: a systematic review and meta-analysis
.
Brain Behav Immun
2022
;
101
:
93
135
.

5

Raman
B
,
Bluemke
DA
,
Lüscher
TF
,
Neubauer
S
.
Long COVID: post-acute sequelae of COVID-19 with a cardiovascular focus
.
Eur Heart J
2022
;
43
:
1157
72
.

6

Margalit
I
,
Yelin
D
,
Sagi
M
, et al.
Risk factors and multidimensional assessment of long COVID fatigue: a nested case-control study
.
Clin Infect Dis
2022
;
75
:
1688
97
.

7

Jacobson
KB
,
Rao
M
,
Bonilla
H
, et al.
Patients with uncomplicated coronavirus disease 2019 (COVID-19) have long-term persistent symptoms and functional impairment similar to patients with severe COVID-19: a cautionary tale during a global pandemic
.
Clin Infect Dis
2021
;
73
:
e826
9
.

8

Theoharides
TC
,
Cholevas
C
,
Polyzoidis
K
,
Politis
A
.
Long-COVID syndrome-associated brain fog and chemofog: luteolin to the rescue
.
Biofactors
2021
;
47
:
232
41
.

9

Hugon
J
,
Msika
E-F
,
Queneau
M
,
Farid
K
,
Paquet
C
.
Long COVID: cognitive complaints (brain fog) and dysfunction of the cingulate cortex
.
J Neurol
2022
;
269
:
44
6
.

10

Han
Q
,
Zheng
B
,
Daines
L
,
Sheikh
A
.
Long-term sequelae of COVID-19: a systematic review and meta-analysis of one-year follow-up studies on post-COVID symptoms
.
Pathogens
2022
;
11
:
269
.

11

Yelin
D
,
Margalit
I
,
Yahav
D
,
Runold
M
,
Bruchfeld
J
.
Long COVID-19—it's not over until?
Clin Microbiol Infect
2021
;
27
:
506
8
.

12

Callard
F
,
Perego
E
.
How and why patients made long COVID
.
Soc Sci Med
2021
;
268
:
113426
.

13

Fernández-de-Las-Peñas
C
,
Gómez-Mayordomo
V
,
de-la-Llave-Rincón
AI
, et al.
Anxiety, depression and poor sleep quality as long-term post-COVID sequelae in previously hospitalized patients: a multicenter study
.
J Infect
2021
;
83
:
496
522
.

14

Dani
M
,
Dirksen
A
,
Taraborrelli
P
, et al.
Autonomic dysfunction in ‘long COVID’: rationale, physiology and management strategies
.
Clin Med
2021
;
21
:
e63
7
.

15

Xie
Y
,
Xu
E
,
Bowe
B
,
Al-Aly
Z
.
Long-term cardiovascular outcomes of COVID-19
.
Nat Med
2022;
28
:
583–90
.

16

Kaggwa
MM
,
Favina
A
,
Najjuka
SM
,
Zeba
Z
,
Mamun
MA
,
Bongomin
F
.
Excessive eating and weight gain: a rare post-acute COVID-19 syndrome
.
Diabetes Metab Syndr
2021
;
15
:
102252
.

17

Mieczkowska
K
,
Deutsch
A
,
Borok
J
, et al.
Telogen effluvium: a sequela of COVID-19
.
Int J Dermatol
2021
;
60
:
122
4
.

18

Petersen
MS
,
Kristiansen
MF
,
Hanusson
KD
, et al.
Long COVID in the Faroe Islands: a longitudinal study among nonhospitalized patients
.
Clin Infect Dise
2021
;
73
:
e4058
63
.

19

Hirschtick
JL
,
Titus
AR
,
Slocum
E
, et al.
Population-based estimates of post-acute sequelae of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection (PASC) prevalence and characteristics
.
Clin Infect Dis
2021
;
73
:
2055
64
.

20

Seeßle
J
,
Waterboer
T
,
Hippchen
T
, et al.
Persistent symptoms in adult patients 1 year after coronavirus disease 2019 (COVID-19): a prospective cohort study
.
Clin Infect Dis
2022
;
74
:
1191
8
.

21

Bull-Otterson
L
,
Baca
S
,
Saydah
S
, et al.
Post-COVID conditions among adult COVID-19 survivors aged 18–64 and ≥ 65 years—United States, March 2020–November 2021
.
Morb Mortal Wkly Rep
2022
;
71
:
713–7
.

22

Al-Aly
Z
,
Xie
Y
,
Bowe
B
.
High-dimensional characterization of post-acute sequelae of COVID-19
.
Nature
2021
;
594
:
259
64
.

23

Byrne
AW
,
McEvoy
D
,
Collins
AB
, et al.
Inferred duration of infectious period of SARS-CoV-2: rapid scoping review and analysis of available evidence for asymptomatic and symptomatic COVID-19 cases
.
BMJ Open
2020
;
10
:
e039856
.

24

Ehwerhemuepha
L
,
Carlson
K
,
Moog
R
, et al.
Cerner Real-World Data (CRWD)—a de-identified multicenter electronic health records database
.
Data Brief
2022
;
42
:
108120
.

25

Qureshi
AI
,
Baskett
WI
,
Huang
W
, et al.
Facilitating the study of relationships between COVID-19 and cardiovascular health outcomes using Cerner real-world COVID-19 deidentified dataset
.
HealthCare Res J
2020
;
1
:
17
28
.

26

Qureshi
AI
,
Baskett
WI
,
Huang
W
, et al.
Acute ischemic stroke and COVID-19: an analysis of 27 676 patients
.
Stroke
2021;
52
:
905
12.

27

Benjamini
Y
,
Hochberg
Y
.
Controlling the false discovery rate: a practical and powerful approach to multiple testing
.
J R Stat Soc Ser B (Methodol
)
1995
;
57
:
289
300
.

28

Van Riel
D
,
Verdijk
R
,
Kuiken
T
.
The olfactory nerve: a shortcut for influenza and other viral diseases into the central nervous system
.
J Pathol
2015
;
235
:
277
87
.

29

Oaklander
AL
,
Mills
AJ
,
Kelley
M
, et al.
Peripheral neuropathy evaluations of patients with prolonged long COVID
.
Neurol Neuroimmunol Neuroinflamm
2022
;
9
:
e1146
.

30

McFarland
AJ
,
Yousuf
MS
,
Shiers
S
,
Price
TJ
.
Neurobiology of SARS-CoV-2 interactions with the peripheral nervous system: implications for COVID-19 and pain
.
Pain Rep
2021
;
6
:
e885
.

31

Xie
Y
,
Xu
E
,
Bowe
B
,
Al-Aly
Z
.
Long-term cardiovascular outcomes of COVID-19
.
Nat Med
2022
;
28
:
583
90
.

32

Andrade B
Silva
,
Siqueira
S
,
de Assis Soares
WR
, et al.
Long-COVID and post-COVID health complications: an up-to-date review on clinical conditions and their possible molecular mechanisms
.
Viruses
2021
;
13
:
700
.

33

Amiral
J
.
Can COVID-19 induce an autoimmune disease associated with long-lasting symptoms and delayed complications
.
Ann Clin Immunol Microbiol
2020
;
2
:
1014
.

34

Hanson
SW
,
Abbafati
C
,
Aerts
JG
, et al.
Estimated global proportions of individuals with persistent fatigue, cognitive, and respiratory symptom clusters following symptomatic COVID-19 in 2020 and 2021
.
JAMA
2022
;
328
:
1604
15
.

35

Davis
HE
,
Assaf
GS
,
McCorkell
L
, et al.
Characterizing long COVID in an international cohort: 7 months of symptoms and their impact
.
EClinicalMedicine
2021
;
38
:
101019
.

36

Soo
RJJ
,
Chiew
CJ
,
Ma
S
,
Pung
R
,
Lee
V
.
Decreased influenza incidence under COVID-19 control measures, Singapore
.
Emerg infect Dis
2020
;
26
:
1933
5
.

Author notes

Potential conflicts of interest. All authors: no reported conflicts of interest. All authors have submitted the ICMJE Form for Disclosure of Potential Conflicts of Interest. Conflicts that the editors consider relevant to the content of the manuscript have been disclosed.

This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivs licence (https://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial reproduction and distribution of the work, in any medium, provided the original work is not altered or transformed in any way, and that the work is properly cited. For commercial re-use, please contact [email protected]

Supplementary data

Comments

1 Comment
Obesity: long-Covid or coincidence?
1 February 2023
Angela Rose
None
The inclusion of obesity as a statistically significant symptom of long-Covid appears to weaken the usefulness of this analysis. Your discussion of the results does not appear to address obesity.
Unlike other symptoms supported in your analysis, obesity does not appear to be a frequently reported symptom of long-Covid.
The statistically significant results in favour of obesity could be explained by other factors (e.g. the effect of lockdowns on diet) without any connection with long-Covid.
There appear to be multiple long-Covid associated symptoms which were not supported, where statistically significant differences were observed in the Covid vs VRIs set, but not in the Covid vs control set.
The mismatch between long-Covid associated symptoms and lack of statistically significant results could be explained by a non-representative or biased control group.
It is not easy to obtain a non-biased control group for this type of analysis and I appreciated your acknowledgement of bias in the dataset and the record selection methodology used.
For future similar analyses it may prove useful to include more than one control group, employing different selection methodologies for each control group. Significant differences in results compared with each control group could highlight instances where control selection bias has a stronger influence on the result than the target variable(s).
Submitted on 01/02/2023 7:37 AM GMT
Submit a comment
You have entered an invalid code
Thank you for submitting a comment on this article. Your comment will be reviewed and published at the journal's discretion. Please check for further notifications by email.