Abstract

Background

Most studies on the psychosocial working environment have focused on evaluating the isolated effect of individual psychosocial work factors or looked at effects through a lens of theories such as job strain or effort–reward imbalance. However, to fathom the intricate nature of workers’ experience of occupational strain, there is a need to investigate the combined and cumulative effects of multiple exposures to psychosocial work factors on workers’ health.

Methods

In this prospective cohort study, we created an additive index (range 0–4) on number of baseline exposures to quantitative demands, emotional demands, role conflicts, and workplace bullying. Via logistic regression and Cox regression, we estimated the association between the additive index of psychosocial work factors and depressive disorder and long-term sickness absence (LTSA). We assessed the onset of depressive disorder using the Major Depression Inventory at 6-month follow-up and the onset of LTSA using a national register during 12-month follow-up.

Results

For onset of depressive disorder, high exposure to any one [odds ratio (OR) 2.98], two (OR 3.14), three (OR 6.44) and all four (OR 9.62) adverse psychosocial work factors predicted a statistically significant increased risk. For onset of LTSA, high exposure to any one [hazard ratio (HR) 1.13], two (HR 1.67), three (HR 2.31) and all four (HR 4.04) psychosocial work factors predicted an increased risk. The two latter associations were statistically significant. Trend tests indicated an exposure–response relationship for both outcomes.

Conclusions

Workers reporting exposure to multiple adverse psychosocial work factors had a higher risk of developing depressive disorder and LTSA.

Additional content

Additional content An author video to accompany this article is available at: https://oup.cloud.panopto.eu/Panopto/Pages/Viewer.aspx?id=b384a9ae-cf88-47d5-a3b7-b04300920ea7.

Introduction

Many studies have investigated associations between psychosocial working conditions and health-related outcomes.1 Findings show that exposure to various adverse psychosocial work factors is associated with an increased risk of stress-related disorders,2 coronary heart disease,3 long-term sickness absence (LTSA)4,5 and depression or symptoms of depression.6,7

Contemporary theoretical models within the field of psychosocial work environment research8–10 describe how co-existing psychosocial factors intertwine to create the work environment experienced by the worker. These models suggest a complex balance between job demands and job resources, in particular job control, and between efforts and rewards—and these models posit that certain types of imbalances increase the risk of the onset of diseases and disorders. In addition, Hobfoll’s conservation of resources (COR) theory11,12 suggests that a worker has a finite amount of resources to deal with exigent work stressors. Thus, when exposed to several demands at the same time the worker’s ability to cope may decrease accordingly, depleting the worker of resources and energy.11

In clinical occupational medicine, practitioners are tasked with assessing patients’ exposure to various psychosocial work factors and symptoms related to occupational stress-related disorders. The process of documenting these exposures and symptoms in a medical anamnesis is highly complex, requiring a systematic and structured approach to understand the multiple factors that often occur simultaneously in the work environment. This complexity presents a significant challenge for occupational health specialists, as they must navigate the intricate nature of the psychosocial work environment experienced by workers in contemporary workplaces. To ensure a comprehensive understanding of the impact of joint exposures in the psychosocial work environment, it is essential to consider as many factors as possible in the assessment and evaluation process.

Although an extensive literature has analyzed the health-related consequences of imbalances between job demands and job resources (e.g. job control), and between efforts and rewards in the work place,1,3,6,13–16 only a few studies have investigated the consequences of simultaneous exposure to multiple job demands and/or negative acts.17–20 Consequently, evidence about the consequences of workers being exposed to multiple job demands and/or negative acts at the same time is limited.

In this study, we contribute to this literature by exploring the consequences of exposure to combinations of two job demands (quantitative demands and emotional demands), one indicator of a hindrance stressor21 (role conflicts), and one indicator of negative acts (workplace bullying). The aim of the present study is to explore the prospective associations between combinations of these four well-established and clinically relevant factors in the psychosocial work environment and the onset of two health-related outcomes: a self-reported measure of depressive disorder and a register-based measure of LTSA.

We decided to focus on these four psychosocial work factors as they are considered relevant in medical occupational clinical practice in Denmark, as well as in Danish work authority legislation. The four psychosocial work factors investigated are in line with The Danish Society of Occupational and Environmental Medicine’s national short clinical guideline to follow when evaluating a patient’s psychosocial work environment.22 The four psychosocial work factors are also in line with the ‘Executive order on psychosocial work environment’, published in 2020, by the Danish Working Environment Authority,23 which is a government agency purposed to safeguard healthy and safe working conditions in Danish work places. The only work environment factor from the executive order that we did not address with our analyses was ‘work-related violence’ because it had a low prevalence in the study raising concerns about statistical power.

By choosing to investigate these four psychosocial work factors, we aim to grasp the complexity missed when evaluating the consequences of exposure to psychosocial work factors in an isolated form. The present article aims to achieve relevance for both the practice of clinical occupational medicine as well as prophylactically oriented workplace authorities.

Methods

This study is based on data from a prospective cohort study on employed individuals in Denmark.24 In 2015, a questionnaire was distributed to 8958 employed individuals of which 4340 responded (response rate: 48.4%). All respondents received a questionnaire after 6 months of follow-up and 2540 responded (response rate 58.5%). The procedures for population sampling and questionnaire interviews as well as potential biases due to non-response at baseline have been described in detail elsewhere.24 We merged data from the baseline survey with data from the Danish Register for Evaluation of Marginalization (DREAM),25 which is a national register that includes information on all social transfer payments in Denmark, including sickness absence benefits.

In our analyses of the onset of depressive disorder, we used data from the baseline and the 6-month follow-up study (n = 2540). We excluded 229 participants with a baseline Major Depression Inventory (MDI) score ≥21, as this would indicate an already existing depressive disorder. We further excluded 153 participants with missing values on main study variables. This yielded a study population of 2158 participants for the analyses using depressive disorder as outcome. In the analyses of the onset of LTSA, we used data from the baseline study that were merged with data from DREAM (n = 4340). We excluded 493 participants with LTSA 2 years preceding the baseline survey. We further excluded 333 participants with missing data on the main study variables. This yielded a study population of 3514 participants for the analyses using LTSA as an outcome.

An analysis of nonresponse at baseline showed that women and older respondents were significantly more likely to participate than men and younger respondents.24 In an analysis of attrition from baseline to follow-up, we found no significant differences between men and women, while older respondents were significantly more likely to respond at follow-up than younger respondents. Additional attrition analyses showed no statistically significant differences in the prevalence of depressive disorders at baseline or in the incidence of long-term sickness absence during follow-up when comparing participants to non-participants.26

Exposure variables

We deployed measures from the Danish Psychosocial Work Environment Questionnaire (DPQ)24 as predictors in the analyses: Quantitative demands (four items; Cronbach’s α: 0.84). Emotional demands (four items; Cronbach’s α: 0.83). Role conflicts (four items; Cronbach’s α: 0.78) (see Supplementary table S1 for an overview of all items and their response categories).

Bullying was measured with one item: Have you been exposed to bullying in your current job during the last 12 months? (Yes or no) (see Supplementary table S1 for details).

For the analyses, we constructed mean scores for quantitative demands, emotional demands, and role conflicts, and dichotomized individuals into low and high exposure using median split. Workplace bullying was dichotomized into ‘exposed’ (yes) or non-exposed (no). Finally, an additive index ranging from 0 (low exposure to all psychosocial work factors) to 4 (high exposure to all psychosocial work factors) was created.

Outcome variables

Depressive disorder was measured with the MDI at baseline, and at 6-month follow-up. The MDI contains 12 items about depressive symptoms experienced within the last 14 days. Response options for each item range from 0 (symptom not present at all) to 5 (symptom present all of the time). Total MDI score ranges from 0 to 50, as for two pairs of items only the higher score is considered.

In accordance with the literature, we used a score 21 as an indication for a probable depressive disorder.27,28 The MDI and its clinical validation are described in detail elsewhere.27–29

We measured LTSA by linking the baseline survey data to DREAM using the participants’ social security number. In line with previous Danish studies,16,20 we defined LTSA as any sickness absence duration lasting a minimum of six consecutive weeks during 1 year of follow-up after baseline.

Covariates

We adjusted the estimates for the following confounders: sex, age, educational attainment, job group, smoking, cohabitation with partner, and cohabitation with children.

Statistical analysis

We analyzed the prospective associations between the additive index of high exposure to the psychosocial work factors at baseline and the onset of depressive disorder at follow-up using logistic regression models to estimate odds ratios (ORs) and 95% confidence intervals (95% CIs). We adjusted all analyses for the covariates in three steps (see table 3) and we excluded respondents with a depressive disorder (MDI score ≥21) at baseline. We also followed these procedures when analyzing associations between each of the four exposure variables and the onset of depressive disorder. We analyzed these associations using the LOGISTIC procedure in SAS 9.4 (SAS Institute, Cary, NC). To assess the robustness of the results, we conducted a sensitivity analysis excluding respondents with a baseline MDI score ≥15 as we did in a previous article.30 Thus, we used for exclusion a baseline score that was slightly lower than the cut-off point for defining a depressive disorder (MDI score ≥21). In the sensitivity analysis, depressive disorder at follow-up was still defined as an MDI score ≥21.

Table 3

OR and 95% CI for the association between cumulated self-reported exposure to adverse psychosocial work factors at baseline and onset of depressive disorder after 6-month follow-up (n = 2158)

Self-reported exposure to number of psychosocial work factorsRisk of onset of depressive disorder after 6 months of follow-up
Crude modela
Model 1b
Model 2c
Model 3d
At riskCases n/%OR95% CIOR95% CIOR95% CIOR95% CI
061013/2.11Reference1Reference1Reference1Reference
161724/3.91.860.94–3.691.850.93–3.682.211.10–4.442.981.09–4.44
247125/5.32.571.30–5.092.571.30–5.083.311.63–6.723.141.54–6.43
341137/9.04.542.38–8.664.572.40–8.737.043.53–14.066.443.19–13.01
4496/12.26.412.32–17.696.912.49–19.179.003.11–26.009.623.30–28.01
Self-reported exposure to number of psychosocial work factorsRisk of onset of depressive disorder after 6 months of follow-up
Crude modela
Model 1b
Model 2c
Model 3d
At riskCases n/%OR95% CIOR95% CIOR95% CIOR95% CI
061013/2.11Reference1Reference1Reference1Reference
161724/3.91.860.94–3.691.850.93–3.682.211.10–4.442.981.09–4.44
247125/5.32.571.30–5.092.571.30–5.083.311.63–6.723.141.54–6.43
341137/9.04.542.38–8.664.572.40–8.737.043.53–14.066.443.19–13.01
4496/12.26.412.32–17.696.912.49–19.179.003.11–26.009.623.30–28.01
a

Crude model: unadjusted.

b

Model 1: adjusted for age and sex.

c

Model 2: Model 1 plus job group and educational attainment.

d

Model 3: Model 2 plus smoking, cohabitation with partner, and cohabitation with children.

Table 3

OR and 95% CI for the association between cumulated self-reported exposure to adverse psychosocial work factors at baseline and onset of depressive disorder after 6-month follow-up (n = 2158)

Self-reported exposure to number of psychosocial work factorsRisk of onset of depressive disorder after 6 months of follow-up
Crude modela
Model 1b
Model 2c
Model 3d
At riskCases n/%OR95% CIOR95% CIOR95% CIOR95% CI
061013/2.11Reference1Reference1Reference1Reference
161724/3.91.860.94–3.691.850.93–3.682.211.10–4.442.981.09–4.44
247125/5.32.571.30–5.092.571.30–5.083.311.63–6.723.141.54–6.43
341137/9.04.542.38–8.664.572.40–8.737.043.53–14.066.443.19–13.01
4496/12.26.412.32–17.696.912.49–19.179.003.11–26.009.623.30–28.01
Self-reported exposure to number of psychosocial work factorsRisk of onset of depressive disorder after 6 months of follow-up
Crude modela
Model 1b
Model 2c
Model 3d
At riskCases n/%OR95% CIOR95% CIOR95% CIOR95% CI
061013/2.11Reference1Reference1Reference1Reference
161724/3.91.860.94–3.691.850.93–3.682.211.10–4.442.981.09–4.44
247125/5.32.571.30–5.092.571.30–5.083.311.63–6.723.141.54–6.43
341137/9.04.542.38–8.664.572.40–8.737.043.53–14.066.443.19–13.01
4496/12.26.412.32–17.696.912.49–19.179.003.11–26.009.623.30–28.01
a

Crude model: unadjusted.

b

Model 1: adjusted for age and sex.

c

Model 2: Model 1 plus job group and educational attainment.

d

Model 3: Model 2 plus smoking, cohabitation with partner, and cohabitation with children.

We analyzed the associations between the additive index of high exposure to the psychosocial work factors at baseline and the onset of LTSA during follow-up using Cox regression models to estimate hazard ratios (HR) and 95% CI. We measured LTSA during 12 months of follow-up using calendar time as the underlying time axis. We followed participants from the week they filled in the questionnaire until the first onset of LTSA or censoring due to migration, retirement, death or end of follow-up, whichever came first. Respondents with LTSA within a 24-month period prior to baseline were excluded from the analyses. We adjusted all analyses for the covariates in three steps (see table 4). We also followed these procedures when analyzing associations between each of the four exposure variables and the onset of LTSA. We found by visual inspection that the proportional hazard assumption was satisfied in all analyses. In these analyses, we used the PHREG procedure in SAS 9.4 (SAS Institute, Cary, NC).

Table 4

HRs and 95% CIs for the association between cumulated self-reported exposure to adverse psychosocial work factors at baseline and onset of long-term sickness absence during 12-month follow-up (n = 3514)

Self-reported exposure to number of psychosocial work factorsRisk of onset of long-term sickness absence during 12 months of follow-up
Crude modela
Model 1b
Model 2c
Model 3d
At riskCases n/%HR95% CIHR95% CIHR95% CIHR95% CI
095329/3.01Reference1Reference1Reference1Reference
194326/2.80.900.53–1.530.880.52–1.501.040.61–1.781.130.65–1.97
282934/4.11.350.82–2.211.360.83–2.231.590.95–2.631.670.99–2.83
368138/5.51.851.14––3.001.771.09–2.872.251.34–3.772.311.35–3.97
410811/10.23.521.76–7.053.241.62–6.503.661.80–7.474.041.95–8.37
Self-reported exposure to number of psychosocial work factorsRisk of onset of long-term sickness absence during 12 months of follow-up
Crude modela
Model 1b
Model 2c
Model 3d
At riskCases n/%HR95% CIHR95% CIHR95% CIHR95% CI
095329/3.01Reference1Reference1Reference1Reference
194326/2.80.900.53–1.530.880.52–1.501.040.61–1.781.130.65–1.97
282934/4.11.350.82–2.211.360.83–2.231.590.95–2.631.670.99–2.83
368138/5.51.851.14––3.001.771.09–2.872.251.34–3.772.311.35–3.97
410811/10.23.521.76–7.053.241.62–6.503.661.80–7.474.041.95–8.37
a

Crude model: unadjusted.

b

Model 1: adjusted for age and sex.

c

Model 2: Model 1 plus job group and educational attainment.

d

Model 3: Model 2 plus smoking, cohabitation with partner, and cohabitation with children.

Table 4

HRs and 95% CIs for the association between cumulated self-reported exposure to adverse psychosocial work factors at baseline and onset of long-term sickness absence during 12-month follow-up (n = 3514)

Self-reported exposure to number of psychosocial work factorsRisk of onset of long-term sickness absence during 12 months of follow-up
Crude modela
Model 1b
Model 2c
Model 3d
At riskCases n/%HR95% CIHR95% CIHR95% CIHR95% CI
095329/3.01Reference1Reference1Reference1Reference
194326/2.80.900.53–1.530.880.52–1.501.040.61–1.781.130.65–1.97
282934/4.11.350.82–2.211.360.83–2.231.590.95–2.631.670.99–2.83
368138/5.51.851.14––3.001.771.09–2.872.251.34–3.772.311.35–3.97
410811/10.23.521.76–7.053.241.62–6.503.661.80–7.474.041.95–8.37
Self-reported exposure to number of psychosocial work factorsRisk of onset of long-term sickness absence during 12 months of follow-up
Crude modela
Model 1b
Model 2c
Model 3d
At riskCases n/%HR95% CIHR95% CIHR95% CIHR95% CI
095329/3.01Reference1Reference1Reference1Reference
194326/2.80.900.53–1.530.880.52–1.501.040.61–1.781.130.65–1.97
282934/4.11.350.82–2.211.360.83–2.231.590.95–2.631.670.99–2.83
368138/5.51.851.14––3.001.771.09–2.872.251.34–3.772.311.35–3.97
410811/10.23.521.76–7.053.241.62–6.503.661.80–7.474.041.95–8.37
a

Crude model: unadjusted.

b

Model 1: adjusted for age and sex.

c

Model 2: Model 1 plus job group and educational attainment.

d

Model 3: Model 2 plus smoking, cohabitation with partner, and cohabitation with children.

The data collection for this study was approved by the Danish Data Protection Agency. Approval from an Ethics Committee is not required for survey-based research in Denmark.

Results

Table 1 shows descriptive statistics for the main study variables. The mean age was 48.2 and 45.7 years in the depressive disorder and LTSA analytic samples, respectively. The proportion of women was 47.0% and 47.1%. Most participants reported high exposure to zero, one or two psychosocial work factors (21.8–28.3%). High exposure to three psychosocial work factors was slightly lower (19.1% and 19.4%) and high exposure to all four factors was substantially lower (2.3% and 3.1%).

Table 1

Characteristics of the two analytic samples at baseline

Analytic sample for depressive disorder (n = 2158)Analytic sample for long-term sickness absence (n = 3514)
Age, mean (SD)48.2 (11.1)45.7 (11.5)
Sex, n (%)
 Men1143 (53.0)1858 (52.9)
 Women1015 (47.0)1656 (47.1)
Educational level, n (%)
 Low (basic schooling)210 (9.8)321 (9.2)
 Middle-low (upper secondary school and vocational education)497 (23.1)909 (26.0)
 Middle-high (short and intermediate higher education)907 (42.2)1425 (40.8)
 High (long higher education)487 (22.7)749 (21.5)
 Other49 (2.3)86 (2.5)
Job group, n (%)
 Office workers149 (6.9)243 (6.9)
 Technical draughtsmen177 (8.2)273 (7.8)
 Teaching and research staff in universities145 (6.7)223 (6.4)
 Health care helpers107 (5.0)170 (4.8)
 Primary school teachers185 (8.6)264 (7.5)
 Medical doctors160 (7.4)232 (6.6)
 Mail carriers122 (5.7)206 (5.9)
 Slaughterhouse workers132 (6.1)259 (7.4)
 Smith workers124 (5.8)214 (6.1)
 Engineers (construction)205 (9.5)315 (9.0)
 Sales assistants in shops115 (5.3)238 (6.8)
 Private bankers176 (8.2)318 (9.1)
 Business managers178 (8.3)291 (8.3)
 Police officers183 (8.5)291 (8.3)
Current smoker, n (%)329 (15.6)586 (17.4)
Cohabitating with partner, n (%)1692 (80.4)2675 (79.5)
Cohabitating with children, n (%)1036 (49.2)1725 (51.3)
Self-reported exposure to psychosocial work factors, n (%)
 Self-reported exposure to high levels of 0 factors610 (28.3)953 (27.1)
 Self-reported exposure to high levels of 1 factor617 (28.6)943 (26.8)
 Self-reported exposure to high levels of 2 factors471 (21.8)829 (23.6)
 Self-reported exposure to high levels of 3 factors411 (19.1)681 (19.4)
 Self-reported exposure to high levels of 4 factors49 (2.3)108 (3.1)
Analytic sample for depressive disorder (n = 2158)Analytic sample for long-term sickness absence (n = 3514)
Age, mean (SD)48.2 (11.1)45.7 (11.5)
Sex, n (%)
 Men1143 (53.0)1858 (52.9)
 Women1015 (47.0)1656 (47.1)
Educational level, n (%)
 Low (basic schooling)210 (9.8)321 (9.2)
 Middle-low (upper secondary school and vocational education)497 (23.1)909 (26.0)
 Middle-high (short and intermediate higher education)907 (42.2)1425 (40.8)
 High (long higher education)487 (22.7)749 (21.5)
 Other49 (2.3)86 (2.5)
Job group, n (%)
 Office workers149 (6.9)243 (6.9)
 Technical draughtsmen177 (8.2)273 (7.8)
 Teaching and research staff in universities145 (6.7)223 (6.4)
 Health care helpers107 (5.0)170 (4.8)
 Primary school teachers185 (8.6)264 (7.5)
 Medical doctors160 (7.4)232 (6.6)
 Mail carriers122 (5.7)206 (5.9)
 Slaughterhouse workers132 (6.1)259 (7.4)
 Smith workers124 (5.8)214 (6.1)
 Engineers (construction)205 (9.5)315 (9.0)
 Sales assistants in shops115 (5.3)238 (6.8)
 Private bankers176 (8.2)318 (9.1)
 Business managers178 (8.3)291 (8.3)
 Police officers183 (8.5)291 (8.3)
Current smoker, n (%)329 (15.6)586 (17.4)
Cohabitating with partner, n (%)1692 (80.4)2675 (79.5)
Cohabitating with children, n (%)1036 (49.2)1725 (51.3)
Self-reported exposure to psychosocial work factors, n (%)
 Self-reported exposure to high levels of 0 factors610 (28.3)953 (27.1)
 Self-reported exposure to high levels of 1 factor617 (28.6)943 (26.8)
 Self-reported exposure to high levels of 2 factors471 (21.8)829 (23.6)
 Self-reported exposure to high levels of 3 factors411 (19.1)681 (19.4)
 Self-reported exposure to high levels of 4 factors49 (2.3)108 (3.1)
Table 1

Characteristics of the two analytic samples at baseline

Analytic sample for depressive disorder (n = 2158)Analytic sample for long-term sickness absence (n = 3514)
Age, mean (SD)48.2 (11.1)45.7 (11.5)
Sex, n (%)
 Men1143 (53.0)1858 (52.9)
 Women1015 (47.0)1656 (47.1)
Educational level, n (%)
 Low (basic schooling)210 (9.8)321 (9.2)
 Middle-low (upper secondary school and vocational education)497 (23.1)909 (26.0)
 Middle-high (short and intermediate higher education)907 (42.2)1425 (40.8)
 High (long higher education)487 (22.7)749 (21.5)
 Other49 (2.3)86 (2.5)
Job group, n (%)
 Office workers149 (6.9)243 (6.9)
 Technical draughtsmen177 (8.2)273 (7.8)
 Teaching and research staff in universities145 (6.7)223 (6.4)
 Health care helpers107 (5.0)170 (4.8)
 Primary school teachers185 (8.6)264 (7.5)
 Medical doctors160 (7.4)232 (6.6)
 Mail carriers122 (5.7)206 (5.9)
 Slaughterhouse workers132 (6.1)259 (7.4)
 Smith workers124 (5.8)214 (6.1)
 Engineers (construction)205 (9.5)315 (9.0)
 Sales assistants in shops115 (5.3)238 (6.8)
 Private bankers176 (8.2)318 (9.1)
 Business managers178 (8.3)291 (8.3)
 Police officers183 (8.5)291 (8.3)
Current smoker, n (%)329 (15.6)586 (17.4)
Cohabitating with partner, n (%)1692 (80.4)2675 (79.5)
Cohabitating with children, n (%)1036 (49.2)1725 (51.3)
Self-reported exposure to psychosocial work factors, n (%)
 Self-reported exposure to high levels of 0 factors610 (28.3)953 (27.1)
 Self-reported exposure to high levels of 1 factor617 (28.6)943 (26.8)
 Self-reported exposure to high levels of 2 factors471 (21.8)829 (23.6)
 Self-reported exposure to high levels of 3 factors411 (19.1)681 (19.4)
 Self-reported exposure to high levels of 4 factors49 (2.3)108 (3.1)
Analytic sample for depressive disorder (n = 2158)Analytic sample for long-term sickness absence (n = 3514)
Age, mean (SD)48.2 (11.1)45.7 (11.5)
Sex, n (%)
 Men1143 (53.0)1858 (52.9)
 Women1015 (47.0)1656 (47.1)
Educational level, n (%)
 Low (basic schooling)210 (9.8)321 (9.2)
 Middle-low (upper secondary school and vocational education)497 (23.1)909 (26.0)
 Middle-high (short and intermediate higher education)907 (42.2)1425 (40.8)
 High (long higher education)487 (22.7)749 (21.5)
 Other49 (2.3)86 (2.5)
Job group, n (%)
 Office workers149 (6.9)243 (6.9)
 Technical draughtsmen177 (8.2)273 (7.8)
 Teaching and research staff in universities145 (6.7)223 (6.4)
 Health care helpers107 (5.0)170 (4.8)
 Primary school teachers185 (8.6)264 (7.5)
 Medical doctors160 (7.4)232 (6.6)
 Mail carriers122 (5.7)206 (5.9)
 Slaughterhouse workers132 (6.1)259 (7.4)
 Smith workers124 (5.8)214 (6.1)
 Engineers (construction)205 (9.5)315 (9.0)
 Sales assistants in shops115 (5.3)238 (6.8)
 Private bankers176 (8.2)318 (9.1)
 Business managers178 (8.3)291 (8.3)
 Police officers183 (8.5)291 (8.3)
Current smoker, n (%)329 (15.6)586 (17.4)
Cohabitating with partner, n (%)1692 (80.4)2675 (79.5)
Cohabitating with children, n (%)1036 (49.2)1725 (51.3)
Self-reported exposure to psychosocial work factors, n (%)
 Self-reported exposure to high levels of 0 factors610 (28.3)953 (27.1)
 Self-reported exposure to high levels of 1 factor617 (28.6)943 (26.8)
 Self-reported exposure to high levels of 2 factors471 (21.8)829 (23.6)
 Self-reported exposure to high levels of 3 factors411 (19.1)681 (19.4)
 Self-reported exposure to high levels of 4 factors49 (2.3)108 (3.1)

Of the 2158 participants in the analytic sample for the onset of depressive disorder, 105 (4.9%) were recorded with a depressive disorder at the 6-month follow-up. Of the 3514 participants in the analytic sample for the onset of LTSA, 138 (3.9%) were recorded with an LTSA during the 12-month follow-up.

Table 2 shows that participants reporting high exposure to quantitative demands (OR 2.09; 95% CI 1.36–3.21), emotional demands (OR 2.46; 95% CI 1.54–3.95), role conflicts (OR 2.92; 95% CI 1.89–4.51) and workplace bullying (OR 2.72; 95% CI 1.54–4.81) had an increased risk of onset of depressive disorder at follow-up compared with the low-exposed reference group.

Table 2

Risk of onset of depressive disorder and long-term sickness absence for participants reporting exposure to high quantitative demands, high emotional demands, high role conflicts and workplace bullying

Onset of depressive disorder
Onset of long-term sickness absence
NCases N (%)OR95% CINCases N (%)HR95% CI
High quantitative demands
 Unexposed120943 (3.6)1Reference196369 (3.5)1Reference
 Exposed94962 (6.5)2.091.36–3.21155169 (4.5)1.581.10–2.27
High emotional demands
 Unexposed119846 (3.8)1Reference192762 (3.2)1Reference
 Exposed96059 (6.2)2.461.54–3.95158776 (4.8)1.711.16–2.53
High role conflicts
 Unexposed124535 (2.8)1Reference189454 (2.9)1Reference
 Exposed91370 (7.7)2.921.89–4.51162084 (5.2)1.861.29–2.66
Workplace bullying
 Unexposed199287 (4.3)1Reference3196115 (3.6)1Reference
  Exposed16618 (10.8)2.721.54–4.8131823 (7.2)1.801.14–2.85
Onset of depressive disorder
Onset of long-term sickness absence
NCases N (%)OR95% CINCases N (%)HR95% CI
High quantitative demands
 Unexposed120943 (3.6)1Reference196369 (3.5)1Reference
 Exposed94962 (6.5)2.091.36–3.21155169 (4.5)1.581.10–2.27
High emotional demands
 Unexposed119846 (3.8)1Reference192762 (3.2)1Reference
 Exposed96059 (6.2)2.461.54–3.95158776 (4.8)1.711.16–2.53
High role conflicts
 Unexposed124535 (2.8)1Reference189454 (2.9)1Reference
 Exposed91370 (7.7)2.921.89–4.51162084 (5.2)1.861.29–2.66
Workplace bullying
 Unexposed199287 (4.3)1Reference3196115 (3.6)1Reference
  Exposed16618 (10.8)2.721.54–4.8131823 (7.2)1.801.14–2.85

Note: All analyses are adjusted for sex, age, educational attainment, job group, smoking, cohabitation with partner and cohabitation with children.

Table 2

Risk of onset of depressive disorder and long-term sickness absence for participants reporting exposure to high quantitative demands, high emotional demands, high role conflicts and workplace bullying

Onset of depressive disorder
Onset of long-term sickness absence
NCases N (%)OR95% CINCases N (%)HR95% CI
High quantitative demands
 Unexposed120943 (3.6)1Reference196369 (3.5)1Reference
 Exposed94962 (6.5)2.091.36–3.21155169 (4.5)1.581.10–2.27
High emotional demands
 Unexposed119846 (3.8)1Reference192762 (3.2)1Reference
 Exposed96059 (6.2)2.461.54–3.95158776 (4.8)1.711.16–2.53
High role conflicts
 Unexposed124535 (2.8)1Reference189454 (2.9)1Reference
 Exposed91370 (7.7)2.921.89–4.51162084 (5.2)1.861.29–2.66
Workplace bullying
 Unexposed199287 (4.3)1Reference3196115 (3.6)1Reference
  Exposed16618 (10.8)2.721.54–4.8131823 (7.2)1.801.14–2.85
Onset of depressive disorder
Onset of long-term sickness absence
NCases N (%)OR95% CINCases N (%)HR95% CI
High quantitative demands
 Unexposed120943 (3.6)1Reference196369 (3.5)1Reference
 Exposed94962 (6.5)2.091.36–3.21155169 (4.5)1.581.10–2.27
High emotional demands
 Unexposed119846 (3.8)1Reference192762 (3.2)1Reference
 Exposed96059 (6.2)2.461.54–3.95158776 (4.8)1.711.16–2.53
High role conflicts
 Unexposed124535 (2.8)1Reference189454 (2.9)1Reference
 Exposed91370 (7.7)2.921.89–4.51162084 (5.2)1.861.29–2.66
Workplace bullying
 Unexposed199287 (4.3)1Reference3196115 (3.6)1Reference
  Exposed16618 (10.8)2.721.54–4.8131823 (7.2)1.801.14–2.85

Note: All analyses are adjusted for sex, age, educational attainment, job group, smoking, cohabitation with partner and cohabitation with children.

Table 2 also shows that participants reporting high exposure to quantitative demands (HR 1.58; 95% CI 1.10–2.27), emotional demands (HR 1.71; 95% CI 1.16–2.53), role conflicts (HR 1.86; 95% CI 1.29–2.66) and workplace bullying (HR 1.80; 95% CI 1.14–2.85) had an increased risk of onset of LTSA during follow-up compared with the low-exposed reference group.

Table 3 shows OR and 95% CI for the association between self-reported high exposure to the number of psychosocial work factors at baseline (0–4) and the onset of depressive disorder during a 6-month follow-up. In the fully adjusted model, compared with the low-exposed reference group, high exposure to any one (OR 2.98; 95% CI 1.09–4.44), any two (OR 3.14; 95% CI 1.54–6.43), any three (OR 6.44; 95% CI 3.19–13.01) and all four (OR 9.62; 95% CI 3.30–28.01) of the psychosocial work factors was associated with an increased risk of depressive disorder. All differences between the high-exposure groups and the low-exposed reference group were statistically significant. A test for trend indicated an exposure–response relationship (P for trend: <0.001).

Results from a sensitivity analysis, where we excluded participants with a baseline MDI score ≥15 points, yielded slightly lower but directionally similar estimates compared with the estimates reported in table 3 (see Supplementary table S2).

Table 4 shows HR and 95% CI for the association between self-reported high exposure to the number of psychosocial work factors at baseline (0–4) and onset of LTSA during 12-month follow-up. In the fully adjusted model, compared with the low-exposed reference group, exposure to any one (HR 1.13; 95% CI 0.65–1.97), any two (HR 1.67; 95% CI 0.99–2.83), any three (HR 2.31; 95% CI 1.35–3.97) and all four (HR 4.04; 95% CI 1.95–8.37) of the psychosocial work factors was associated with an increased risk of onset of LTSA. Exposure to three or four factors yielded statistically significant results compared with the reference group. A test for trend indicated an exposure–response relationship (P for trend: <0.001).

Discussion

In the present study, we examined exposure to four psychosocial work factors (high quantitative demands, high emotional demands, high role conflicts and workplace bullying) in a prospective analysis with regard to two outcomes: onset of depressive disorder and onset of LTSA. We found an exposure–response relationship between the number of self-reported exposure to the psychosocial work factors and the risk of both onset of depressive disorder and onset of LTSA. Participants reporting exposure to high levels of all four psychosocial work factors had a 9-fold increased risk of onset of depressive disorder and a 4-fold increased risk of onset of LTSA at follow-up compared with participants reporting low exposure to all four factors.

The results suggest that simultaneous, cumulative exposure to multiple psychosocial work factors increases the risk of onset of depressive disorder and LTSA. These findings are in agreement with previous studies reporting that combinations of psychosocial work factors constitute a risk factor for adverse work- and health-related outcomes.17–20 Other studies31–33 have also reported that the combination of psychosocial demands and physical demands increases workers’ risk of ill health.

This study adds new knowledge on the effects of combined factors in the psychosocial work environment, which is relevant for occupational health specialists and work environment authorities when promoting a holistic approach to healthy psychosocial working conditions. Thus, focusing solely on single factors at the workplace may be insufficient in improving and protecting workers’ health, although it could be a step in the way. By considering combinations of psychosocial factors in the work environment, it is possible to identify potential problems and take steps to address them in order to create a healthier and safer work environment. To our knowledge, this is the first study to report a prospective association between the accumulation of four potentially adverse psychosocial work factors and the risk of depressive disorder and LTSA. This adds to the relatively new focus on combinations of job demands that have emerged since the study from van Woerkom et al. from 2015.17

According to the COR theory,12 workers invest their resources to deal with job demands in the work situation. When workers over extended periods are exposed to high levels of job demands or adverse factors in their work environment, their psychological and/or physiological resources are likely to be depleted. This may further reduce their ability to deal successfully with additional job demands or adverse factors in the work environment. This could ultimately lead to a so-called loss spiral, as those who lack resources are at greater risk of additional loss,12,17 which again may lead to adverse health-related outcomes, such as depressive disorder or LTSA. In our data, the observed exposure–response relationship serves to both illustrate and support the concept of a loss spiral from the conservation of resources theory. On the basis of COR theory, it could be speculated that a supportive workplace culture may constitute a resource in the psychosocial work environment that could mitigate the risks associated with exposure to multiple adverse psychosocial work factors.12,34 Further, structural and contextual factors need to be considered in attempts to improve the psychosocial work environment.35

Another aspect of this study is its potential relevance for insurance medicine. From 2019 to 2021, The Danish Labour Market Insurance yearly handled between 4001 and 4691 cases of reported work-related mental disorders.36 After assessment, about 7% of these cases were ultimately recognized as occupational diseases. The average percentage of all recognized occupational disease cases, in the same 3 years, was about 25%.36 This discrepancy suggests that professional consensus and understanding about work-related mental illness is not as developed as in other spheres of occupational medicine, e.g. respiratory illnesses, allergies, cancers, etc. In accordance, the weight of evidence in regard to causality between adverse psychosocial working conditions and mental disease is still being vigorously debated.7,37 As our study is an observational study, we cannot rule out that unmeasured confounding biased the associations, and thus the study design limits confidence in interpreting the associations between the four psychosocial work factors and the two outcomes as causal. On the other hand, the exposure–response association and the remarkably strong estimates in the highest exposure group (OR 9.62 for depressive disorder and HR 4.04 for LTSA) increase confidence in a causal interpretation of the associations, as unmeasured confounding needed to be exceptionally pronounced to attenuate these strong estimates towards unity.

Limitations and strengths

The study deployed two different outcomes in the analyses, one measured using self-reports and the other measured in a national register. This is a strength of the study. However, common method biases may have inflated the magnitude of the associations in the analyses of depressive disorder, as both exposure and outcome were assessed by self-report. This may be a limitation of the study.38 It is, therefore, a strength of the study that we have used a register-based measure of LTSA as an outcome as this eliminates the risk of common method biases38 and loss to follow-up. However, DREAM does not contain information on the diagnoses the individual cases of LTSA are based upon.

The analysis of non-response at baseline showed that women and older respondents were more likely to participate than men and younger respondents. This must be taken into account in the interpretation of the results. However, when comparing participants to non-participants at follow-up, the attrition analysis showed no statistically significant differences in the prevalence of depressive disorders at baseline or in the incidence of long-term sickness absence during follow-up.

We measured depressive disorder with the MDI, a self-administered rating scale, and not with an individual clinical interview, the gold standard method for ascertaining depressive disorder.39 We felt confident in using the MDI, because the instrument and the cut-off point of 21 have previously been validated in clinical studies.27,40 It is possible, though, that workers reporting exposure to multiple adverse psychosocial work factors at baseline also have reported a high MDI score, close to the cut-off point of ≥21 at baseline, and that these workers needed only little change to surpass the defined threshold. This could result in reverse causation and severely bias our results, which is a particular concern in the analyses of depressive disorder in this study, as time of follow-up was only 6 months. Therefore, we conducted a sensitivity analysis excluding workers with a baseline MDI score 15. These results did not differ notably from those of the main analysis, indicating that the results were not driven by small changes among workers who were close to the threshold for a depressive disorder at baseline.

Conclusion

In this prospective cohort study, we found that the more adverse psychosocial work factors a worker reported being exposed to, the more likely that worker was to experience onset of depressive disorder and LTSA during follow-up. For both depressive disorder and LTSA alike, we found a clear exposure–response relationship with the number of adverse psychosocial work factors a worker was exposed to at baseline.

To our knowledge, this study is the first that reported a prospective association between combinations of quantitative demands, emotional demands, role conflicts and workplace bullying and risk of depressive disorder and LTSA. The results add to the growing awareness that combinations of psychosocial work factors are important when evaluating their effect on worker health. In a practical context, the results are important for occupational health specialists, work environment authorities and workplaces to evaluate, maintain and create a healthy work environment.

Supplementary data

Supplementary data are available at EURPUB online.

Funding

This study was funded by a strategic fund for research in sickness absence from the National Research Centre for the Working Environment (grant number is not applicable) and from a grant from the Danish Work Environment Research Fund (grant no. 10-2019-03). The data collection for this study was funded by an internal grant (grant number is not applicable) from the National Research Centre for the Working Environment. The funding bodies had no role in designing the study, data collection, data analyses, interpretation of the data, writing of the report, and the decision to submit the report for publication.

Conflicts of interest: None declared.

Author contributions

All authors contributed to the design of the study. T.C. and J.K.S. performed the data analyses. J.C.L. and T.C. co-wrote the first draft of the manuscript. All authors have contributed significantly to the preparation of the manuscript and all authors have approved the final version of the manuscript.

Data availability

The data that this study is based upon may be shared on reasonable request to the corresponding author.

Key points
  • To fathom the intricate nature of workers’ experience of occupational strain, there is a call for investigating the combined or cumulative effects of multiple exposures to psychosocial work factors on workers’ health.

  • This prospective study investigated the association between cumulative exposure to four adverse psychosocial work factors and two health-related outcomes: depressive disorder and long-term sickness absence.

  • Workers reporting exposure to more adverse psychosocial work factors had a higher risk of developing depressive disorder and long-term sickness absence.

  • The findings of this study contribute to the emerging awareness that the combination of psychosocial work factors should play a crucial role when evaluating and assessing the impact of occupational strain on worker health.

  • Occupational health specialists, work environment authorities and employers should heed these findings in their efforts to evaluate, maintain and create safe and healthy work environments.

References

1

Niedhammer
I
,
Bertrais
S
,
Witt
K.
Psychosocial work exposures and health outcomes: a meta-review of 72 literature reviews with meta-analysis
.
Scand J Work Environ Health
2021
;
47
:
489
508
.

2

Nieuwenhuijsen
K
,
Bruinvels
D
,
Frings-Dresen
M.
Psychosocial work environment and stress-related disorders, a systematic review
.
Occup Med (Lond)
2010
;
60
:
277
86
.

3

Kivimäki
M
,
Nyberg
ST
,
Batty
GD
, et al. ;
IPD-Work Consortium
.
Job strain as a risk factor for coronary heart disease: a collaborative meta-analysis of individual participant data
.
Lancet
2012
;
380
:
1491
7
.

4

Clausen
T
,
Nielsen
K
,
Carneiro
IG
,
Borg
V.
Job demands, job resources and long-term sickness absence in the Danish eldercare services: a prospective analysis of register-based outcomes
.
J Adv Nurs
2012
;
68
:
127
36
.

5

Framke
E
,
Sørensen
JK
,
Alexanderson
K
, et al.
Emotional demands at work and risk of long-term sickness absence in 1·5 million employees in Denmark: a prospective cohort study on effect modifiers
.
Lancet Public Health
2021
;
6
:
e752
e759
.

6

Madsen
IEH
,
Nyberg
ST
,
Magnusson Hanson
LL
, et al. ;
IPD-Work Consortium
Job strain as a risk factor for clinical depression: systematic review and meta-analysis with additional individual participant data
.
Psychol Med
2017
;
47
:
1342
56
.

7

Mikkelsen
S
,
Coggon
D
,
Andersen
JH
, et al.
Are depressive disorders caused by psychosocial stressors at work? A systematic review with metaanalysis
.
Eur J Epidemiol
2021
;
36
:
479
96
.

8

Bakker
AB
,
Demerouti
E.
The Job Demands‐Resources model: state of the art
.
J Manag Psychol
2007
;
22
:
309
28
.

9

Karasek
RA.
Job demands, job decision latitude, and mental strain: implications for job redesign
.
Adm Sci Q
1979
;
24
:
285
308
.

10

Siegrist
J.
Adverse health effects of high-effort/low-reward conditions
.
J Occup Health Psychol
1996
;
1
:
27
41
.

11

Hobfoll
SE.
Conservation of resources. A new attempt at conceptualizing stress
.
Am Psychol
1989
;
44
:
513
24
.

12

Hobfoll
SE.
The influence of culture, community, and the nested-self in the stress process: advancing conservation of resources theory
.
Appl Psychol
2001
;
50
:
337
421
.

13

Dragano
N
,
Siegrist
J
,
Nyberg
ST
, et al. ;
IPD-Work Consortium
.
Effort-reward imbalance at work and incident coronary heart disease: a multicohort study of 90,164 individuals
.
Epidemiology
2017
;
28
:
619
26
.

14

Juvani
A
,
Oksanen
T
,
Virtanen
M
, et al.
Clustering of job strain, effort−reward imbalance, and organizational injustice and the risk of work disability: a cohort study
.
Scand J Work Environ Health
2018
;
44
:
485
95
.

15

Rugulies
R
,
Aust
B
,
Madsen
IE.
Effort-reward imbalance at work and risk of depressive disorders. A systematic review and meta-analysis of prospective cohort studies
.
Scand J Work Environ Health
2017
;
43
:
294
306
.

16

Andersen
LL
,
Vinstrup
J
,
Thorsen
SV
, et al.
Combined psychosocial work factors and risk of long-term sickness absence in the general working population: prospective cohort with register follow-up among 69 371 workers
.
Scand J Work Environ Health
2022
;
48
:
549
59
.

17

van Woerkom
M
,
Bakker
AB
,
Nishii
LH.
Accumulative job demands and support for strength use: fine-tuning the job demands-resources model using conservation of resources theory
.
J Appl Psychol
2016
;
101
:
141
50
.

18

Jimmieson
NL
,
Tucker
MK
,
Walsh
AJ.
Interaction effects among multiple job demands: an examination of healthcare workers across different contexts
.
Anxiety Stress Coping
2017
;
30
:
317
32
.

19

Geisler
M
,
Berthelsen
H
,
Hakanen
JJ.
No job demand is an Island - interaction effects between emotional demands and other types of job demands
.
Front Psychol
2019
;
10
:
873
.

20

Clausen
T
,
Sørensen
JK
,
Dalsager
L
, et al.
Do different job demands interact as predictors of long-term sickness absence? A register-based follow-up on 55 467 Danish workers
.
Occup Environ Med
2023
;
80
:
7
13
.

21

Podsakoff
NP
,
LePine
JA
,
LePine
MA.
Differential challenge stressor-hindrance stressor relationships with job attitudes, turnover intentions, turnover, and withdrawal behavior: a meta-analysis
.
J Appl Psychol
2007
;
92
:
438
54
.

22

Thomsen
JF.
Kort klinisk instruks: patienten med psykiske symptomer [Short clinical guideline: the patient with mental symptoms], DASAM [The Danish Society of Occupational and Environmental Medicine].
2017
. Available at: https://view.officeapps.live.com/op/view.aspx?src=https%3A%2F%2Fdasam.dk%2Fwp-content%2Fuploads%2F2019%2F03%2FKort-klinisk-instruks-Psykisk-lidelse.docx&wdOrigin=BROWSELINK (18 July 2023, date last accessed).

23

The Danish Working Environment Authority (Arbejdstilsynet)
. The Danish Working Environment Authority's Executive Order No. 1406 of 26 September 2020 on psychosocial working environment. 2020. Available at: https://at.dk/en/regulations/executive-orders/psychosocial-working-environment-1406/ (18 July 2023, date last accessed).

24

Clausen
T
,
Madsen
IEH
,
Christensen
KB
, et al.
The Danish Psychosocial Work Environment Questionnaire (DPQ): Development, content, reliability and validity
.
Scand J Work Environ Health
2019
;
45
:
356
69
.

25

Hjollund
NH
,
Larsen
FB
,
Andersen
JH.
Register-based follow-up of social benefits and other transfer payments: accuracy and degree of completeness in a Danish interdepartmental administrative database compared with a population-based survey
.
Scand J Public Health
2007
;
35
:
497
502
.

26

Clausen
T
,
Christensen
K
,
Sørensen
J
, et al.
The predictive validity of the Danish Psychosocial Work Environment Questionnaire with regard to onset of depressive disorders and long-term sickness absence
.
Ann Work Expo Health
2023
;
67
:
195
207
.

27

Bech
P
,
Rasmussen
NA
,
Olsen
LR
, et al.
The sensitivity and specificity of the Major Depression Inventory, using the Present State Examination as the index of diagnostic validity
.
J Affect Disord
2001
;
66
:
159
64
.

28

Olsen
LR
,
Jensen
DV
,
Noerholm
V
, et al.
The internal and external validity of the Major Depression Inventory in measuring severity of depressive states
.
Psychol Med
2003
;
33
:
351
6
.

29

Cuijpers
P
,
Dekker
J
,
Noteboom
A
, et al.
Sensitivity and specificity of the Major Depression Inventory in outpatients
.
BMC Psychiatry
2007
;
7
:
39
.

30

Clausen
T
,
Rugulies
R
,
Li
J.
Workplace discrimination and onset of depressive disorders in the Danish workforce: a prospective study
.
J Affect Disord
2022
;
319
:
79
82
.

31

Widanarko
B
,
Legg
S
,
Devereux
J
,
Stevenson
M.
The combined effect of physical, psychosocial/organisational and/or environmental risk factors on the presence of work-related musculoskeletal symptoms and its consequences
.
Appl Ergon
2014
;
45
:
1610
21
.

32

Widanarko
B
,
Legg
S
,
Devereux
J
,
Stevenson
M.
Interaction between physical and psychosocial work risk factors for low back symptoms and its consequences amongst Indonesian coal mining workers
.
Appl Ergon
2015
;
46 Pt A
:
158
67
.

33

Sejbaek
CS
,
Pedersen
J
,
Schlünssen
V
, et al.
The influence of multiple occupational exposures on absence from work in pregnancy: a prospective cohort study
.
Scand J Work Environ Health
2020
;
46
:
60
8
.

34

Xu
T
,
Rugulies
R
,
Vahtera
J
, et al.
Workplace psychosocial resources and risk of cardiovascular disease among employees: a multi-cohort study of 135 669 participants
.
Scand J Work Environ Health
2022
;
48
:
621
31
.

35

Aust
B
,
Møller
JL
,
Nordentoft
M
, et al.
How effective are organizational-level interventions in improving the psychosocial work environment, health, and retention of workers? A systematic overview of systematic reviews
.
Scand J Work Environ Health
2023
;
49
:
315
29
.

36

The Danish Labour Market Insurance (Arbejdsmarkedets Erhvervssikring)
, Arbejdsskadestatistik [Occupational Disease Statistics 2021],
2022
;
34
5
. Available at: https://www.aes.dk/dokument/aes-arbejdsskadestatistik-2021 (19 July 2023, date last accessed).

37

Kolstad
HA
,
Hansen
ÅM
,
Kærgaard
A
, et al.
Job strain and the risk of depression: is reporting biased?
Am J Epidemiol
2011
;
173
:
94
102
.

38

Podsakoff
PM
,
MacKenzie
SB
,
Lee
JY
,
Podsakoff
NP.
Common method biases in behavioral research: a critical review of the literature and recommended remedies
.
J Appl Psychol
2003
;
88
:
879
903
.

39

Drill
R
,
Nakash
O
,
DeFife
JA
,
Westen
D.
Assessment of clinical information: comparison of the validity of a Structured Clinical Interview (the SCID) and the Clinical Diagnostic Interview
.
J Nerv Ment Dis
2015
;
203
:
459
62
.

40

Bech
P
,
Timmerby
N
,
Martiny
K
, et al.
Psychometric evaluation of the Major Depression Inventory (MDI) as depression severity scale using the LEAD (Longitudinal Expert Assessment of All Data) as index of validity
.
BMC Psychiatry
2015
;
15
:
190
.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited.

Supplementary data

Comments

0 Comments
Submit a comment
You have entered an invalid code
Thank you for submitting a comment on this article. Your comment will be reviewed and published at the journal's discretion. Please check for further notifications by email.