Skip to main content
Download PDF

The importance of transdiagnostic symptom level assessment to understanding prognosis for depressed adults: analysis of data from six randomised control trials

BMC Medicine volume 19, Article number: 109 (2021) Cite this article

Abstract

Background

Depression is commonly perceived as a single underlying disease with a number of potential treatment options. However, patients with major depression differ dramatically in their symptom presentation and comorbidities, e.g. with anxiety disorders. There are also large variations in treatment outcomes and associations of some anxiety comorbidities with poorer prognoses, but limited understanding as to why, and little information to inform the clinical management of depression. There is a need to improve our understanding of depression, incorporating anxiety comorbidity, and consider the association of a wide range of symptoms with treatment outcomes.

Method

Individual patient data from six RCTs of depressed patients (total n = 2858) were used to estimate the differential impact symptoms have on outcomes at three post intervention time points using individual items and sum scores. Symptom networks (graphical Gaussian model) were estimated to explore the functional relations among symptoms of depression and anxiety and compare networks for treatment remitters and those with persistent symptoms to identify potential prognostic indicators.

Results

Item-level prediction performed similarly to sum scores when predicting outcomes at 3 to 4 months and 6 to 8 months, but outperformed sum scores for 9 to 12 months. Pessimism emerged as the most important predictive symptom (relative to all other symptoms), across these time points. In the network structure at study entry, symptoms clustered into physical symptoms, cognitive symptoms, and anxiety symptoms. Sadness, pessimism, and indecision acted as bridges between communities, with sadness and failure/worthlessness being the most central (i.e. interconnected) symptoms. Connectivity of networks at study entry did not differ for future remitters vs. those with persistent symptoms.

Conclusion

The relative importance of specific symptoms in association with outcomes and the interactions within the network highlight the value of transdiagnostic assessment and formulation of symptoms to both treatment and prognosis. We discuss the potential for complementary statistical approaches to improve our understanding of psychopathology.

Peer Review reports

Background

Psychological therapies and medication are effective treatments for depression (e.g. [1, 2]). However, effect sizes have been modest and gains in treatment outcomes have plateaued [3]. Interventions for depression target a broad range of symptoms, and knowledge of ‘what’ is being intervened upon is not necessary to the delivery of most treatments, and poses problems for causal inference [4]. To improve interventions, we may need to improve our knowledge of the structure of depression [5].

Depression is heterogeneous in terms of aetiology and symptom profile [6,7,8]. Mood disorders are highly comorbid with anxiety disorders and may share psychological and biological vulnerabilities [9, 10]. The risk of one disorder can increase the risk of another [11], and the same end state may be achieved via many different paths (equifinality) [12, 13]. These disorders are not discrete entities and, as such, neglecting the symptomatic heterogeneity discards potential insights [14].

There is strong evidence that different symptoms are not equivalent or interchangeable [15] and studies of individual symptoms in the last decade have brought important understanding. For example, individual symptoms may differ in response to treatment [16, 17] and have been shown to have a differential impact on functioning [18,19,20]. Depression is a recurrent disorder with the probability of relapse strongly associated with the presence of residual depressive symptoms at the end of treatment [21, 22]. Comorbid anxiety disorders are related both to worse treatment outcomes [23] and to an increased risk of relapse [21]. An assumed unidimensional view of depression, characterised by sum score (sum of symptom severity scores) measurement and prediction models, conceals the variability within depression [24]. Understanding the relative importance of comorbid symptoms may offer more information than severity of disorder alone and provide additional treatment and prognostic information [25]. Large-scale, multisite clinical trial data, coupled with innovative statistical methods, can provide categorisation and treatment optimisation to provide immediate benefits by informing clinical decisions [26,27,28].

There is also value in studying the relations among these symptoms. Network theory posits that the relationships between common affective, cognitive, and somatic symptoms of these disorders may reflect potential causal pathways and elucidate maintenance mechanisms [29]. Depression and anxiety have been modelled as symptom networks using cross-sectional and longitudinal data, demonstrating the interrelation between the symptoms of each disorder, where comorbidity results from mutually reinforcing interrelation between symptoms of each disorder [30, 31]. Anhedonia, anxiety, worry, fatigue, and sadness are predominantly influential symptoms in these networks [5, 32, 33]. The relationship between symptoms/mechanisms can help to predict outcome and potentially inform treatment targets and the development of treatments targeting specific mechanisms [34].

There are inconsistencies in the network literature exploring depression and anxiety, due to design, sampling, and variability arising from differing measurement [15, 35]. When attempting to discriminate between groups for the purposes of identifying whom may benefit from treatment (prognosis at group level), there are varying results from network comparison studies, where it has been suggested that densely connected networks may be less likely to recover [36]. However, these differences are not always observed [37] and require large sample sizes to detect any effect. It is also unclear how these networks generalise to idiographic networks at the present stage. Past research has been conducted on small samples with low quality assessment of patients (or non-clinical samples) and lack of adequate consideration of comorbidity (missing out on the wider spectrum of anxiety disorders).

In this study we aim to:

  1. 1)

    Identify important symptoms for outcome by examining the (differential) impact of individual symptoms on prognosis for adults with depression that took part in randomised controlled trials after seeking treatment in primary care and assess whether individual symptoms offer predictive value above sum scores.

  2. 2)

    Discern the functional relations among symptoms and clarify the interplay between highly comorbid symptoms of depression and anxiety disorders.

  3. 3)

    Consider whether there are differences in the baseline symptom networks of patients that remitted vs. those whose depression persisted, after treatment.

Method

Datasets

Data were drawn from a subset of the Dep-GP individual patient data (IPD) database [36]. The formation of the Dep-GP IPD dataset has been described elsewhere [36]. Bibliographic databases were searched up to 29 April 2020 for RCTs of unipolar depressed adults seeking treatment for depression or with depressive symptoms significant enough for them to seek treatment, recruited from primary care; had at least one active treatment arm; and used the CIS-R at baseline.

Studies were excluded if they were studies of patients with depression secondary to a diagnosis of personality disorder, psychotic conditions, or neurological conditions; bi-polar or psychotic depressions; children or adolescents; feasibility studies; or were studies of adults with either depression or an anxiety disorder, rather than a primary depression with or without comorbid anxiety. Additional inclusion criteria for the present study were the use of the Beck Depression Inventory (2nd Edition) (BDI-II) [37] at study entry. The inclusion criteria ensured uniformity in the measurement of depressive and anxiety symptoms, chronicity of problems, and determination of diagnoses including anxiety comorbidities.

Data on all individual patients from all six eligible RCTs were included in the current study, these were COBALT [38], GENPOD [39], PANDA [40], TREAD [41], MIR [42], and IPCRESS [43].

Measures

Individual items from the BDI-II [37], and individual symptom subscales of the CIS-R [44], including duration of depression and anxiety, which have been shown to be independently associated with prognosis for depressed adults [45].

Outcomes

The primary outcome was endpoint depressive symptoms at three to four months post-study entry. Five of the studies used the BDI-II at 3–4 months, and one used the PHQ-9. A continuous ‘depression severity’ score was developed by converting the responses on each measure to a latent trait depressive symptom severity score (PROMIS T-Score) [46], using the expected a posteriori parameter from a multidimensional item-response theory based score conversion tool [47]. Depressive symptoms (PROMIS T-Score) at 6–8 months post-study entry, and 9–12 months were secondary outcomes.

As a sensitivity analysis, the BDI-II scores were used as outcomes for the three time points (five studies at 3–4months; four studies at 6–8months, and three studies at 9–12 months).

Data analysis

All analyses were performed in R 3.6 [48] and Stata 16.0 [49]. Analysis code is available from https://osf.io/wck6b/. The data that support the findings of this study are available from the lead author of the Dep-GP (JB) subject to agreement from the chief investigators or data controllers of the individual RCTs. Restrictions apply to the availability of these data, which were used under licence for this study.

Pre-processing

Datasets were combined and pre-processed together. There was no missing data at study entry. All items were investigated to ensure they met assumptions for inclusion in the network models, including assessing for near zero variance, roughly equal variance of items, asymmetrical distributions, and topological overlap [50]. Items were removed if they violated assumptions across all studies. We aimed to address topological overlap using the ‘goldbricker’ function in R [51] with a threshold of 25% (correlations between items should have significantly different correlations with 25% of the other items), accepting minimal correlation of 0.5.The respective pair of items were combined into a single variable using principal component analysis (PCA) if reasonable to combine from a clinical perspective. Items were afterwards rescaled to their original Likert scale values to make variances comparable across items [52].

Association with outcomes

We aimed to examine the differential impact of individual symptoms on outcomes and assess whether individual symptoms offer predictive value above sum scores. Sum score totals were entered into a linear regression model, while the item severity scores were entered into an elastic net generalised linear model (ENR) [53]. ENR, a statistical method combining lasso and ridge regression approaches, minimises overfitting and the use of ten separate, tenfold repeated cross validation aids in assessing the effectiveness of the model. The item-level and sum-score models were compared using root mean squared error, mean absolute error, and R2.

As the item-level predictors were assumed to be correlated and that we wished to assess the explanatory power of individual predictors, we estimated the contribution of each item to the outcome prediction using Shapley Additive exPlanations [54], following ENR model estimation. Five hundred Monte Carlo repetitions were used to estimate each Shapley value. This metric is more accurate than other variable importance metrics when predictors are dependent [55]. Items with large Shapley values are ‘important’, indicating the relative contribution of an item to the model while accounting for correlated features in the data.

Network modelling

A graphical Gaussian model (GGM) aims to capture the direct effects (edges) between items while controlling for all other items in the network. A network was estimated by combining data from the six RCTs. The sample was then split into two networks (those with persistent symptoms vs. remitters: BDI-II score < 10 at 3–4 months); the networks were re-estimated and compared using the network comparison test with 1000 iterations [56].

We performed a number of analyses to test the robustness of the networks we estimated.

While lasso [57], regularised GGMs [58] are most frequently reported in the network literature, lasso specificity has recently been shown to be lower than expected in dense networks with many small edges, leading to an increase in false positives [59]. We also estimated an unregularized GGM using an iterative modelling procedure: the Extended Bayesian Information Criterion (EBIC). Selecting unregularized GGMs according to EBIC has been shown to converge to the true model [60]. The algorithm runs 100 glasso models, re-fits all models without regularisation,, and subsequently adds and removes edges until EBIC can no longer be improved. The best performing model (EBIC parameter) was selected to provide a conservative GGM estimation (high specificity).

Chronicity of disorders has been shown to interact with symptom severity [45, 61]. We corrected for the potential confounding effects of duration of depression and anxiety within the network models.

Combining data obtained from different studies holds the potential for between-study differences to influence estimation. A network estimation procedure (fused graphical lasso: FGL) [62] has been designed to manage this issue, however, this involves estimating networks individually and penalising between study differences. Where study size affects the estimation of edges, this can lead to penalization based on sample size rather than on true differences between the network structures [63]. As such, it was decided to estimate based on the combined sample and to compare this to the FGL network (joint estimation using a fused penalty, and 10-fold cross validation), to assess the potential influence of group level differences.

Finally, the network model was tested for the stability of expected influence centrality and the accuracy of interrelations using a nonparametric bootstrapping procedure (1000 iterations) [64]. For details of these, see the Supplementary material.

We obtained two types of information from the resulting network structures. First, symptoms can form clusters or communities with other symptoms to which they are connected reflecting commonalities between them. We estimated the community structure by using a bootstrapped walktrap algorithm [65], investigated for item stability before selecting communities. Second, the overall connectivity of a symptom, i.e. its connection to other symptoms, can be quantified in a number of ways and is referred to as centrality. Some scholars have argued that activation of a central symptom has the potential to activate associated symptoms in the network [66], where symptom centrality is then interpreted as symptom importance, given that identifying such symptoms may have the potential to elucidate the processes underlying comorbidity and implications for treatment. Within the context of communities specifically, symptoms which connected to more than one community are referred to as bridge symptoms. Within cross-sectional networks (as explored here), we refer to centrality as a statistical parameter, i.e. the strength of predictive associations between symptoms. Centrality does not automatically translate into clinical relevance [67] and cautious interpretation is warranted [63]. It requires consideration of how the symptoms activate within the network (flow or transfer), the conceptual similarity between symptoms, and whether there is missing information on the shared variance [68]. Symptom centrality was calculated using expected influence (EI: strength of the relationships a given node has with other node) and the geometric mean of the participation ratio (PR) and participation coefficient (PC), and normalised bridge expected influence centrality [69]. The PR quantifies the number and strength of edges, while the PC takes the community structure into account [70].

Results

Demographic details for the studies are presented in Table 1. Overall samples were comparable. The severity of depressive symptoms captured by BDI-II scores at baseline in the PANDA sample was lower than the other trials. Descriptive results are reported in the supplementary materials.

Table 1 Descriptive table of studies included in the dataset. Summary of included variables provided in supplementary materials. * International Baccalaureate equivalent ** High school diploma equivalent
Full size table

Association with outcomes

In order to assess the utility of item level models, we compared them to sum score models. For all item level models (Table 2), the optimal shrinkage parameters for the elastic net regression model were selected via minimum cross-validated error criterion (ᾳ = 0.1 and λ = 0.05). While models performed similarly at 3–4 months and 6–8 months, the item level elastic net regression model outperformed linear regression with BDI-II and CIS-R (sum of anxiety items) totals at the 9–12-month time point. The sensitivity analysis performed similarly. Due to the absence of two studies (IPCRESS and PANDA) at the 9–12-month endpoint, we reran the analyses for the earlier time points without these studies. This sensitivity analysis did not reveal any difference in the pattern of model performance.

Table 2 Performance of the regression models. Sum scores: BDI-II and CIS-R; RMSE root mean squared error; MAE mean absolute error; R2 proportion of the variance explained
Full size table

Pessimism (Fig. 1) was consistently the most important item; health anxiety was in the upper quartile at each time point; and concentration, failure/worthlessness, also in the upper quartile at 3–4months; guilt and sleep at 6–8 months; and somatic symptoms at 9–12 months.

Fig. 1
figure 1

Shapley values for variable importance are plotted: (showing the difference contribution of items to predictions)

Full size image

Network modelling

For the individual items in the network model, near zero variance (e.g. due to floor and ceiling effects) was not observed. However, we saw asymmetric distributions (skew) on a number of items. As such, a Spearman covariance matrix was estimated and used to estimate the network model. Multi-collinearity was identified for two pairs of items (loss of pleasure with loss of interest, failure with worthlessness). New items were constructed using PCA for each pair. The optimal model for the network analysis was an unregularized graphical Gaussian model using the EBIC.

A walktrap algorithm identified three, stable, symptom communities (median = 3, SD = 0.15, 95% CI [2.71, 3.29]). The three communities split into anxiety items, depressive cognitions and depressive physical symptoms. Bridging EI elucidated three bridging symptoms between the communities: sadness and indecisiveness (from the physical symptoms community) and pessimism (cognitive symptoms community).

Centrality estimates (i.e. measures of the strength of connection to other items) are reported in Fig. 2. The EI correlation stability coefficient was high (0.75), suggesting that the ordering of items based on centrality remained the same after re-estimating the network with fewer cases (the probability the correlation between original centrality indices and centrality of networks based on subsets was 0.7 or higher) and can be reliably interpreted.

Fig. 2
figure 2

Network plot (top) with communities. Bridge symptoms are categorised separately; however, sadness and indecisiveness fall into community 1, and pessimism into community 3. The thickness of the edges indicates to what degree items are related, and the colour of the edges indicates the relationship sign (i.e. positive = blue, negative = red). Centrality estimates: PC/PR and EI (bottom)

Full size image

The estimates from the different metrics (EI and PC/PR) were correlated (r = 0.58). The most central symptoms were sadness (PC/PR) and failure/worthlessness (EI). Failure/worthlessness had a significantly higher EI centrality than twenty-one other symptoms (see supplementary material). The next most central nodes (EI) were sadness, self-criticism, and loss of energy (all z-score > 1), followed by concentration, loss of pleasure/interest, and fatigue (z-score > 0.96), while the next most central nodes when using PC/PR were pessimism, failure/worthlessness, and punishment (all z-score > 1), then guilt, indecisiveness, and suicidal thoughts (all z-score > 0.80). Notably, while suicidal thoughts were highly central according the PC/PR metric (z-score = 0.80), it was much less central using EI (z-score = − 0.67). Loss of energy displayed the opposite relationship, more central for EI (z-score = 1.01) than PC/PR (z-score = − 2.03). Loss of energy and obsessions were jointly the least central nodes using PC/PR, and obsessions was also the least central when using EI.

Robustness checks suggest the resulting graphical Gaussian model was stable and accurate. Stability and accuracy plots, individual networks (with the fused penalty) and the fused network model are supplied in the supplementary materials. Mean severity was not significantly correlated (p < 0.05) with EI (r = 0.21) or PC/PR (r = − 0.05), while the standard deviation was significantly correlated for both EI (r = − 0.56) and PC/PR (r = − 0.41). Symptom severity was not associated with nodes being interconnected. Lower variability was associated with variability, which is the reverse of a more typical concern: differential variability driving the centrality of nodes [52].

The interrelation of the network and the FGL network were compared (r = 0.72), suggesting that between study differences had a small effect on network estimation. The network was corrected for the influence of duration of depression and anxiety; however, the overall influence on edge estimation was negligible (interrelation between the corrected network and a network estimated without duration variables: r = 0.997). Overall, the resulting network model can be considered robust.

Network comparison test

Networks (unregularized) were compared (1000 iterations) for those who were classified as in remission (n = 956) and those who were not (n = 1466). Mean severity differences at baseline were significant for all items (p < 0.001). The correlation between networks was high (r = 0.67). While there were significant difference between edges, the overall networks (see supplementary material) did not differ in connectivity (global strength invariance: p < 0.08) and post hoc tests were not warranted. There was only evidence of one difference in centrality between the networks: somatic symptoms were more connected in the remitter network than the persister network (p < 0.001).

Discussion

Individuals with depression also present with comorbidity, and this could present an issue for depression treatment. Understanding how symptoms influence one another across traditional diagnostic boundaries, and how they influence important outcomes, may provide insights relevant to the assessment and treatment of mood disorders. In this study, we initially examined the differential impact of individual symptoms on prognosis and assessed whether individual symptoms offer predictive value above sum scores. The item level models of outcomes post-treatment and the sum score models were similarly associated with outcomes at 3–4 and 6–8 months but explained considerably more variance at 9–12 months. Pessimism was consistently the most important predictor of future outcomes (independent of its mean), indicating that experiencing pessimism rather than severity of the symptom is responsible for this association. Secondly, we explored the functional relations among comorbid symptoms of depression and anxiety disorders using network analysis. The symptom network comprised of three communities clearly clustering into anxiety items, depressive cognitions, and depressive physical symptoms. The primary bridge symptoms between communities were sadness; pessimism; and indecision. The most central symptoms across both centrality metrics were sadness and failure/worthless. Finally, we analysed differences in the symptom networks at study entry for patients that remitted vs. those whose depression persisted, after treatment. Network comparison revealed no overall differences in connectivity. Together, the present findings suggest the utility of item-level analysis in informing the content of assessments and consideration of individual items over and above scale scores when predicting prognosis.

Findings in context

Exploring the associations with treatment outcomes revealed that item-level prediction methods performed similarly to sum scores and outperformed sum score models at the 9–12-month endpoint. It is not clear why there is a difference at this time point; while it was not due to attrition between endpoints, it could be due to random variation. It may also reflect the course of depression following intervention, or the cyclical nature of depression such that individual items are better at predicting the relapse or maintenance of symptoms after benefits of treatment have faded, or where an amelioration of symptoms occurred due to further treatment post randomisation. There is an ongoing debate in the field whether central items derived from network models offer predictive utility beyond other items [71,72,73]. Pessimism was not only the best predictor across outcomes; it was a central item (ranked 2nd on PC/PR and 6th on EI centrality) that acted as a bridge between communities and showed strong associations with sadness and failure/worthlessness. Sadness, comparatively, did not predict well across time points. It is worth noting that sadness falls within the physical symptom community and pessimism within the cognitive community. The amenability to act on an emotion (sadness) is understandably less than that of a cognition (pessimism), a target of cognitive therapy, while pessimism in association with a sense of failure/worthlessness may negatively impact treatment engagement (i.e. the motivation to sustain goal pursuit in the face of obstacles) [74]. Given the central role and prognostic value of pessimism, we might speculate that it is associated with treatment factors, where pessimism hinders some people making progress and may not be directly addressed by some psychological treatments.

Symptoms of anxiety and depression clustered into separate communities with certain symptoms acting as bridges between communities. The bridge symptoms are statistically relevant and theoretically linked: indecision is a symptom in the classifications of both depression and generalised anxiety disorder, pessimism overlaps with worry [75] and the strong cross-community edge of sadness to worry was similar to findings in other studies [32, 76]. The results therefore provide evidence that these bridging symptoms may be important in the emergence of comorbidity between anxiety disorders and depression.

Planned comparisons of networks at study entry for those whose depression would persist versus those who would be in remission revealed no overall difference in connectivity, in contrast to Van Borkulo et al. [77], but similar to Schweren et al. [78].

Overall, we found no correlation between centrality metrics and Shapley values. This extends prior work on the association between centrality and the prognostic utility of items [71]. Failure/worthlessness was predictively important at 3–4 months, displayed high centrality and is suggested to be a key symptom in depression and anxiety [30]. The predictive utility of health anxiety and somatic concerns may be considered alongside the observation from the network comparison where there was a difference in centrality with somatic concerns more connected in the remitter network. Health anxiety was in the upper quintile of variable importance across time points, but relatively unimportant in terms of centrality. Not surprisingly, given the conceptual overlap, with health anxiety, the strongest edge was with somatic concerns. As such, the degree of concern for one’s health, or attention to somatic symptoms, whilst not playing a significant role within the maintenance of depression, may act as a motivational spur to engage with treatment (in this way enabling rather than disabling the individual). The absence of this anxiety may reflect an apathy about one’s health which is not captured by the motivational item in the BDI. While the predictive modelling did consider the influence of each item independent of the other items, modelling the predictive value of individual items may be improved by examining the association between the changes at symptom level and the overall network [79, 80].

The network derived in this study provides empirical phenomena that can be explained by principles of network theory. This requires interpreting the network as a causal system, even though we cannot infer temporal relationship between symptoms and there is an absence of causal mechanisms within the external field (e.g. environmental factors) [29]. These limitations apply to most of the findings in the network literature, although overinterpretation is common [81]. Holding this in mind, we can consider possible pathways and mediating role of symptoms through the network. For example, taking suicidal ideation as a clinically severe symptom, we can identify the shortest path from worry [82] passing through sadness (bridge), and from loss of pleasure/interest [83] to suicidal thoughts, passed through pessimism (bridge). It is possible that any causal effect between these connections may be part of a longer pathway within the network highlighting a need for greater attention to be given to symptom interactions.

The statistical model investigates a symptom level, transdiagnostic conceptualization of the symptom interactions for individuals diagnosed with depression participating in RCTs. These interventions are based on biological or psychological theories, most notably Beck’s cognitive of theory of depression [84]. Clinically, pragmatism trumps theoretical completeness; simple interventions which achieve rapid change do not require a detailed appreciation of the potential underlying mechanisms. However, oversimplified theories may restrict the ability to identify causal patterns, and gaps emerge in practice where the model is suggested to not fit the patient [85]. More process-driven interventions targeting shared features of disorders have been developed [86, 87], yet there is no unifying theory. The findings presented may help bridge the gap between disorder-specific theories and more transdiagnostic theories. Considering how symptoms may interact can help clinicians and researchers to understand underlying processes and in turn to conceptualise their patients’ difficulties in a way that supplements existing knowledge. A functional analysis which integrates the association between sadness and worry does not need to conceptualise the individual as having two disorders, but can consider how, for the individual, this interaction is being fuelled and may be contributing to their distress.

The journey to develop models that provide both explanatory and predictive utility will lead to greater understanding of psychopathology [88]. While the analysis presented is primarily exploratory, it sets up clear testable hypotheses. These can be derived by examining the central structures within the network, formulating hypotheses and testing on an independent sample [89]. For instance, whether the bridge edges belonging to pessimism, sadness, and indecisiveness re-emerge in an independent sample or whether a discrete intervention targeting pessimism would alter the network structure and lead to improved outcome. These statistical methods may help inform how identifying pathways and targets may lead to improved treatments all dependent on better assessment of symptoms.

Strengths and limitations

This study has clear strengths, making use of a large sample of individuals participating in RCTs for depression in primary care. The use of same assessment measures at study entry removed the need to harmonise data across different measures for the network. While this is less true of outcomes where issues of measurement errors arise from the use of PROMIS T-Score, the sensitivity analyses provided confidence in the results.

The demographic balance across samples may affect generalisability; however, five of the six trials were pragmatic trials more closely representative of patient populations. Most cases of depression are treated in primary care, and the studies being set in primary care, improve the potential generalisability to patients seen in this setting [90].

This study was limited to the use of aggregate/group level findings to inform within person processes. However, the presence of an RCT outcome variable affords us the ability to detect changes from one state (e.g. depressed) to another (e.g. remitted), which is typically not the case with idiographic research studies that collect cross-sectional data. Exploring the prognostics value of networks on deterioration of symptoms would extend the utility of network analysis. This would however require generating idiographic networks, where reliable estimation necessitates many time points (low sensitivity at 100 time points [91].

The accuracy of the network is limited by the items included and those omitted. The network does not cover the breadth of comorbidity of symptoms across psychopathology and is missing other environmental variables. Social adversity is associated with worse treatment outcomes for some patients with depression; it can be important to assess for and address these issues in clinic, where possible, to mitigate the risks of poor prognoses [92]. There is also the possibility that the centrality of sadness particularly represents a strong association with a latent variable rather than a specific role within the network [93].

The network models adjusted for duration of depression and anxiety, and a sensitivity analysis assessed for the influence of between study variability, adding robustness to the findings. While RCTs are used in the analysis, treatment arms were not factored in and treated as equivalent when estimating outcome. This may make the findings generalizable where findings are applicable regardless of treatment offered especially as the treatments included reflect those commonly available in primary care. Controlling for treatment group within the outcome modelling and controlling for relevant covariates (e.g. age, gender and social economic status) would also have improved the robustness of the findings. Such adjustments would have been fitting where the emphasis was on developing the best predictive model, instead of comparing the predictive ability of symptoms vs. total scores. More comprehensive prediction modelling using the Dep-GP dataset has been conducted [94]. Additionally, our modelling did not include train/test split, as the whole sample was used in estimation of the network models. While a true out-of-sample ‘holdout’ dataset would have provided an unbiased evaluation of model fit, and is the preferred method for evaluating such models [95], the internal cross-fold validation employed in the symptom level model offers a layer of robustness supporting the final model estimates (where overfitting presents an issue). This study focussed on item-level analysis in comparison to sum-scores, future comparisons with models which may measure latent constructs in other ways, could be informative.

Single item symptom measurement will have unknown reliability and construct validity. Equally, the restricted range (e.g. a four-point scale) may not adequately capture the range of symptom variance occurring in the sample. Symptom measurement on a broader scale may improve the prediction of changes over time.

Conclusions

Our study used samples from high-quality randomised controlled trials, and the findings can be generalised to adults with depression being treated in primary care. This study has reiterated the importance of assessing for both depressive and anxious symptoms among adults seeking treatment for depression, and that valuable information about prognosis can be gained by understanding the interrelations between individual symptoms, information which is not available when considering sum scores or baseline symptom severity alone. This may be particularly important to longer term outcomes from treatment. Treatment selection and application is often hampered by comorbid symptoms and considered to introduce ‘complexity’ [96]. Considering the bidirectional relationship between symptoms and associations which may be mediated by another symptom (e.g. a bridge symptom) may help to consider comorbidity as normative.

While specific symptoms and associations have been highlighted, the aim is not to offer simple heuristics to inform clinical judgement and decision making. The relative importance of the highlighted associations should not be overweighed. The aim is not to identify individual items, but to consider the network of interactions. The critical role of individual symptoms and their interactions give rise to the activation of the network through pathways and anxiety and depressive cognitive and physical symptoms may activate one another via these pathways. This network highlights how symptoms of depression and anxiety disorders influence one another. Clinically, there is a need for treatments to adequately assess and address comorbidity.

Availability of data and materials

The data that support the findings of this study are available from the authors of the individual trial studies. Restrictions apply to the availability of these data, which were used under licence for the current study, and so are not publicly available.

Abbreviations

BDI-II:

Beck depression invention (2nd edition)

CIS-R:

Revised Clinical Interview Schedule

EBIC:

Extended Bayesian information criterion

EI:

Expected influence

ENR:

Elastic net regression

FGL:

Fused graphical lasso

GGM:

Gaussian graphical model

IPD:

Individual patient data

MAE:

Mean absolute error

PC:

Participation coefficient

PCA:

Principal component analysis

PHQ-9:

Patient Health Questionnaire 9

PR:

Participation ratio

RMSE:

Root mean squared error

References

  1. Arroll B, Chin WY, Martis W, Goodyear-Smith F, Mount V, Kingsford D, et al. Antidepressants for treatment of depression in primary care: a systematic review and meta-analysis. J Prim Health Care. 2016;8(4):325–34. https://0-doi-org.brum.beds.ac.uk/10.1071/HC16008.

    Article  PubMed  Google Scholar 

  2. Santoft F, Axelsson E, Öst LG, Hedman-Lagerlöf M, Fust J, Hedman-Lagerlöf E. Cognitive behaviour therapy for depression in primary care: systematic review and meta-analysis. Psychol Med. 2019;49(8):1266–74. https://0-doi-org.brum.beds.ac.uk/10.1017/S0033291718004208.

    Article  PubMed  Google Scholar 

  3. Cuijpers P, van Straten a, Bohlmeijer E, Hollon SD, Andersson G. The effects of psychotherapy for adult depression are overestimated: a meta-analysis of study quality and effect size. Psychol Med 2010;40(2):211–223, doi: https://0-doi-org.brum.beds.ac.uk/10.1017/S0033291709006114.

  4. Eronen MI. Causal discovery and the problem of psychological interventions. New Ideas Psychol. 2020;59:100785. https://0-doi-org.brum.beds.ac.uk/10.1016/j.newideapsych.2020.100785.

    Article  Google Scholar 

  5. Fried EI, Epskamp S, Nesse RM, Tuerlinckx F, Borsboom D. What are “good” depression symptoms? Comparing the centrality of DSM and non-DSM symptoms of depression in a network analysis. J Affect Disord. 2016;189:314–20. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jad.2015.09.005.

    Article  PubMed  Google Scholar 

  6. Cuijpers P, Reynolds CF, Donker T, Li J, Andersson G, Beekman A. Personalized treatment of adult depression: medication, psychotherapy, or both? A systematic review. Depress Anxiety. 2012;29(10):855–64. https://0-doi-org.brum.beds.ac.uk/10.1002/da.21985.

    Article  PubMed  Google Scholar 

  7. Hardeveld F, Spijker J, De Graaf R, Nolen WA, Beekman ATF. Recurrence of major depressive disorder and its predictors in the general population: results from The Netherlands Mental Health Survey and Incidence Study (NEMESIS). Psychol Med. 2013;43(1):39–48. https://0-doi-org.brum.beds.ac.uk/10.1017/S0033291712002395.

    Article  CAS  PubMed  Google Scholar 

  8. Simon GE, Perlis RH. Personalized medicine for depression: can we match patients with treatments? Am J Psychiatry. 2010;167(12):1445–55 Available from: http://psychiatryonline.org/doi/abs/10.1176/appi.ajp.2010.09111680.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Cummings CM, Caporino NE, Kendall PC. Comorbidity of anxiety and depression in children and adolescents: 20 years after. Psychol Bull. 2014;140(3):816–45 Available from: http://doi.apa.org/getdoi.cfm?doi=10.1037/a0034733.

    Article  PubMed  Google Scholar 

  10. Brown TA, Barlow DH. A proposal for a dimensional classification system based on the shared features of the DSM-IV anxiety and mood disorders: implications for assessment and treatment. Psychol Assess. 2009;21(3):256–71. https://0-doi-org.brum.beds.ac.uk/10.1037/a0016608.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Kessler RC, Ormel J, Petukhova M, McLaughlin KA, Green JG, Russo LJ, et al. Development of lifetime comorbidity in the World Health Organization world mental health surveys. Arch Gen Psychiatry. 2011;68(1):90–100. https://0-doi-org.brum.beds.ac.uk/10.1001/archgenpsychiatry.2010.180.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Kendler KS. What psychiatric genetics has taught us about the nature of psychiatric illness and what is left to learn. Mol Psychiatry. 2013;18(10):1058–66. https://0-doi-org.brum.beds.ac.uk/10.1038/mp.2013.50.

    Article  CAS  PubMed  Google Scholar 

  13. Wichers M. The dynamic nature of depression: a new micro-level perspective of mental disorder that meets current challenges. Psychol Med. 2014;44(7):1349–60. https://0-doi-org.brum.beds.ac.uk/10.1017/S0033291713001979.

    Article  CAS  Google Scholar 

  14. Fried EI, Nesse RM. Depression is not a consistent syndrome: an investigation of unique symptom patterns in the STAR*D study. J Affect Disord. 2015;172:96–102. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jad.2014.10.010.

    Article  Google Scholar 

  15. Fried EI. The 52 symptoms of major depression: lack of content overlap among seven common depression scales. J Affect Disord. 2017;208:191–7. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jad.2016.10.019.

    Article  Google Scholar 

  16. Bekhuis E, Schoevers R, De Boer M, Peen J, Dekker J, Ven H, et al. Symptom-specific effects of psychotherapy versus combined therapy in the treatment of mild to moderate depression: a network approach. Psychother Psychosom. 2018;87(2):121–3. https://0-doi-org.brum.beds.ac.uk/10.1159/000486793.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Boschloo L, Cuijpers P, Karyotaki E, Berger T, Moritz S, Meyer B, et al. Symptom-specific effectiveness of an internet-based intervention in the treatment of mild to moderate depressive symptomatology: the potential of network estimation techniques. Behav Res Ther. 2019;122:103440 Available from: https://0-linkinghub-elsevier-com.brum.beds.ac.uk/retrieve/pii/S0005796719301263.

    Article  PubMed  Google Scholar 

  18. Fried EI, Nesse RM. The impact of individual depressive symptoms on impairment of psychosocial functioning. Gong Q, editor. Plos One. 2014 9(2):e90311.

  19. Fried E, von Stockert S, Haslbeck JMB, Lamers F, Schoevers RA, Penninx BWJH. Using network analysis to examine links between individual depressive symptoms, inflammatory markers, and covariates. Psychol Med 2019;1–9. Available from: https://0-www-cambridge-org.brum.beds.ac.uk/core/product/identifier/S0033291719002770/type/journal_article

  20. Gollan JK, Fava M, Kurian B, Wisniewski SR, Rush AJ, Daly E, et al. What are the clinical implications of new onset or worsening anxiety during the first two weeks of SSRI treatment for depression? Depress Anxiety. 2012;29(2):94–101. https://0-doi-org.brum.beds.ac.uk/10.1002/da.20917.

    Article  PubMed  Google Scholar 

  21. Buckman JEJ, Underwood A, Clarke K, Saunders R, Hollon SD, Fearon P, et al. Risk factors for relapse and recurrence of depression in adults and how they operate: a four-phase systematic review and meta-synthesis. Clin Psychol Rev. 2018;64(7):13–38. https://0-doi-org.brum.beds.ac.uk/10.1016/j.cpr.2018.07.005.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  22. Judd LL. The role of residual subthreshold depressive symptoms in early episode relapse in unipolar major depressive disorder. Arch Gen Psychiatry. 1999;56(8):764–5. https://0-doi-org.brum.beds.ac.uk/10.1001/archpsyc.56.8.763.

    Article  CAS  PubMed  Google Scholar 

  23. Webb CA, Cohen ZD, Beard C, Forgeard M, Peckham AD, Björgvinsson T. Personalized prognostic prediction of treatment outcome for depressed patients in a naturalistic psychiatric hospital setting: a comparison of machine learning approaches. J Consult Clin Psychol. 2020;88(1):25–38 Available from: https://doi.apa.org/getdoi.cfm?doi=10.1037/ccp0000451.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Fried EI, Nesse RM. Depression sum-scores don’t add up: why analyzing specific depression symptoms is essential. BMC Med. 2015;13(1):72. https://0-doi-org.brum.beds.ac.uk/10.1186/s12916-015-0325-4.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Fried E. Moving forward: how depression heterogeneity hinders progress in treatment and research. Expert Rev Neurother. 2017;17(5):423–5 Available from: https://0-doi-org.brum.beds.ac.uk/10.1080/14737175.2017.1307737.

    Article  CAS  PubMed  Google Scholar 

  26. Dwyer DB, Falkai P, Koutsouleris N. Machine learning approaches for clinical psychology and psychiatry. Annu Rev Clin Psychol. 2018;14(1):91–118. https://0-doi-org.brum.beds.ac.uk/10.1146/annurev-clinpsy-032816-045037.

    Article  PubMed  Google Scholar 

  27. DeRubeis RJ, Cohen ZD, Forand NR, Fournier JC, Gelfand LA, Lorenzo-Luaces L. The personalized advantage index: translating research on prediction into individualized treatment recommendations. A demonstration. PLoS One. 2014;9(1):1–8.

    Article  Google Scholar 

  28. Fernandez KC, Fisher AJ, Chi C. Development and initial implementation of the dynamic assessment treatment algorithm (DATA). PLoS One. 2017;12(6):1–16.

    Article  Google Scholar 

  29. Borsboom D. A network theory of mental disorders. World Psychiatry. 2017;16(1):5–13. https://0-doi-org.brum.beds.ac.uk/10.1002/wps.20375.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Heeren A, Bernstein EE, McNally RJ. Deconstructing trait anxiety: a network perspective. Anxiety Stress Coping. 2018;31(3):262–76. https://0-doi-org.brum.beds.ac.uk/10.1080/10615806.2018.1439263.

    Article  PubMed  Google Scholar 

  31. Cramer AOJ, Waldorp LJ, van der Maas HLJ, Borsboom D. Comorbidity: a network perspective. Behav Brain Sci. 2010;33(2–3):137–50. https://0-doi-org.brum.beds.ac.uk/10.1017/S0140525X09991567.

    Article  PubMed  Google Scholar 

  32. Beard C, Millner AJ, Forgeard MJC, Fried EI, Hsu KJ, Treadway MT, et al. Network analysis of depression and anxiety symptom relationships in a psychiatric sample. Psychol Med. 2016;46(16):3359–69. https://0-doi-org.brum.beds.ac.uk/10.1017/S0033291716002300.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  33. Boschloo L, van Borkulo CD, Borsboom D, Schoevers RA. A prospective study on how symptoms in a network predict the onset of depression. Psychother Psychosom. 2016;85(3):183–4. https://0-doi-org.brum.beds.ac.uk/10.1159/000442001.

    Article  PubMed  Google Scholar 

  34. Kendler KS, Campbell J. Interventionist causal models in psychiatry: repositioning the mind–body problem. Psychol Med. 2009;39(6):881–7. https://0-doi-org.brum.beds.ac.uk/10.1017/S0033291708004467.

    Article  CAS  PubMed  Google Scholar 

  35. Newson JJ, Hunter D, Thiagarajan TC. The heterogeneity of mental health assessment. Front Psychiatry. 2020;11(February):1–24.

    Google Scholar 

  36. Buckman JEJ, Saunders R, Cohen ZD, Clarke K, Ambler G, DeRubeis RJ, et al. What factors indicate prognosis for adults with depression in primary care? A protocol for meta-analyses of individual patient data using the Dep-GP database. Wellcome Open Res. 2020;4:69 Available from: https://wellcomeopenresearch.org/articles/4-69/v3.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Beck AT, Steer RA, Brown GK. Beck depression inventory-II. San Antonio. 1996;78(2):490–8.

    Google Scholar 

  38. Thomas LJ, Abel A, Ridgway N, Peters T, Kessler D, Hollinghurst S, et al. Cognitive behavioural therapy as an adjunct to pharmacotherapy for treatment resistant depression in primary care: the CoBalT randomised controlled trial protocol. Contemp Clin Trials. 2012;33(2):312–9 Available from: https://0-doi-org.brum.beds.ac.uk/10.1016/j.cct.2011.10.016.

    Article  PubMed  Google Scholar 

  39. Lewis G, Mulligan J, Wiles N, Cowen P, Craddock N, Ikeda M, et al. Polymorphism of the 5-HT transporter and response to antidepressants: randomised controlled trial. Br J Psychiatry. 2011;198(6):464–71. https://0-doi-org.brum.beds.ac.uk/10.1192/bjp.bp.110.082727.

    Article  PubMed  Google Scholar 

  40. Lewis G, Duffy L, Ades A, Amos R, Araya R, Brabyn S, et al. The clinical effectiveness of sertraline in primary care and the role of depression severity and duration (PANDA): a pragmatic, double-blind, placebo-controlled randomised trial. Lancet Psychiatry. 2019;6(11):903–14. https://0-doi-org.brum.beds.ac.uk/10.1016/S2215-0366(19)30366-9.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Chalder M, Wiles NJ, Campbell J, Hollinghurst SP, Haase AM, Taylor AH, et al. Facilitated physical activity as a treatment for depressed adults: randomised controlled trial. BMJ. 2012;344:e2758–e2758. https://0-doi-org.brum.beds.ac.uk/10.1136/bmj.e2758.

  42. Kessler DS, MacNeill SJ, Tallon D, Lewis G, Peters TJ, Hollingworth W, et al. Mirtazapine added to SSRIs or SNRIs for treatment resistant depression in primary care: phase III randomised placebo controlled trial (MIR). BMJ. 2018:k4218 Available from: http://0-www-bmj-com.brum.beds.ac.uk/lookup/doi/10.1136/bmj.k4218.

  43. Kessler D, Lewis G, Kaur S, Wiles N, King M, Weich S, et al. Therapist-delivered internet psychotherapy for depression in primary care: a randomised controlled trial. Lancet. 2009;374(9690):628–34. https://0-doi-org.brum.beds.ac.uk/10.1016/S0140-6736(09)61257-5.

    Article  PubMed  Google Scholar 

  44. Lewis G, Pelosi AJ, Araya R, Dunn G. Measuring psychiatric disorder in the community: a standardized assessment for use by lay interviewers. Psychol Med. 1992;22(02):465 Available from: http://www.journals.cambridge.org/abstract_S0033291700030415.

    Article  CAS  PubMed  Google Scholar 

  45. Buckman JEJ, Saunders R, Cohen ZD, Barnett P, Clarke K, Ambler G, et al. The contribution of depressive ‘disorder characteristics’ to determinations of prognosis for adults with depression: an individual patient data meta-analysis. Psychological Medicine. 2021. Available from: https://www.ssrn.com/abstract=3520082.

  46. Choi SW, Schalet B, Cook KF, Cella D. Establishing a common metric for depressive symptoms: linking the BDI-II, CES-D, and PHQ-9 to PROMIS Depression. Psychol Assess. 2014;26(2):513–27 Available from: http://doi.apa.org/getdoi.cfm?doi=10.1037/a0035768.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Fischer HF, Rose M. Www.common-metrics.org: a web application to estimate scores from different patient-reported outcome measures on a common scale. BMC Med Res Methodol. 2016;16(1):1–5 Available from: https://0-doi-org.brum.beds.ac.uk/10.1186/s12874-016-0241-0.

    Article  Google Scholar 

  48. R Core Team. R: a language and environment for statistical computing. Vienna: R Foundation for statistical Computing; 2017. Available from: https://www.r-project.org

    Google Scholar 

  49. StataCorp. Stata Statistical Software: Release 16. College Station: StataCorp LLC; 2019.

    Google Scholar 

  50. Fried EI, Cramer AOJ. Moving forward: challenges and directions for psychopathological network theory and methodology. Perspect Psychol Sci. 2017;12(6):999–1020 Available from: http://0-journals-sagepub-com.brum.beds.ac.uk/doi/10.1177/1745691617705892.

    Article  PubMed  Google Scholar 

  51. Jones PJ. Networktools: Tools for identifying important no des in networks. R Package version. 2018;1(0):10–115.

  52. Terluin B, De Boer MR, De Vet HCW. Differences in connection strength between mental symptoms might be explained by differences in variance: reanalysis of network data did not confirm staging. PLoS One 2016;11(11):1–12, e0155205, doi: https://0-doi-org.brum.beds.ac.uk/10.1371/journal.pone.0155205.

  53. Friedman J, Hastie T, Tibshirani R. Regularization paths for generalized linear models via coordinate descent. J Stat Softw. 2010;33(1):1–22.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Lundberg SM, Lee S-I. A Unified Approach to Interpreting Model Predictions. In: Advances in Neural Information Processing Systems 30; 2017. p. 4765–74.

    Google Scholar 

  55. Molnar C. Interpretable Machine Learning: A Guide for Making Black Box Models Explainable. Leanpub; 2019. https://christophm.github.io/interpretable-ml-book/.

  56. van Borkulo CD, Boschloo L, Kossakowski JJ, Tio P, Schoevers RA, Borsboom D, et al. Comparing network structures on three aspects: A permutation test. Manuscr Submitt. 2017:34. https://0-doi-org.brum.beds.ac.uk/10.13140/RG.2.2.29455.38569.

  57. Tibshirani R. Regression shrinkage and selection via the lasso. J R Stat Soc Ser B. 2016;58:267–88.

    Google Scholar 

  58. Epskamp S, Cramer AOJ, Waldorp LJ, Schmittmann VD, Borsboom D. qgraph : network visualizations of relationships in psychometric data. J Stat Softw. 2012;48(4) Available from: http://www.jstatsoft.org/v48/i04/.

  59. Williams DR, Rast P. Back to the basics: rethinking partial correlation network methodology. Br J Math Stat Psychol. 2020;73(2):187–212. https://0-doi-org.brum.beds.ac.uk/10.1111/bmsp.12173.

    Article  PubMed  Google Scholar 

  60. Foygel R, Drton M. Extended Bayesian information criteria for Gaussian graphical models. Adv Neural Inf Process Syst. 2010:604–12.

  61. Lorenzo-Luaces L, Rodriguez-Quintana N, Bailey AJ. Double trouble: do depression severity and duration interact to predicting treatment outcomes in adolescent depression? Behav Res Ther. 2020;131:103637. https://0-doi-org.brum.beds.ac.uk/10.1016/j.brat.2020.103637.

  62. Costantini G, Richetin J, Preti E, Casini E, Epskamp S, Perugini M. Stability and variability of personality networks. A tutorial on recent developments in network psychometrics. Pers Individ Dif. 2019;136:68–78 Available from: https://0-doi-org.brum.beds.ac.uk/10.1016/j.paid.2017.06.011.

    Article  Google Scholar 

  63. Fried EI, Eidhof MB, Palic S, Costantini G, Huisman-van Dijk HM, Bockting CLH, et al. Replicability and generalizability of posttraumatic stress disorder (PTSD) networks: a cross-cultural multisite study of PTSD symptoms in four trauma patient samples. Clin Psychol Sci. 2018;6(3):335–51 Available from: http://0-journals-sagepub-com.brum.beds.ac.uk/doi/10.1177/2167702617745092.

    Article  PubMed  PubMed Central  Google Scholar 

  64. Epskamp S, Borsboom D, Fried EI. Estimating psychological networks and their accuracy: a tutorial paper. Behav Res Methods. 2018;50(1):195–212 Available from: http://0-link-springer-com.brum.beds.ac.uk/10.3758/s13428-017-0862-1.

    Article  PubMed  Google Scholar 

  65. Golino H, Shi D, Christensen AP, Garrido LE, Nieto MD, Sadana R, et al. Investigating the performance of exploratory graph analysis and traditional techniques to identify the number of latent factors: a simulation and tutorial. Psychol Methods. 2020; Available from: http://doi.apa.org/getdoi.cfm?doi=10.1037/met0000255.

  66. Borsboom D, Cramer AOJ. Network analysis: an integrative approach to the structure of psychopathology. Annu Rev Clin Psychol. 2013;9(1):91–121 Available from: http://0-www-annualreviews-org.brum.beds.ac.uk/doi/10.1146/annurev-clinpsy-050212-185608.

    Article  PubMed  Google Scholar 

  67. Bringmann LF, Elmer T, Epskamp S, Krause RW, Schoch D, Wichers M, et al. What do centrality measures measure in psychological networks? J Abnorm Psychol. 2019;128(8):892–903 Available from: http://doi.apa.org/getdoi.cfm?doi=10.1037/abn0000446.

    Article  PubMed  Google Scholar 

  68. Robinaugh DJ, LeBlanc NJ, Vuletich HA, McNally RJ. Network analysis of persistent complex bereavement disorder in conjugally bereaved adults. J Abnorm Psychol. 2014;123(3):510–22 Available from: http://doi.apa.org/getdoi.cfm?doi=10.1037/abn0000002.

    Article  PubMed  PubMed Central  Google Scholar 

  69. Jones P, Ma R, McNally RJ. Bridge centrality: a network approach to understanding comorbidity. Multivariate Behav Res. 2019;0(0):1–15 Available from: https://0-doi-org.brum.beds.ac.uk/10.1080/00273171.2019.1614898.

    Article  Google Scholar 

  70. Letina S, Blanken TF, Deserno MK, Borsboom D. Expanding network analysis tools in psychological networks: minimal spanning trees, participation coefficients, and motif analysis applied to a network of 26 psychological attributes. Complexity. 2019;2019:1–27. https://0-doi-org.brum.beds.ac.uk/10.1155/2019/9424605.

    Article  Google Scholar 

  71. Elliott H, Jones PJ, Schmidt U. Central symptoms predict posttreatment outcomes and clinical impairment in anorexia nervosa: a network analysis. Clin Psychol Sci. 2020;8(1):139–54. https://0-doi-org.brum.beds.ac.uk/10.1177/2167702619865958.

    Article  Google Scholar 

  72. Rodebaugh TL, Tonge NA, Piccirillo ML, Fried E, Horenstein A, Morrison AS, et al. Does centrality in a cross-sectional network suggest intervention targets for social anxiety disorder? J Consult Clin Psychol. 2018;86(10):831–44 Available from: http://doi.apa.org/getdoi.cfm?doi=10.1037/ccp0000336.

    Article  PubMed  PubMed Central  Google Scholar 

  73. Spiller TR, Levi O, Neria Y, Suarez-Jimenez B, Bar-Haim Y, Lazarov A. On the validity of the centrality hypothesis in cross-sectional between-subject networks of psychopathology. BMC Med. 2020;18(1):1–14.

    Article  Google Scholar 

  74. Dickson JM, Moberly NJ, O’Dea C, Field M. Goal fluency, pessimism and disengagement in depression. PLoS One. 2016;11(11):1–11. https://0-doi-org.brum.beds.ac.uk/10.1371/journal.pone.0166259.

    Article  CAS  Google Scholar 

  75. MacLeod AK, Williams JM, Bekerian DA. Worry is reasonable: the role of explanations in pessimism about future personal events. J Abnorm Psychol. 1991;100(4):478–86 Available from: http://doi.apa.org/getdoi.cfm?doi=10.1037/0021-843X.100.4.478.

    Article  CAS  PubMed  Google Scholar 

  76. Price M, Legrand AC, Brier ZMF, Hébert-Dufresne L. The symptoms at the center: examining the comorbidity of posttraumatic stress disorder, generalized anxiety disorder, and depression with network analysis. J Psychiatr Res. 2019;109(June 2018):52–8 Available from: https://0-doi-org.brum.beds.ac.uk/10.1016/j.jpsychires.2018.11.016.

    Article  PubMed  Google Scholar 

  77. Van Borkulo C, Boschloo L, Borsboom D, Penninx BWJH, Lourens JW, Schoevers RA. Association of symptom network structure with the course of longitudinal depression. JAMA Psychiatry. 2015;72(12):1219–26. https://0-doi-org.brum.beds.ac.uk/10.1001/jamapsychiatry.2015.2079.

    Article  PubMed  Google Scholar 

  78. Schweren L, Van Borkulo CD, Fried E, Goodyer IM. Assessment of symptom network density as a prognostic marker of treatment response in adolescent depression. JAMA Psychiatry. 2018;75(1):98–100. https://0-doi-org.brum.beds.ac.uk/10.1001/jamapsychiatry.2017.3561.

    Article  PubMed  Google Scholar 

  79. Robinaugh DJ, Millner AJ, McNally RJ. Identifying highly influential nodes in the complicated grief network. J Abnorm Psychol. 2016;125(6):747–57 Available from: http://doi.apa.org/getdoi.cfm?doi=10.1037/abn0000181.

    Article  PubMed  PubMed Central  Google Scholar 

  80. Papini S, Rubin M, Telch MJ, Smits JAJ, Hien DA. Pretreatment posttraumatic stress disorder symptom network metrics predict the strength of the association between node change and network change during treatment. J Trauma Stress. 2020;33(1):64–71. https://0-doi-org.brum.beds.ac.uk/10.1002/jts.22379.

    Article  PubMed  Google Scholar 

  81. Fried EI. Lack of theory building and testing impedes progress in the factor and network literature. Psychol Inq. 2020;31:271–88. https://0-doi-org.brum.beds.ac.uk/10.1080/1047840X.2020.1853461.

  82. Law KC, Tucker RP. Repetitive negative thinking and suicide: a burgeoning literature with need for further exploration. Curr Opin Psychol. 2018;22:68–72 Available from: https://0-doi-org.brum.beds.ac.uk/10.1016/j.copsyc.2017.08.027.

    Article  PubMed  Google Scholar 

  83. Ducasse D, Loas G, Dassa D, Gramaglia C, Zeppegno P, Guillaume S, et al. Anhedonia is associated with suicidal ideation independently of depression: a meta-analysis. Depress Anxiety. 2018;35(5):382–92. https://0-doi-org.brum.beds.ac.uk/10.1002/da.22709.

    Article  PubMed  Google Scholar 

  84. Beck AT. Depression: clinical, experimental, and theoretical aspects. New York (Hoeber); 1967.

  85. Roth A, Fonagy P. What works for whom?: a critical review of psychotherapy research. 2nd Edition. New York: Guilford Press; 2006.

  86. Barlow DH, Allen LB, Choate ML. Toward a unified treatment for emotional disorders – republished article. Behav Ther. 2016;47(6):838–53 Available from: https://0-doi-org.brum.beds.ac.uk/10.1016/j.beth.2016.11.005.

    Article  PubMed  Google Scholar 

  87. Hvenegaard M, Moeller SB, Poulsen S, Gondan M, Grafton B, Austin SF, et al. Group rumination-focused cognitive-behavioural therapy (CBT) v. group CBT for depression: phase II trial. Psychol Med. 2020;50(1):11–9 Available from: https://www.taylorfrancis.com/books/9781000102147/chapters/10.4324/9781003076391-177.

    Article  PubMed  Google Scholar 

  88. Yarkoni T, Westfall J. Choosing prediction over explanation in psychology: lessons from machine learning. Perspect Psychol Sci. 2017;12(6):1100–22. https://0-doi-org.brum.beds.ac.uk/10.1177/1745691617693393.

    Article  PubMed  PubMed Central  Google Scholar 

  89. Williams DR, Rast P, Pericchi LR, Mulder J. Comparing Gaussian graphical models with the posterior predictive distribution and Bayesian model selection. Psychol Methods. 2020;25(5):653–72 Available from: http://doi.apa.org/getdoi.cfm?doi=10.1037/met0000254.

    Article  PubMed  Google Scholar 

  90. McManus S, Bebbington P, Jenkins R, Brugha T. Mental health and wellbeing in England: Adult Psychiatric Morbidity Survey 2014. Leeds: NHS Digital; 2016.

  91. Mansueto AC, Wiers R, van Weert J, Schouten BC, Epskamp S. Investigating the feasibility of idiographic network models; 2020.

    Google Scholar 

  92. Buckman JEJ, Saunders R, O’Driscoll C, Cohen ZD, Stott J, Ambler G, et al. Is social support pre-treatment associated with prognosis for adults with depression in primary care? Acta Psychiatr Scand. 2021:acps.13285 Available from: https://0-onlinelibrary-wiley-com.brum.beds.ac.uk/doi/10.1111/acps.13285.

  93. Hallquist MN, Wright AGC, Molenaar PCM. Problems with centrality measures in psychopathology symptom networks: why network psychometrics cannot escape psychometric theory. Multivariate Behav Res. 2019;0(0):1–25 Available from: https://0-doi-org.brum.beds.ac.uk/10.1080/00273171.2019.1640103.

    Article  Google Scholar 

  94. Buckman JEJ, Cohen ZD, O’Driscoll C, Fried EI, Saunders R, Ambler G. . ., et al. Predicting prognosis for adults with depression using individual symptom data: a comparison of modelling approaches. 2020; Available from: https://0-doi-org.brum.beds.ac.uk/10.31219/osf.io/xkwdc

    Google Scholar 

  95. Steyerberg EW, Harrell FE. Prediction models need appropriate internal, internal–external, and external validation. J Clin Epidemiol. 2016;69(1):245–7. Available from: https://0-linkinghub-elsevier-com.brum.beds.ac.uk/retrieve/pii/S0895435615001754. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jclinepi.2015.04.005.

    Article  PubMed  Google Scholar 

  96. Kuyken W, Tsivrikos D. Therapist competence, comorbidity and cognitive-behavioral therapy for depression. Psychother Psychosom. 2008;78(1):42–8. https://0-doi-org.brum.beds.ac.uk/10.1159/000172619.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Not applicable

Funding

This work was supported by the Wellcome Trust through a Clinical Research Fellowship to JEJB (201292/Z/16/Z), MQ Foundation (for ZDC: MQDS16/72), the Higher Education Funding Council for England, the National Institute of Health Research (NIHR), NIHR University College London Hospitals Biomedical Research Centre (RS and SP), NIHR Biomedical Research Centre at the University Hospitals Bristol and Weston NHS Foundation Trust and the University of Bristol (NW and DK), University College London (GA, GL), University of Pennsylvania (RDR), Vanderbilt University (SDH), University of Southampton (TK), University of Exeter (EW), and University of York (SG). The views expressed are those of the authors and not necessarily those of the NIHR or the Department of Health and Social Care.

The included studies that make up the Dep-GP IPD database were funded by:

1. COBALT: The National Institute for Health Research Health Technology Assessment (NIHR HTA) programme (project number 06/404/02).

2. GENPOD: Medical Research Council and supported by the Mental Health Research Network.

3. IPCRESS: BUPA Foundation.

4. MIR: National Institute for Health Research (NIHR) Health Technology Assessment (HTA) programme (project 11/129/76) and supported by the NIHR Biomedical Research Centre at University Hospitals Bristol NHS Foundation Trust and the University of Bristol.

5. PANDA: NIHR Programme Grant for Applied Research (RP-PG-0610-10048).

6. TREAD: National Institute for Health Research (NIHR) Health Technology Assessment (HTA) programme.

The funders of the study had no role in study design, data collection, data analysis, data interpretation, or writing of the report. All authors were fully independent of their respective funders and had responsibility for the decision to submit for this manuscript for publication. The guarantor accepts full responsibility for the work and the conduct of the study, had access to the data, and controlled the decision to publish.

Author information

Authors and Affiliations

  1. Centre for Outcomes Research and Effectiveness (CORE), Research Department of Clinical, Educational & Health Psychology, University College London, 1-19 Torrington Place, London, WC1E 7HB, UK

    C. O’Driscoll, J. E. J. Buckman, R. Saunders & S. Pilling

  2. iCope – Camden & Islington Psychological Therapies Services, Camden & Islington NHS Foundation Trust, St Pancras Hospital, London, NW1 0PE, UK

    J. E. J. Buckman

  3. Department of Clinical Psychology, Leiden University, Leiden, The Netherlands

    E. I. Fried

  4. Department of Psychiatry, University of California, Los Angeles, Los Angeles, CA, USA

    Z. D. Cohen

  5. Statistical Science, University College London, 1-19 Torrington Place, London, WC1E 7HB, UK

    G. Ambler

  6. School of Arts and Sciences, Department of Psychology, 425 S. University Avenue, Philadelphia, PA, 19104-60185, USA

    R. J. DeRubeis

  7. Department of Health Sciences, University of York, Seebohm Rowntree Building, Heslington, York, YO10 5DD, UK

    S. Gilbody

  8. Department of Psychology, Vanderbilt University, Nashville, TN, USA

    S. D. Hollon

  9. Primary Care, Population Sciences and Medical Education, Faculty of Medicine, University of Southampton, Aldermoor Health Centre, Southampton, SO16 5ST, UK

    T. Kendrick

  10. Centre for Academic Primary Care, Population Health Sciences, Bristol Medical School, University of Bristol, Canynge Hall, Bristol, UK

    D. Kessler

  11. Division of Psychiatry, University College London, Maple House, London, W1T 7NF, UK

    G. Lewis

  12. Department of Psychology, University of Exeter, Sir Henry Wellcome Building for Mood Disorders Research, Perry Road, Exeter, EX4 4QG, UK

    E. Watkins

  13. Centre for Academic Mental Health, Population Health Sciences, Bristol Medical School, University of Bristol, Oakfield House, Bristol, UK

    N. Wiles

  14. Camden & Islington NHS Foundation Trust, St Pancras Hospital, 4 St Pancras Way, London, NW1 0PE, UK

    S. Pilling

Authors
  1. C. O’Driscoll
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. J. E. J. Buckman
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. E. I. Fried
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. R. Saunders
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Z. D. Cohen
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. G. Ambler
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. R. J. DeRubeis
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. S. Gilbody
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. S. D. Hollon
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. T. Kendrick
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. D. Kessler
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. G. Lewis
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. E. Watkins
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. N. Wiles
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. S. Pilling
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Conceptualization (CO’D, JB, EF, RS), data curation (JB), statistical analysis (CO’D, JB), draft preparation (CO’D), review and editing (JB, EF, RS, ZC, GA, RD, SG, SH, TK, DK, GL, EW, NW, SP). All authors contributed to and approved the final manuscript.

Corresponding authors

Correspondence to C. O’Driscoll or J. E. J. Buckman.

Ethics declarations

Ethics approval and consent to participate

Not applicable

Consent for publication

Not applicable

Competing interests

Not applicable

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

O’Driscoll, C., Buckman, J.E.J., Fried, E.I. et al. The importance of transdiagnostic symptom level assessment to understanding prognosis for depressed adults: analysis of data from six randomised control trials. BMC Med 19, 109 (2021). https://0-doi-org.brum.beds.ac.uk/10.1186/s12916-021-01971-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12916-021-01971-0

Keywords

BMC Medicine

ISSN: 1741-7015

Contact us