You are here

  • Home
  • Archive
  • Volume 2, Issue 6
  • Large-scale international validation of the ADO index in subjects with COPD: an individual subject data analysis of 10 cohorts

Article Text

Article menu
XML
Epidemiology
Research
Large-scale international validation of the ADO index in subjects with COPD: an individual subject data analysis of 10 cohorts
  1. Milo A Puhan1,2,
  2. Nadia N Hansel3,
  3. Patricia Sobradillo4,
  4. Paul Enright5,
  5. Peter Lange6,
  6. DeMarc Hickson7,8,
  7. Ana M Menezes9,
  8. Gerben ter Riet10,
  9. Ulrike Held2,
  10. Antonia Domingo-Salvany11,15,
  11. Zab Mosenifar12,
  12. Josep M Antó11,13,14,15,
  13. Karel G M Moons16,
  14. Alphons Kessels17,
  15. Judith Garcia-Aymerich11,13,14,15,
  16. for the International COPD Cohorts Collaboration Working Group
  1. 1Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, USA
  2. 2Horten Centre, University of Zurich, Zurich, Switzerland
  3. 3Division of Pulmonary & Critical Care Medicine, Johns Hopkins School of Medicine, Baltimore, Maryland, USA
  4. 4CIBER Enfermedades Respiratorias (CIBERES), Fundación Caubet-Cimera, Mallorca, Spain
  5. 5College of Public Health, The University of Arizona, Tucson, Arizona, USA
  6. 6Pulmonary Division, Hvidovre Hospital, Hvidovre, Danmark
  7. 7Jackson Heart Study, Coordinating Center, Jackson State University, Jackson, Mississippi, USA
  8. 8Department of Medicine, University of Mississippi Medical Center, Jackson, Mississippi, USA
  9. 9Federal University of Pelotas, Pelotas, Brazil
  10. 10Department of General Practice, Academic Medical Centre, University of Amsterdam, Amsterdam, The Netherlands
  11. 11Hospital del Mar Research Institute (IMIM), Barcelona, Spain
  12. 12Cedars Sinai Medical Center, David Geffen School of Medicine at UCLA, Los Angeles, California, USA
  13. 13Center for Research in Environmental Epidemiology (CREAL), Barcelona, Spain
  14. 14Universitat Pompeu Fabra, Barcelona, Spain
  15. 15CIBER de Epidemiologia y Salud Pública (CIBERESP), Barcelona, Spain
  16. 16Department of Epidemiology, Julius Centre for Health Sciences and General Practice, University Medical Center, Utrecht, The Netherlands
  17. 17Clinical Epidemiology, and Medical Technology Assessment, University Hospital Maastricht, Maastricht, The Netherlands
  1. Correspondence to Dr Judith Garcia-Aymerich; jgarcia{at}creal.cat

Abstract

Background Little evidence on the validity of simple and widely applicable tools to predict mortality in patients with chronic obstructive pulmonary disease (COPD) exists.

Objective To conduct a large international study to validate the ADO index that uses age, dyspnoea and FEV1 to predict 3-year mortality and to update it in order to make prediction of mortality in COPD patients as generalisable as possible.

Design Individual subject data analysis of 10 European and American cohorts (n=13 914).

Setting Population-based, primary, secondary and tertiary care.

Patients COPD GOLD stages I–IV.

Measurements We validated the original ADO index. We then obtained an updated ADO index in half of our cohorts to improve its predictive accuracy, which in turn was validated comprehensively in the remaining cohorts using discrimination, calibration and decision curve analysis and a number of sensitivity analyses.

Results 1350 (9.7%) of all subjects with COPD (60% male, mean age 61 years, mean FEV1 66% predicted) had died at 3 years. The original ADO index showed high discrimination but poor calibration (p<0.001 for difference between predicted and observed risk). The updated ADO index (scores from 0 to 14) preserved excellent discrimination (area under curve 0.81, 95% CI 0.80 to 0.82) but showed much improved calibration with predicted 3-year risks from 0.7% (95% CI 0.6% to 0.9%, score of 0) to 64.5% (61.2% to 67.7%, score of 14). The ADO index showed higher net benefit in subjects at low-to-moderate risk of 3-year mortality than FEV1 alone.

Interpretation The updated 15-point ADO index accurately predicts 3-year mortality across the COPD severity spectrum and can be used to inform patients about their prognosis, clinical trial study design or benefit harm assessment of medical interventions.

  • Pulmonary Disease, Chronic Obstructive
  • Mortality
  • Prognosis
  • Validation Studies

This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits use, distribution, and reproduction in any medium, provided the original work is properly cited, the use is non commercial and is otherwise in compliance with the license. See: http://creativecommons.org/licenses/by-nc/2.0/ and http://creativecommons.org/licenses/by-nc/2.0/legalcode.

https://doi.org/10.1136/bmjopen-2012-002152

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    Article summary

    Article focus

    • We aimed to conduct a large international study to validate the ADO index that uses age, dyspnoea and FEV1 to predict 3-year mortality and to update it in order to make prediction of mortality in chronic obstructive pulmonary disease (COPD) patients as generalisable as possible.

    Key messages

    • The updated 15-point ADO index accurately predicts 3-year mortality across the COPD severity spectrum (GOLD stage I–IV), settings (general population, primary care and specialised care) and geographical area.

    • The updated ADO index can be used to inform patients, clinical trial study design and benefit harm assessment of medical interventions on a population level or individual level.

    • In addition, the ADO index could serve as a reference standard for risk prediction against which the additional value of various biomarkers to predict mortality could be assessed.

    Strengths and limitations of this study

    • The study includes a large sample size from 10 European and American cohorts and covers the entire COPD severity spectrum, which increases external validity.

    • The study uses information readily available in routine clinical practices.

    • Focus on mortality and easily available predictors.

    Introduction

    Chronic obstructive pulmonary disease (COPD) is among the leading causes of death worldwide.1 ,2 Although the substantial excess mortality associated with COPD is well recognised from a public health standpoint, relatively little evidence is available on how to estimate the risk of mortality for an individual patient. Tools to accurately project the clinical course of the disease, including prediction of outcomes such as mortality, exacerbations or quality of life, would inform patients and their caregivers about prognosis and allow for a better understanding of the benefits and harms of possible treatments.3–6 Also, tools that incorporate prognostic information from easily available parameters could serve as reference against which the additional prognostic value of biomarkers could be assessed.

    Current international COPD guidelines provide little guidance on how to assess a patient's prognosis.7 ,8 This is likely due, in large part, to the scarcity of evidence on how to accurately estimate prognosis in patients with COPD; however, this is in contrast to other chronic disease guidelines that have clear recommendations on the use of prognostic indices to inform patients and to guide treatment decisions.9–13 Prognostic indices for COPD have recently received increased attention, but have seen little application in clinical practice. This may be because indices, to date, have either required information not readily available in routine clinical practice,14 do not provide explicit outcome risks15 ,16 or have received minimal validation.15–17 A recently developed index, the ADO index, combines age, dyspnoea and airflow obstruction to predict the risk of mortality. It may have great potential for widespread application because of its simplicity. However, formal testing of its accuracy across a variety of COPD patient cohorts following standard methods has not yet been done.6 ,18–21 The original index was derived in a cohort of moderate-to-severe COPD patients from specialised care, therefore, it requires validation in larger and notably more diverse COPD populations. We conducted such large-scale international validation of the ADO index to determine how well it predicts mortality for individual subjects with COPD from diverse settings, and updated the index as needed.

    Methods

    Cohorts and patients

    Investigators from 10 COPD and population-based cohort studies in Europe and the Americas agreed to collaborate in the International COPD Cohorts Collaboration Working Group. These cohorts include the Barmelweid cohort (Switzerland, clinic based),17 the Basque study (Spain, clinic based),22 the Cardiovascular Health Study (CHS, USA, population based),23 the Copenhagen City Heart Study (CCHS, Denmark, population based),24 the Jackson Heart Study (JHS, USA, population based),25 the Lung Health Study (LHS, USA, clinic based),26 the cohort from which patients for the National Emphysema Treatment Trial were recruited (NETT, USA, clinic based),27 the Phenotype and Course of COPD PAC-COPD Study (PAC-COPD, Spain, clinic based),28 the PLATINO study (Uruguay, population based),29 and the Quality of Life of COPD Study Group (SEPOC, Spain, clinic based).30 Details about the cohorts are provided in the online supplement (see online supplementary appendix 1). From this international pool of cohorts we selected participants with at least 40 years of age and with COPD defined by spirometry as a post-bronchodilator (BD) FEV1/FVC≤0.7, except for the CHS and CCHS cohorts where post-BD was not available and pre-BD values were used. Thus, our large pool of cohorts represents a heterogeneous group of subjects, combining (1) COPD patients from clinical cohorts and (2) subjects with evidence of airway limitation from the population-based cohorts, but without a confirmed diagnosis of COPD. Ethics Board approval was obtained in all cohorts.

    Mortality and candidate predictors of mortality

    All-cause mortality at 3 years was defined as the outcome. It was obtained from personal follow-up of patients or relatives, national registries, or hospital records, yielding no missing information with respect to mortality. We considered potential predictors of mortality which are easy to obtain across diverse medical settings. These variables included age, sex, smoking status, prebronchodilator or postbronchodilator FEV1 as available, dyspnoea score (Medical Research Council Dyspnea scale), respiratory signs and symptoms (cough, sputum and wheezing), body mass index (BMI), asthma and cardiovascular disease (CVD, which included ischaemic heart disease, stroke, congestive heart failure or peripheral vascular disease). As in previous analyses,17 we explicitly excluded potential predictors of mortality which are more burdensome to measure such as exercise capacity (eg, 6 min walked distance) or arterial blood gases, since these are unlikely to be available consistently in clinical practice outside academic centres. Missing values were imputed using 10-fold multiple imputation for each cohort, using the remaining variables as predictors.31 ,32 Methods used for collecting and harmonising data, and for handling missing data are detailed in the appendix (see online supplementary appendices 2–4).

    Statistical analysis

    A detailed version of statistical analysis including sample size assessment is available in the appendix (see online supplementary appendix 5).

    We first validated the original ADO index17 through the assessment of its discrimination (area under curve) and calibration (comparison of predicted vs observed risk) properties in all subjects except for those included in the original derivation cohort (ie, the Barmelweid study).

    In order to make the risk estimation tool as generalisable to different international populations as possible, we then updated the ADO index following standardised procedures that first included an updating or adjustment of the intercept only followed by, if necessary, more extensive updates including model revision (refitting the predictor-outcome associations) and model extension (adding new predictors).21 ,32 Model refitting of the ADO index was performed using all subjects from the CCHS, LHS, NETT, PLATINO and PAC-COPD cohorts (update cohort, n=10 221), applying logistic regression with death as the outcome variable and age, dyspnoea and FEV1 as predictors. Then the validation (discrimination and calibration) of the final updated ADO index was done with the subjects from the Barmelweid study, CHS, Basque Study, JHS and SEPOC cohorts (validation cohort, n=3693). Thus, both update and validation sets included a large number of subjects with COPD or airflow limitation, diverse in terms of disease severity (GOLD I–IV) and settings (general population, primary care and specialised care). We translated the final model into a simple-to-use 15-point scale.33

    To further quantify the accuracy of the updated ADO index, we performed a decision curve analysis that compares the net benefit of different approaches. Net benefit is defined as the difference between the proportion of subjects that are correctly identified to be at or above a certain risk threshold (eg, 5% risk) and the proportion of subjects incorrectly identified to be at or above that threshold. We focused on subjects with COPD at low-to-moderate risk for 3-year mortality (<20%) where most uncertainty about the balance between benefits and harms of treatments may exist so that risk thresholds may be specifically useful.34 ,35

    Finally, we explored whether adding new predictors (eg, CVD, BMI and sex) improved the updated (refitted) models’ discrimination and calibration and we conducted three sensitivity analyses that tested how susceptible our results were to analytical approaches taken. All analyses were repeated: (1) using multilevel (rather than conventional) logistic regression analysis; (2) excluding subjects with mild COPD (GOLD stage I) and (3) excluding subjects with a physician diagnosis of asthma from cohorts where only prebronchodilator spirometry was available. We also considered restricting the analyses to subjects with an FEV1/FVC ratio below their lower limit of normal level according to local prediction equations, but the number of subjects not fulfilling this criterion was very low (<1%).

    We conducted all analyses using Stata for Windows (V.11.1, College Station, Texas, USA) and R, V.2.12 (R Foundation for Statistical Computing, Vienna, Austria, 2011).

    Results

    In total, 13 914 subjects with COPD (60% men) were included in the analysis (table 1). On average, subjects were approximately 61 years old, with moderate airflow limitation and mild dyspnoea; however, there was a wide range of disease severity within and across cohorts. The majority of subjects were former or current smokers (89%) and 22% had concomitant CVD. After 3 years 1350 (9.7%) subjects had died.

    View this table:
    Table 1

    Description of sociodemographic and clinical characteristics of 13 914 subjects with COPD from the cohorts

    The original ADO index showed high discrimination (see online supplementary appendix 6) but poor calibration with a substantial mismatch between predicted and observed risks across the entire risk spectrum. Updating the intercept only did not substantially improve this miscalibration. Therefore, we decided to update the original ADO index.

    In the update cohort, the updated ADO model showed very good agreement between predicted and observed 3-year mortality risk across 10 equally sized groups of subjects with increasing predicted risk (figure 1: mean predicted risk 9.1%). More importantly, in the validation cohort, the updated index still had good prediction across all risk categories, in particular in subjects at mortality risks below 20%. There was only a slight overprediction among subjects at very high risk. This validation did not indicate a need for further adjustment of the intercept or regression coefficients of the updated ADO model, which indicated good generalisability across countries and settings. Discrimination was, as expected, somewhat lower in the validation cohort but still 0.73 (95% CI 0.70% to 0.76%). Further extensions of the updated ADO index by adding CVD, BMI and sex did not substantially improve the model's discrimination or calibration, even though all three predictors were significantly associated with mortality in the multivariate model (all p values <0.05). The area under the curve remained 0.85 in the update cohort and 0.74 in the validation cohort, and the calibration also remained good (see online supplementary appendix 7).

    Figure 1
    Figure 1

    Update and validation of the ADO index in 13 914 subjects with chronic obstructive pulmonary disease (COPD). The upper part of the figure shows the predictive performance of the updated ADO index in 10 221 subjects with COPD from the Copenhagen City Heart Study, Lung Health Study, National Emphysema Treatment Trial, PLATINO and the Phenotype and Course of COPD Study. The calibration plot shows the predicted and observed risks for 10 equally sized group with increasing risk of 3-year mortality. The discrimination plot shows the area under the curve. The lower part of the figure shows the predictive performance of the updated ADO index in the validation cohort with 3693 subjects from the Cardiovascular Health Study, Basque COPD study, Jackson Heart Study, Barmelweid Study and the Quality of Life of Chronic Obstructive Pulmonary Disease Study (SEPOC).

    Tables 2 and 3 show the updated ADO index where the strength of association of age, dyspnoea and FEV1 with 3-year mortality is reflected in the regression coefficients and the corresponding integer point score. The 3-year risks of mortality associated with ADO scores are shown in table 4 and range from 0.7% (95% CI 0.6% to 0.9%) with a score of zero to 64.5% (95% CI 61.2% to 67.7%) at a point score of 14. The area under the curve of the updated ADO index is 0.81 (95% CI 0.80% to 0.82%).

    View this table:
    Table 2

    Regression coefficients and development of updated ADO index

    View this table:
    Table 3

    Assignment of points for the updated ADO index, compared with the original ADO index

    View this table:
    Table 4

    The ADO index—prediction of 3-year mortality in chronic obstructive pulmonary disease subjects

    Figure 2A shows that, from 1% to 20% risk of 3-year mortality, using the updated ADO index (regression equation) is consistently more accurate to classify patients correctly above or below certain risk thresholds than using either of the three predictors alone. Figure 2B shows the consequences of more accurate risk classification. For example at a risk threshold of 5%, using the ADO index would result in a reduction of the number of patients classified incorrectly to be above 5% by 33/100 subjects compared with considering all patients to be above 5% (ie, without using any predictors), and compared with using only FEV1 (18 per 100 subjects), age (24 per 100 subjects) or dyspnoea (10 per 100 subjects). At higher risk thresholds, the updated ADO index and FEV1 perform similarly.

    Figure 2
    Figure 2

    Accuracy of four strategies to classify subjects into risk categories. The upper part (A) of the figure shows the net benefit of six strategies to classify subjects with chronic obstructive pulmonary disease. The higher the values for net benefit the more patients are correctly classified. Two strategies do not use any predictors but assume that all patients would be above or below a risk threshold. The four other strategies use the ADO index, age, dyspnoea or FEV1 and associated risks of 3-year mortality to classify patients. Net benefit is defined as the difference between the proportion of correctly classified subjects and the proportion of subjects classified incorrectly to be at or above a risk threshold (eg, 5% risk). The line for considering all patients to be above a risk threshold crosses that line for considering all patients to be below a risk threshold at the death rate observed (9.7%). The lower part of the graph (B) shows that, for example at a threshold of 5% mortality risk, using the ADO index would result in a net benefit similar to the reduction of 33 incorrectly classified patients per 100 subjects compared to considering all patients to be above a 5% mortality risk. Using age, dyspnoea or FEV1 only would reduce it by only 24, 10 and 18 per 100 subjects, respectively. The graph is restricted to subjects at low to moderate risk for 3-year mortality (<20%) where most uncertainty about the balance between benefits and harms from treatment may exist.

    Discrimination, calibration and the analysis of accuracy for risk thresholds remained essentially unchanged in all sensitivity analyses (see online supplementary appendix 8).

    Discussion

    Our study showed that the updated ADO index, ranging from 0 to 14, accurately predicts 3-year mortality in subjects with COPD. We found that adding CVD, BMI or sex does not significantly improve prediction of mortality when added to age, dyspnoea and FEV1. Importantly, these results were consistent in sensitivity analyses and across very diverse COPD populations. Based on these results, the updated ADO index has the potential to provide COPD patients with accurate prognostic information on mortality.

    The interest in prognostic assessment of COPD has resulted in several prognostic tools.15–17 The latter had, however, little impact on clinical guidelines or practice so far. The current study overcomes potentially important barriers to the use of previously published prognostic tools by providing an extensive, international validation of a simple tool. The first step of our analysis, the large-scale validation of the original ADO index, showed that mortality could not be predicted accurately but that the combination of age, dyspnoea and FEV1 is highly discriminative. Therefore, a more extensive update than just an adjustment for different underlying risks was necessary and we updated the entire regression model in our very diverse update cohort that represented the entire disease spectrum. The resulting updated ADO index showed excellent calibration and discrimination in both the update and validation cohorts. An additional adjustment was not deemed necessary for the validation cohort, which may be due to the great diversity of the update and validation cohorts in terms of disease severity, clinical setting and geographical area. Our results confirm that CVD and low BMI are important comorbidities in COPD patients and are significantly associated with mortality; however, they did not provide additional accuracy in risk prediction when added to age, dyspnoea and FEV1, as shown by the fact that the performance of the ADO index was not improved by adding CVD, sex and BMI to the statistical model.

    Informing patients about their prognosis is a core task of clinicians. Patients with chronic disease are particularly interested in the potential course of their disease in order to better understand what a diagnosis such as COPD implies for them. Important outcomes that characterise prognosis are exacerbations, quality of life and mortality.36 With the ADO index, we now provide a simple tool that clinicians from any setting can use to estimate the risk of mortality. We propose that such multivariable tools can also be used to balance the benefits and harms of possible treatments since the benefit harm balance depends heavily on the patients’ prognosis.4 ,37 Thus, estimation of prognosis is of key importance for patients but also for policy makers, regulatory agencies and clinical guideline developers. Our data suggest that the ADO index classifies patients more correctly above or below certain risk thresholds than only FEV1, and this gain is especially relevant in subjects with very low and low risk of 3-year mortality where the benefit harm balance may be unfavourable.3 ,4 Although most COPD treatments are not prescribed to modify mortality risk, but to reduce exacerbations, and improve symptoms and quality of life, similar estimates for the benefit harm balance could be made for patients at low risk for exacerbations. Therefore, in the future, the ADO index should be complemented by other widely validated risk tools that make accurate projections about the risk for important outcomes in COPD, including exacerbations or worsening quality of life, in order to balance the benefits and harms of possible treatments.

    In addition, accurate prediction of mortality by the ADO index can be used in clinical trials to base sample size calculations on realistic estimates of expected event rates, to target treatments to specific risk groups, for prestratification or to adjust for potential baseline imbalances. Also, the ADO index could be useful for the evaluation of biomarkers. Currently, major studies are being carried out to identify biomarkers that might help to improve outcome prediction and response to treatments. The use of such biomarkers in clinical practice seems justified if they add significantly to the prediction based on easily available information. The ADO index is a simple tool that could serve as reference against which the additional value of biomarkers to predict mortality could be assessed. Therefore, the ADO index is likely to be useful for both medical practice and research.

    A limitation to the current study is the use of mortality as the only assessed outcome, since COPD morbidity includes other relevant outcomes such as exacerbations, hospital admissions, or quality-of-life. Thus, our study should be considered a simplification of the clinical setting but it may pave the way for similar research evaluating risk prediction of additional outcomes. Once risk tools for various important outcomes and improved evidence about benefit and harm of treatments to modify these risks are available, informed decisions for providing the most appropriate care can be better supported. Our study was confined to a limited number of readily available predictors; therefore, variables with potential relevance to mortality risk such as exacerbation frequency or measures of exercise capacity were not included. This may also be perceived as strength of our study because it uses information readily available in routine clinical practices, including primary care settings, where most COPD patients are treated. Additional strengths of our study include the already mentioned large sample size and diversity of the populations. This increases external validity, which in this context means that recalibrations in populations different from those included in our analyses do not seem necessary. Lastly, by using decision curve analysis we looked beyond standard metrics for the performance of risk tools (discrimination and calibration) by providing an interpretation of the risk model that refers to different risk thresholds that may be used to inform treatment decisions.

    In conclusion, the updated 15-point ADO index is a simple tool that can be used in diverse settings to inform patients and their caregivers about prognosis. Using risk tools in clinical COPD research may also help to design clinical trials and to inform policy makers, regulatory agencies or guideline developers when estimating the benefit harm balance and to serve as a reference standard for risk prediction against which the additional value of various biomarkers to predict mortality could be assessed.

    References

    1. ↵
      1. Lopez AD,
      2. Shibuya K,
      3. Rao C,
      4. et al
      . Chronic obstructive pulmonary disease: current burden and future projections. Eur Respir J 2006;27:397–412.
      OpenUrlFREE Full Text
    2. ↵
      1. Mathers CD,
      2. Loncar D
      . Projections of global mortality and burden of disease from 2002 to 2030. PLoS Med 2006;3:e442.
      OpenUrlCrossRefPubMed
    3. ↵
      1. Guo JJ,
      2. Pandey S,
      3. Doyle J,
      4. et al
      . A review of quantitative risk-benefit methodologies for assessing drug safety and efficacy-report of the ISPOR risk-benefit management working group. Value Health 2010;13:657–66.
      OpenUrlCrossRefPubMedWeb of Science
    4. ↵
      1. Kent DM,
      2. Hayward RA
      . Limitations of applying summary results of clinical trials to individual patients: the need for risk stratification. JAMA 2007;298:1209–12.
      OpenUrlPubMed
    5. ↵
      1. Politi MC,
      2. Han PK,
      3. Col NF
      . Communicating the uncertainty of harms and benefits of medical interventions. Med Decis Making 2007;27:681–95.
      OpenUrlAbstract/FREE Full Text
    6. ↵
      1. Moons KG,
      2. Royston P,
      3. Vergouwe Y,
      4. et al
      . Prognosis and prognostic research: what, why, and how? BMJ 2009;338:b375.
      OpenUrlFREE Full Text
    7. ↵
      Global Strategy for Diagnosis, Management, and Prevention of COPD. 2010. http://wwwgoldcopdcom/GuidelinesResourcesasp?l1=2&l2=0 (accessed 10 Sept 2012).
    8. ↵
      1. Celli BR,
      2. MacNee W
      . Standards for the diagnosis and treatment of patients with COPD: a summary of the ATS/ERS position paper. Eur Respir J 2004;23:932–46.
      OpenUrlFREE Full Text
    9. ↵
      National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults (Adult Treatment Panel III). Third Report of the National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults (Adult Treatment Panel III) final report. Circulation 2002;106:3143–421.
      OpenUrlFREE Full Text
    10. ↵
      American Diabetes Association. Standards of medical care in diabetes. Diabetes Care 2011;34(Suppl 1):S11–61.
      OpenUrlFREE Full Text
    11. ↵
      National Collaborating Centre for Cancer. NICE clinical guideline 58: Prostate cancer: diagnosis and treatment. National Institute for Health and Clinical Excellence. 2008. http://www.nice.org.uk/cg58 (accessed 10 Sept 2012).
    12. ↵
      National Collaborating Centre for Cancer. NICE clinical guideline 80: Early and locally advanced breast cancer: diagnosis and treatment. National Institute for Health and Clinical Excellence. 2009. http://www.nice.org.uk/cg80 (accessed 10 Sept 2012).
    13. ↵
      US Preventive Services Task Force. Aspirin for the prevention of cardiovascular disease: U.S. Preventive Services Task Force recommendation statement. Ann Intern Med 2009;150:396–404.
      OpenUrlCrossRefPubMedWeb of Science
    14. ↵
      1. Puhan MA,
      2. Zoller M,
      3. ter Riet G
      . COPD: more than respiratory. Lancet 2008;371:27–8.
      OpenUrlCrossRefPubMedWeb of Science
    15. ↵
      1. Jones RC,
      2. Donaldson GC,
      3. Chavannes NH,
      4. et al
      . Derivation and validation of a composite index of severity in chronic obstructive pulmonary disease: the DOSE Index. Am J Respir Crit Care Med 2009;180:1189–95.
      OpenUrlCrossRefPubMedWeb of Science
    16. ↵
      1. Celli BR,
      2. Cote CG,
      3. Marin JM,
      4. et al
      . The body-mass index, airflow obstruction, dyspnea, and exercise capacity index in chronic obstructive pulmonary disease. N Engl J Med 2004;350:1005–12.
      OpenUrlCrossRefPubMedWeb of Science
    17. ↵
      1. Puhan MA,
      2. Garcia-Aymerich J,
      3. Frey M,
      4. et al
      . Expansion of the prognostic assessment of patients with chronic obstructive pulmonary disease: the updated BODE index and the ADO index. Lancet 2009;374:704–11.
      OpenUrlCrossRefPubMedWeb of Science
    18. ↵
      1. Altman DG,
      2. Royston P
      . What do we mean by validating a prognostic model? Stat Med 2000;19:453–73.
      OpenUrlCrossRefPubMedWeb of Science
    19. ↵
      1. Altman DG,
      2. Vergouwe Y,
      3. Royston P,
      4. et al
      . Prognosis and prognostic research: validating a prognostic model. BMJ 2009;338:b605.
      OpenUrlFREE Full Text
    20. ↵
      1. Steyerberg EW,
      2. Bleeker SE,
      3. Moll HA,
      4. et al
      . Internal and external validation of predictive models: a simulation study of bias and precision in small samples. J Clin Epidemiol 2003;56:441–7.
      OpenUrlCrossRefPubMedWeb of Science
    21. ↵
      1. Janssen KJ,
      2. Moons KG,
      3. Kalkman CJ,
      4. et al
      . Updating methods improved the performance of a clinical prediction model in new patients. J Clin Epidemiol 2008;61:76–86.
      OpenUrlCrossRefPubMedWeb of Science
    22. ↵
      1. Sobradillo P,
      2. Iriberri M,
      3. Gomez B,
      4. et al
      . Validation of bode index as a predictor of mortality in COPD patients. 18th Annual Congress of the European Respiratory Society. Berlin: European Respiratory Society, 2008:P531.
    23. ↵
      1. Fried LP,
      2. Borhani NO,
      3. Enright P,
      4. et al
      . The Cardiovascular Health Study: design and rationale. Ann Epidemiol 1991;1:263–76.
      OpenUrlCrossRefPubMed
    24. ↵
      1. Appleyard M,
      2. Hansen A,
      3. Schnohr P
      . The Copenhagen City Heart Study: a book of tables with data from the first examination (1976–78) and a five years follow-up (1981–1983). Scand J Soc Med 1989;170:1–160.
      OpenUrl
    25. ↵
      1. Carpenter MA,
      2. Crow R,
      3. Steffes M,
      4. et al
      . Laboratory, reading center, and coordinating center data management methods in the Jackson Heart Study. Am J Med Sci 2004;328:131–44.
      OpenUrlCrossRefPubMed
    26. ↵
      1. Connett JE,
      2. Kusek JW,
      3. Bailey WC,
      4. et al
      . Design of the Lung Health Study: a randomized clinical trial of early intervention for chronic obstructive pulmonary disease. Control Clin Trials 1993;14:3S–19S.
      OpenUrlCrossRefPubMed
    27. ↵
      1. Fishman A,
      2. Martinez F,
      3. Naunheim K,
      4. et al
      . A randomized trial comparing lung-volume-reduction surgery with medical therapy for severe emphysema. N Engl J Med 2003;348:2059–73.
      OpenUrlCrossRefPubMedWeb of Science
    28. ↵
      1. Garcia-Aymerich J,
      2. Gomez FP,
      3. Anto JM
      . Phenotypic Characterization and Course of Chronic Obstructive Pulmonary Disease in the PAC-COPD Study: design and methods. Arch Bronconeumol 2009;45:4–11.
      OpenUrlCrossRefPubMedWeb of Science
    29. ↵
      1. Menezes AM,
      2. Perez-Padilla R,
      3. Jardim JR,
      4. et al
      . Chronic obstructive pulmonary disease in five Latin American cities (the PLATINO study): a prevalence study. Lancet 2005;366:1875–81.
      OpenUrlCrossRefPubMedWeb of Science
    30. ↵
      1. Domingo-Salvany A,
      2. Lamarca R,
      3. Ferrer M,
      4. et al
      . Health-related quality of life and mortality in male patients with chronic obstructive pulmonary disease. Am J Respir Crit Care Med 2002;166:680–5.
      OpenUrlCrossRefPubMedWeb of Science
    31. ↵
      1. Moons KG,
      2. Donders RA,
      3. Stijnen T,
      4. et al
      . Using the outcome for imputation of missing predictor values was preferred. J Clin Epidemiol 2006;59:1092–101.
      OpenUrlCrossRefPubMedWeb of Science
    32. ↵
      1. Steyerberg E
      . Applications of prediction models. In: Steyerberg E (ed.). Clinical prediction models—a practical approach to development, validation, and updating. New York: Springer, 2010. pp. 281–310
    33. ↵
      1. Sullivan LM,
      2. Massaro JM,
      3. D'Agostino RB
      . Presentation of multivariate data for clinical use: the Framingham Study risk score functions. Stat Med 2004;23:1631–60.
      OpenUrlCrossRefPubMedWeb of Science
    34. ↵
      1. Vickers AJ
      . Decision analysis for the evaluation of diagnostic tests, prediction models and molecular markers. Am Stat 2008;62:314–20.
      OpenUrlCrossRefPubMed
    35. ↵
      1. Vickers AJ,
      2. Elkin EB
      . Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making 2006;26:565–74.
      OpenUrlAbstract/FREE Full Text
    36. ↵
      1. Cazzola M,
      2. MacNee W,
      3. Martinez FJ,
      4. et al
      . Outcomes for COPD pharmacological trials: from lung function to biomarkers. Eur Respir J 2008;31:416–69.
      OpenUrlAbstract/FREE Full Text
    37. ↵
      1. Gail MH
      . The estimation and use of absolute risk for weighing the risks and benefits of selective estrogen receptor modulators for preventing breast cancer. Ann N Y Acad Sci 2001;949:286–91.
      OpenUrlPubMedWeb of Science

    Supplementary materials

    • Supplementary Data

      This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

      Files in this Data Supplement:

    Footnotes

    • Collaborators Cohorts and investigators of the International COPD Cohorts Collaboration Working Group: Barmelweid cohort (Switzerland)—Martin Frey, MD, Klinik Barmelweid, Switzerland; Ulrike Held, PhD, Horten Centre, University of Zurich, Switzerland; Milo A. Puhan, MD, PhD, Johns Hopkins Bloomberg School of Public Health, Baltimore, USA and Horten Centre, University of Zurich, Switzerland. Basque study (Spain)—Milagros Iriberri Pascual, MD, Cruces Hospital, Baracaldo, Basque Country, Spain; Patricia Sobradillo, MD, CIBER Enfermedades Respiratorias (CIBERES), Fundación Caubet-Cimera, Mallorca, Spain. Cardiovascular Health Study (USA)—R. Graham Barr, MD, Department of Medicine, College of Physicians and Surgeons, Columbia University, New York, USA; Paul Enright, MD, College of Public Health, The University of Arizona, Tucson, Arizona, USA; Jerry Krishnan, MD, Department of Medicine, Section of Pulmonary and Critical Care, University of Chicago, Chicago, USA; Tony Wilson, Department of Biostatistics, University of Washington, Seattle, USA; Sachin Yende, MD, Department of Critical Care Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania, USA. Copenhagen City Heart City study (Denmark)—Peter Lange, MD, Pulmonary Division, Hvidovre Hospital, Hvidovre, Danmark. Jackson Heart Study (USA)—DeMarc Hickson, PhD, MPH, Jackson State University, Jackson Heart Study, Coordinating Center, USA. Department of Medicine, University of Mississippi Medical Center, USA; Wendy White, PhD, MPH, Tougaloo College, Jackson Heart Study, USA. Lung Health Study (USA)—Nadia Hansel, MD, MPH, and Robert A. Wise, MD, Division of Pulmonary & Critical Care Medicine, Johns Hopkins School of Medicine, Baltimore, USA. National Emphysema Treatment Trial (USA)—Fernando Martinez, MD, Division of Pulmonary and Critical Care Medicine, University of Michigan Health System, Ann Arbor, USA; Zab Mosenifar, MD, Cedars Sinai Medical Center, David Geffen School of Medicine at UCLA, Los Angeles, USA; Andrew Ries, MD, Department of Medicine, University of California, San Diego, USA; James K. Stoller, MD, MS, Respiratory Institute, Department of Pulmonary and Critical Care Medicine, Cleveland Clinic Foundation, Cleveland, USA; Robert A. Wise, MD, see above. PAC-COPD (Spain)—Alvar Agustí, MD, Federico P Gómez, MD, and Roberto Rodriguez-Roisin, MD, Department of Pneumology, Thorax Institute, Hospital Clinic, Institut d'Investigacions Biomèdiques August Pi i Sunyer, Barcelona, and CIBER Enfermedades Respiratorias (CIBERES), Spain; Josep M Antó, MD, PhD, and Judith Garcia-Aymerich, MD, PhD, (1) Center for Research in Environmental Epidemiology (CREAL), Barcelona, Spain, (2) Hospital del Mar Research Institute (IMIM), Barcelona, Spain, (3) Universitat Pompeu Fabra, Barcelona, Spain, (4) CIBER de Epidemiologia y Salud Pública (CIBERESP), Spain. PLATINO study team (Brazil, Uruguay)—Ana MB Menezes, MD, PhD, Federal University of Pelotas, Pelotas, Brazil; Maria Victorina Lopez, MD, and Adriana Muiño, MD, Universidad de la República, Montevideo. Uruguay. SEPOC study (Spain)—Josep M Antó, MD, PhD, see above; Antonia Domingo-Salvany, MD, PhD, Hospital del Mar Research Institute (IMIM), Barcelona, Spain; Judith Garcia-Aymerich, MD, PhD, see above; Methodological and Statistical team; Judith Garcia-Aymerich, MD, PhD, see above; Nadia Hansel, MD, MPH, see above; Ulrike Held, PhD, see above; Alphons Kessels, MD, Clinical Epidemiology, and Medical Technology Assessment, University Hospital Maastricht, Maastricht, The Netherlands; Karel GM Moons, PhD, Julius Centre for Health Sciences and General Practice, University Medical Center, Utrecht, The Netherlands; Milo A. Puhan, MD, PhD, see above; Gerben ter Riet, Department of General Practice, Academic Medical Centre, University of Amsterdam, The Netherlands; Ignasi Serra, Center for Research in Environmental Epidemiology, Barcelona, Spain.

    • Contributors MP, NH and JGA conceived the study idea, contributed to the statistical analysis and drafted the first version of the manuscript. MF, UH and MP oversaw all activities related to the conduct of the Barmelweid cohort (Switzerland). MIP and PS oversaw all activities related to the conduct of the Basque study (Spain). RGB, PE, JK and TW oversaw all activities related to the conduct of the Cardiovascular Health Study (USA). PL oversaw all activities related to the conduct of the Copenhagen City Heart City study (Denmark). DMH and WW oversaw all activities related to the conduct of the Jackson Heart Study (USA). NH and RW oversaw all activities related to the conduct of the Lung Health Study (USA). FM, ZM, AR and RW oversaw all activities related to the conduct of the National Emphysema Treatment Trial (USA). AA, FPG, RRR, JMA and JGA oversaw all activities related to the conduct of the PAC-COPD (Spain). AMM, MVL and AM oversaw all activities related to the conduct of the PLATINO study team (Brazil, Uruguay). JMA, ADS and JGA oversaw all activities related to the conduct of the SEPOC study (Spain). UH, AK, KGM, GtR and IS contributed to the statistical analysis. All authors revised the manuscript and accepted the final version.

    • Funding The Barmelweid cohort (Switzerland) was funded by the Swiss National Science Foundation (grant number 3233B0-115216) and by the Klinik Barmelweid. Basque study (Spain): No external funding. The Cardiovascular Health Study is supported by NHLBI Grant/Contract numbers N01-HC-85239, N01-HC-85079 through N01-HC-85086; N01-HC-35129, N01 HC-15103, N01 HC-55222, N01-HC-75150, N01-HC-45133; HL080295, HL-075366; NIA Grant/Contract numbers AG-023269, AG-15928, AG-20098, and AG-027058; University of Pittsburgh Claude. D. Pepper Older Americans Independence Center grant number P30-AG-024827; with additional contribution from NINDS. See also http://www.chs-nhlbi.org/pi.htm The Copenhagen City Heart City study (Denmark) was supported by grants from The Danish Heart Foundation, The Danish Lung Association and Danish Medical Research Council. The Jackson Heart Study (JHS) is a collaborative study supported by the National Institutes of Health and the National Center on Minority Health and Health Disparities (study ID numbers: 5001; N01 HC95170; N01 HC95171; N01 HC95172) in partnership with Jackson State University, Tougaloo College, and University of Mississippi Medical Center. The Lung Health Study (USA) was supported by contract NIH/N01-HR-46002 from the National Heart, Lung and Blood Institute (NHLBI). The National Emphysema Treatment Trial (USA) is funded by the National Heart, Lung and Blood Institute, the Centers for Medicare and Medicaid Services, and the Agency for Healthcare Research and Quality. The PAC-COPD Study is funded by grants from Fondo de Investigación Sanitaria (FIS PI020541), Ministry of Health, Spain; Agència d'Avaluació de Tecnologia i Recerca Mèdiques (AATRM 035/20/02), Catalonia Government; Spanish Society of Pneumology and Thoracic Surgery (SEPAR 2002/137); Catalan Foundation of Pneumology (FUCAP 2003 Beca Marià Ravà); Red RESPIRA (RTIC C03/11); Red RCESP (RTIC C03/09), Fondo de Investigación Sanitaria (PI052486); Fondo de Investigación Sanitaria (PI052302); Fundació La Marató de TV3 (num. 041110); DURSI (2005SGR00392); and an unrestricted educational grant from Novartis Farmacèutica, Spain. CIBERESP and CIBERES are funded by the Instituto de Salud Carlos III, Ministry of Health, Spain. PLATINO study was funded by ALAT (Associacion Latino Americana del Tórax); Boehringer Ingelheim GmbH (BI), and GlaxoSmithKline (GSK). The SEPOC study (Spain) was supported by grants from Fondo de Investigación Sanitaria 99/0690 and CIRIT 1999SGR00240. Judith Garcia-Aymerich has a researcher contract from the Instituto de Salud Carlos III (CP05/00118), Ministry of Health, Spain. Karel G.M. Moons receives funding from the Netherlands Organisation for Scientific Research (project 9120.8004 and 918.10.615).

    • Competing interests None.

    • Ethics approval Ethics Committees of each participating hospital/reserach institute.

    • Provenance and peer review Not commissioned; externally peer reviewed.

    • Data sharing statement No additional data are available.