Validation and modification of HEART score components for patients with chest pain in the emergency department

Article information

Clin Exp Emerg Med. 2021;8(4):279-288
Publication date (electronic) : 2021 December 31
doi : https://doi.org/10.15441/ceem.20.106
1Department of Emergency Medicine, Hallym University Sacred Heart Hospital, Hallym University Medical Center, Anyang, Korea
2Department of Neurology, Hallym University Sacred Heart Hospital, Hallym University Medical Center, Anyang, Korea
Correspondence to: Sang Ook Ha Department of Emergency Medicine, Hallym University Sacred Heart Hospital, Hallym University Medical Center, 22 Gwanpyeong-ro 170 beongil, Donan-gu, Anyang 14068, Korea E-mail: mdhso@hallym.or.kr
Received 2020 August 20; Revised 2020 September 23; Accepted 2020 September 24.

Abstract

Objective

This study aimed to clarify the relative prognostic value of each History, Electrocardiography, Age, Risk Factors, and Troponin (HEART) score component for major adverse cardiac events (MACE) within 3 months and validate the modified HEART (mHEART) score.

Methods

This study evaluated the HEART score components for patients with chest symptoms visiting the emergency department from November 19, 2018 to November 19, 2019. All components were evaluated using logistic regression analysis and the scores for HEART, mHEART, and Thrombolysis in Myocardial Infarction (TIMI) were determined using the receiver operating characteristics curve.

Results

The patients were divided into a derivation (809 patients) and a validation group (298 patients). In multivariate analysis, age did not show statistical significance in the detection of MACE within 3 months and the mHEART score was calculated after omitting the age component. The areas under the receiver operating characteristics curves for HEART, mHEART and TIMI scores in the prediction of MACE within 3 months were 0.88, 0.91, and 0.83, respectively, in the derivation group; and 0.88, 0.91, and 0.81, respectively, in the validation group. When the cutoff value for each scoring system was determined for the maintenance of a negative predictive value for a MACE rate >99%, the mHEART score showed the highest sensitivity, specificity, positive predictive value, and negative predictive value (97.4%, 54.2%, 23.7%, and 99.3%, respectively).

Conclusion

Our study showed that the mHEART score better detects short-term MACE in high-risk patients and ensures the safe disposition of low-risk patients than the HEART and TIMI scores.

INTRODUCTION

Chest pain is a frequently cited and potentially serious complaint among patients visiting the emergency department (ED). Therefore, it is vital for emergency physicians to identify whether this chest pain is consistent with acute coronary syndrome and to predict the outcomes associated with chest pain in the ED. Several studies have evaluated the efficacy of various clinical risk stratification scores in the prediction of outcomes in patients with chest pain, which are as follows: Thrombolysis in Myocardial Infarction (TIMI) risk score; History, Electrocardiography (ECG), Age, Risk Factors, and Troponin (HEART) score; and Global Registry of Acute Coronary Events (GRACE) score [1-5]. However, only the HEART score was designed for use in the ED. Owing to its ease of use and superior accuracy in the prediction of short-term major adverse cardiac events (MACE) [6-11], the American College of Emergency Physicians recently categorized the use of the HEART score as a level B recommendation for the initial evaluation of patients presenting to the ED with chest pain [12].

The HEART score is a prognostic tool employed to assign undifferentiated chest pain patients to low-, intermediate-, and high-risk short-term MACE groups. However, most previous studies on the topic primarily examined the use of the HEART score in the identification of those with a safe disposition in terms of MACE incidence. Moreover, previous studies did not clarify the actual extent of the individual impact of each HEART score component on MACE incidence [7-11,13-20].

Accordingly, we performed a retrospective external validation study to clarify the relative prognostic value of each component of the score in terms of MACE presenting within 3 months and to validate the modified HEART (mHEART) score.

METHODS

Study design and patient selection

We conducted our study at the ED of an urban academic tertiarycare hospital in South Korea. This 900-bed facility has a regional emergency medical center, as designated by the government, and receives approximately 75,000 ED annual visits. Participants were selected through a systematic review of electronic medical records (EMRs). We included all adult patients (aged 18 years or older) with a chief complaint of chest pain, chest tightness, chest pressure, or chest discomfort, as found in a keyword search for “chief complaint” of our EMRs from November 19, 2018 to November 19, 2019. The exclusion criteria were as follows: (1) age under 18 years, (2) presence of fever or cough, (3) presence of chest pain due to trauma, (4) negative response for the presence of chest-related symptoms on questioning by a primary ED physician, (5) presence of abdominal pain (e.g., epigastric pain) when examined by a primary ED physician, which was later established to be a symptom of the gastrointestinal tract or an accessory organ-related condition using computed tomography (e.g., acute cholangitis), (6) presence of an altered level of consciousness upon arrival at the ED, (7) absence of initial troponin-I measurements or ECG data or patient refusal to undergo evaluation in the ED, (8) insufficient data for the calculation of the HEART score, and (9) presence of ST-segment elevation myocardial infarction on the initial ECG. We also excluded participants who were lost to follow-up at 3 months after ED presentation although we performed a telephone interview at the end of the data collection period (e.g., participants who did not answer the phone or had provided the wrong phone number). Patients included during the first 8 months (November 2018 to July 2019) were assigned to the derivation group and those included during the latter 4 months (August 2019 to November 2019) to the internal validation group.

Data collection

The EMRs of the enrolled patients were reviewed. Since our ED has been using the HEART score as a routine protocol for the safe disposition and risk stratification of patients presenting to the ED with chest symptoms since March 1, 2018, we were able to determine the factors for calculating the HEART score from the EMRs of most of the eligible patients during the data collection period. Data on patients’ baseline characteristics (sex, age, smoking, familial history of coronary artery disease [CAD], aspirin use in the past 7 days), underlying disease (hypertension, diabetes mellitus, obesity, dyslipidemia, atherosclerotic disease), initial vital signs (systolic blood pressure, diastolic blood pressure, heart rate, respiratory rate), history, initial troponin-I level, ECG results, HEART score, and MACE incidence within the previous 3 months were obtained and evaluated retrospectively. MACE were defined as a composite of acute myocardial infarction, percutaneous intervention, coronary artery bypass graft, and all-cause mortality. The HEART score incorporates the elements of history, ECG, age, risk factors, and cardiac troponin levels, and ranges from 0 to 2 in each of these five categories, with 0 being the lowest possible score and 10 the highest. A 3-month follow-up was performed through the evaluation of patients’ hospital records or if these data were unavailable, by a telephone interview. The component of history was evaluated by a senior resident specializing in emergency medicine, and in cases involving ambiguity, it was further evaluated by faculty members specializing in emergency medicine.

Statistical analyses

The normality of the data distributions was evaluated using the Kolmogorov-Smirnov test for the selection of appropriate parametric and nonparametric statistical methods. Categorical variables were analyzed using chi-squared or Fisher exact tests and expressed as total numbers (percentages). Continuous variables were expressed as medians (25th–75th percentiles) and analyzed using the Mann-Whitney U-test. Independent risk factors associated with MACE occurrence within 3 months in terms of the HEART score components were evaluated using multivariate backward stepwise logistic regression. Based on the multivariate analyses, we calculated the mHEART score and then evaluated the original HEART score, mHEART score, and the TIMI score using receiver operating characteristic (ROC) curves in the derivation and validation groups. Subsequently, we evaluated the cutoff values to maintain a negative predictive value (NPV) with a MACE rate >99% for the HEART, mHEART, and TIMI scores in the validation group. With these cutoff values, we compared the performance for the sensitivity, specificity, positive predictive value (PPV), and NPV in the prediction of MACE within 3 months. For all comparisons, the tests were two-tailed, and between-group differences were regarded as statistically significant at a P-value lower than 0.05. PASW Statistics ver. 18.0 (SPSS Inc., Chicago, IL, USA) was used for all analyses.

Ethics statement

This study was approved by the institutional review board of Hallym University Sacred Heart Hospital (2020-07-004). Owing to the purely observational, retrospective, and noninterventional nature of the study, the need for informed consent was waived.

RESULTS

Baseline and clinical characteristics of the patients

The study population was enrolled from among 1,634 consecutive patients with chest-related symptoms who presented to the ED for evaluation. Overall, 524 patients were excluded, and 1,110 patients met the inclusion criteria. Three patients were lost to follow-up, as they could not be reached for a telephone interview or due to a lack of EMR data. Finally, 1,107 patients were included in the analysis and categorized into the derivation group (809 patients) and the validation group (298 patients) (Fig. 1). The differences in baseline characteristics between the derivation and validation groups are summarized in Table 1. Although there were no significant differences in the patients’ age, comorbidities, smoking status, aspirin use in the past 7 days, family history of CAD, initial vital signs, or initial troponin-I levels between the two groups, there was a significant difference in terms of sex (proportion of men: 63.5% in the derivation group and 53.4% in the validation group, P=0.002). The overall MACE incidence rate within 3 months was not significantly different between the 2 groups (12.9% vs. 12.8%, respectively) (Table 2).

Fig. 1.

Flow diagram for the enrollment of patients. ED, emergency department; ECG, electrocardiography; STEMI, ST segment elevation myocardial infarction; MACE, major adverse cardiac events.

Baseline characteristics of the patients with chest pain

Components of the HEART score and clinical outcomes

HEART and mHEART scores

Table 2 describes the HEART score components and risk classification in both groups. Among the components, history and ECG results showed significant differences between the groups (P<0.001 and P=0.003, respectively); however, age, initial troponin-I levels, and risk factors did not show significant differences. In both groups, the proportion of patients with a score of 1 was found to be the highest in terms of the components of history, age, and risk factors, whereas the proportion of those with a score of 0 was the highest for troponin-I. In terms of ECG results, we observed the highest numbers of patients with a score of 1 and 0 in the derivation and validation groups, respectively. In terms of risk classification, the proportion of those with a high risk (7–10 points) was low in both groups (6.7% and 6.7%, respectively). A tendency of increasing MACE incidence was observed with increasing scores, and comparisons were performed between the HEART, mHEART, and TIMI scoring systems (Fig. 2). Univariate and multivariate analyses of the HEART score components were performed in the derivation group (Table 3). In the univariate logistic regression analysis, any score greater than 0 for the components of history, age, risk factors, or initial troponin-I level and a score of 2 for the ECG component indicated statistical significance compared to a score of 0 for each component, except in cases with a score of 1 for the ECG component. In the subsequent multivariate analysis, the age component did not show statistical significance in the detection of MACE occurrence within 3 months. Based on the results of the multivariate analysis, we calculated the mHEART score by omitting the age component, with a score ranging from a minimum of 0 to a maximum of 8 (Table 4).

Fig. 2.

Comparison of the History, Electrocardiography, Age, Risk Factors, and Troponin (HEART), modified HEART (mHEART), and Thrombolysis in Myocardial Infarction (TIMI) scores in the derivation group.

Univariate and multivariate analyses of the HEART score components in the derivation group

The modified HEART score for chest pain

HEART, mHEART, and TIMI scores for the detection of MACE incidence within 3 months

The areas under the ROC curves (AUROCs) for the HEART, mHEART, and TIMI scores in the prediction of MACE incidence within 3 months were 0.88 (95% confidence interval [CI], 0.85–0.91; P<0.001), 0.91 (95% CI, 0.86–0.94; P<0.001), and 0.83 (95% CI, 0.79–0.87; P<0.001), respectively, in the derivation group and 0.88 (95% CI, 0.82–0.30; P<0.001), 0.91 (95% CI, 0.86–0.95; P<0.001), and 0.81 (95% CI, 0.75–0.87; P<0.001), respectively, in the validation group (Fig. 3). The performances of the cutoff values for the HEART, mHEART, and TIMI scores in the validation group are shown in Table 5. The cutoff value for each scoring system was determined to maintain a negative predictive value (NPV) for a MACE rate >99% (HEART score 3, mHEART score 2, TIMI score 0). The mHEART score showed the highest sensitivity, specificity, positive predictive value (PPV), and NPV (97.4%, 54.2%, 23.7%, and 99.3%, respectively). Comparison of overall MACE between low- and intermediate/high-risk groups in the validation group and details are presented in Table 6.

Fig. 3.

Receiver operating characteristic curves for the History, Electrocardiography, Age, Risk Factors, and Troponin (HEART), modified HEART (mHEART), and Thrombolysis in Myocardial Infarction (TIMI) scores in the prediction of major adverse cardiac events incidence within 3 months. (A) Derivation group and (B) validation group.

Cutoff values for the HEART, mHEART, and TIMI scores in the validation group

Comparison of the incidence of MACE between low- and intermediate/high-risk groups in the validation group

DISCUSSION

In the present retrospective external validation study that sought to clarify the relative prognostic value of each HEART score component for MACE occurrence within 3 months, the age component did not show statistical significance in the multivariate logistic regression analysis. The mHEART score was calculated without the age component, with a range of a minimum of 0 points to a maximum of 8 points. The mHEART score performed better, with the highest AUROC, when the detection of MACE incidence within 3 months was considered compared to the HEART and TIMI scores.

MACE within 3 months

According to an earlier systematic review, which screened 514 studies regarding clinical scores for risk stratification of chest pain patients in the ED that were published between 1 January 2012 and 25 September 2017, a total of 29 studies on the validation and modification of HEART, TIMI, GRACE, and heart rate variability based scores were reviewed. The duration of the short-term MACE ranged from 72 hours to 6 months after the time when patients’ disposition was made and 12 months was classified as the long-term duration for MACE [21]. In addition, in a study conducted by Six et al. [10], who first proposed the HEART score, the long-term follow-up data of 120 out of a total of 122 eligible patients were available, with a duration of 423±106 days. During this period, MACE were reported in 29 patients, all of which occurred within a time frame of 3 months. Accordingly, our study assessed a more efficient period of short-term MACE which was of 3 months to maximize the ability to detect these events.

Baseline and clinical characteristics of the patients

The demographic parameters, including those of the original HEART score that were observed in this study, were similar to those noted in previous HEART score-based studies, except for obesity and a family history of CAD [10,13,14,16-18,22-24]. However, compared to these previous studies, we reported significantly lower rates of obesity in both the derivation and validation groups (3.0% and 2.7%, respectively). In 2017, the Organization for Economic Cooperation and Development (OECD) stated that 19.5% of the adult population in OECD countries were obese. The prevalence rate of obesity in the adult population of South Korea is 5.3%, which is the third lowest among the OECD countries, after those found in Japan and India, with the adult population in the United States showing the highest obesity rate at 38.2% [25]. Since the present study was performed in South Korea, this may explain the lower rates of obesity. Indeed, the HEART score validation studies conducted in China and Hong Kong, which showed obesity rates in the adult population similar to South Korea, have been found to demonstrate similar results. Additionally, similar results were observed in those with a family history of CAD. These differences indicate a potentially unique risk factor profile in South Korean patients, or Asian populations in general, with regards to MACE incidence. Overall, MACE occurred within 3 months in 12.9% and 12.8% of patients in the derivation and validation groups, respectively, which was consistent with previous findings [7,11].

HEART and mHEART scores

The HEART score is used to ensure the safe disposition of low-risk chest pain patients presenting to the ED and has gained popularity among ED physicians worldwide. With the accumulation of external validation data, there is now ample evidence to support the score’s value in guiding the patient’s safe disposition. However, although some studies have investigated the relationship between each element of the HEART score and short-term MACE incidence, none have demonstrated the exact extent of their impact or identified whether all the elements have the same influence on MACE incidence [10,11,18,24]. Initially, Six et al. [10] while proposing the HEART score, suggested that all components had the same score ranges (0–2 points), and assumed that each component would have the same impact on the MACE prevalence. It is notable that this was based on experts’ clinical experiences, but not on traditional multivariate regression analysis, which is commonly used in clinical score derivation [21,26]. In this context, we evaluated whether all components of the HEART score had the same effect on MACE incidence.

In this study, the general characteristics of the components of the HEART score were in line with those observed in previous related studies. Particularly, we reported the highest P-value for the age component than for the other components showing correlations with MACE incidence in the univariate analysis. A retrospective validation study in China reported similar results [24]. All other HEART score components showed P-values lower than 0.001, whereas the age component had a P-value of 0.025, which was the highest. Additionally, a similar finding was shown in the original HEART score study [10]. The age component had the highest P-value among all components, with a P-value of 0.2847. This finding suggests that the age component may have weaker statistical significance in the prediction of short-term MACE incidence than the other HEART score components. Finally, in the subsequent multivariate analysis, age did not show statistical significance. Thus, we calculated the mHEART score without the age component and evaluated whether this score was more appropriate for use in the prediction of short-term MACE risk than the original HEART score.

HEART, mHEART, and TIMI scores for the detection of MACE within 3 months

Several studies have reported the AUROC for the HEART score in the prediction of short-term MACE incidence. Streitz et al. [18] reported an AUROC of 0.885 (95% CI, 0.838–0.931), whereas in an external validation study conducted in the United States, the value was 0.898 (95% CI, 0.847–0.950) [16]. In our study, the AUROC for the HEART score was 0.880 (95% CI, 0.850–0.910; P<0.001) in the derivation group and 0.880 (95% CI, 0.820–0.300; P<0.001) in the validation group, similar to the values observed in other studies. However, the AUROCs for the mHEART score were 0.910 (95% CI, 0.860–0.940; P<0.001) and 0.910 (95% CI, 0.860–0.950; P<0.001) in the derivation and validation groups, respectively, which are higher than those for the HEART score, as observed in our study as well as other HEART-related studies. In the comparison of observed sensitivity, specificity, PPV, and NPV for MACE occurrence with those observed in a HEART score validation study in an Asian-Pacific population performed in the Netherlands [11], when the cutoff levels for the HEART and mHEART scores were set at ≤3 and ≤2, respectively, all four values were higher for the mHEART score than for the HEART score.

Multiple ED-based external validation studies have concluded that the accuracy of the HEART score is superior to that of the TIMI score in the prediction of short-term MACE incidence [7,10,13,18,27]. In the aforementioned study conducted in the Netherlands [11], when the cutoff level was set at ≤3 for the HEART score and 0 for the TIMI score, the PPV rates for short-term MACE incidence for the HEART score and TIMI score were 17.3% and 15.4%, respectively, and the corresponding NPV rates were 98.3% and 98.7%, respectively; the corresponding specificity values for MACE incidence were 31.8% and 20.3%, respectively. These results suggest that the HEART score allows for the identification of high-risk patients with greater accuracy than the TIMI score, while also allowing for the safe disposition of low-risk patients. Additionally, our study showed that the mHEART score had the highest PPV and NPV for short-term MACE incidence for the three scoring tools mentioned, with a PPV rate of 23.7% and NPV rate of 99.3%. The fact that the mHEART score showed the highest PPV when we calculated the PPV with the NPV fixed at a rate of 99% or higher indicates that the mHEART score performed better in terms of detecting high-risk patients for short-term MACE incidence and in ensuring the safe disposition of low-risk patients than both the HEART and TIMI scores.

With the increase in the number of external validation studies related to the HEART score, sufficient data have already been collected to support its diagnostic value in the identification of lowrisk patients. Recent external validation studies on the HEART score are now predominantly focused on the validation of its prognostic value in distinguishing high-risk patients for short-term MACE incidence rather than the safe disposition of low-risk patients, which has already been heavily researched. Given these current trends, our results may be meaningful as they support the use of the mHEART score as a prognostic tool for groups with a high risk of MACE and also as the basis for the disposition of low-risk patients. Moreover, our findings suggest that each component of the HEART score may have a different degree of influence on short-term MACE incidence. If this degree is reflected in the HEART score, the prognostic accuracy of the score would be maximized. Future studies with larger sample sizes might yield more knowledge on this subject.

Our study has several limitations. First, its single-center, retrospective study design may be associated with a selection bias. Second, the sample size was not calculated, and only patients who visited the ED over a period of 1 year were included. Thus, the generalizability of the results may be limited. Third, patients were included in the study only if they had chest pain, chest tightness, chest pressure, or chest discomfort. Patients with atypical symptoms without such chest-related symptoms who may have presented with only nausea, dyspnea, or an impaired level of consciousness were not included. This may have influenced the outcomes, as acute coronary syndrome patients with initial atypical symptoms are known to have worse prognoses than those with chest symptoms [28,29]. Our findings should be validated in a general population including various ethnicities. A more comprehensive and well-designed multicenter prospective validation study is needed to address the aforementioned issues. Lastly, as a biomarker of myocardial cell necrosis, troponin-I is very sensitive, but lacks the specificity for cardiac ischemia associated with acute coronary syndrome. Troponin-I may also increase due to acute decompensated heart failure, myocarditis, and renal failure. Further studies on the troponin component of the HEART score may be another important area for future investigation.

In summary, our study showed that the mHEART score performed better in the detection of patients at high risk for short-term MACE incidence as well as in ensuring the safe disposition of low-risk patients than the HEART or TIMI score. Our findings suggest that each component of the HEART score may have a different degree of influence on short-term MACE incidence. If this degree is reflected in the HEART score, the prognostic accuracy of the score would be maximized. Further, more comprehensive and well-designed multicenter prospective validation studies are needed in the future.

Notes

No potential conflict of interest relevant to this article was reported.

References

1. Antman EM, Cohen M, Bernink PJ, et al. The TIMI risk score for unstable angina/non-ST elevation MI: a method for prognostication and therapeutic decision making. JAMA 2000;284:835–42.
2. Boersma E, Pieper KS, Steyerberg EW, et al. Predictors of outcome in patients with acute coronary syndromes without persistent ST-segment elevation: results from an international trial of 9461 patients. The PURSUIT Investigators. Circulation 2000;101:2557–67.
3. Chase M, Robey JL, Zogby KE, Sease KL, Shofer FS, Hollander JE. Prospective validation of the Thrombolysis in Myocardial Infarction Risk Score in the emergency department chest pain population. Ann Emerg Med 2006;48:252–9.
4. Elbarouni B, Goodman SG, Yan RT, et al. Validation of the Global Registry of Acute Coronary Event (GRACE) risk score for inhospital mortality in patients with acute coronary syndrome in Canada. Am Heart J 2009;158:392–9.
5. Fanaroff AC, Rymer JA, Goldstein SA, Simel DL, Newby LK. Does this patient with chest pain have acute coronary syndrome?: the rational clinical examination systematic review. JAMA 2015;314:1955–65.
6. Backus BE, Six AJ, Kelder JC, et al. A prospective validation of the HEART score for chest pain patients at the emergency department. Int J Cardiol 2013;168:2153–8.
7. Backus BE, Six AJ, Kelder JC, et al. Chest pain in the emergency room: a multicenter validation of the HEART Score. Crit Pathw Cardiol 2010;9:164–9.
8. Hyams JM, Streitz MJ, Oliver JJ, et al. Impact of the HEART pathway on admission rates for emergency department patients with chest pain: an external clinical validation study. J Emerg Med 2018;54:549–57.
9. Poldervaart JM, Reitsma JB, Backus BE, et al. Effect of using the HEART score in patients with chest pain in the emergency department: a stepped-wedge, cluster randomized trial. Ann Intern Med 2017;166:689–97.
10. Six AJ, Backus BE, Kelder JC. Chest pain in the emergency room: value of the HEART score. Neth Heart J 2008;16:191–6.
11. Six AJ, Cullen L, Backus BE, et al. The HEART score for the assessment of patients with chest pain in the emergency department: a multinational validation study. Crit Pathw Cardiol 2013;12:121–6.
12. American College of Emergency Physicians Clinical Policies Subcommittee (Writing Committee) on Thromboembolic Disease, Wolf SJ, Hahn SA, et al. Clinical policy: critical issues in the evaluation and management of adult patients presenting to the emergency department with suspected acute venous thromboembolic disease. Ann Emerg Med 2018;71:e59–109.
13. Poldervaart JM, Reitsma JB, Koffijberg H, et al. The impact of the HEART risk score in the early assessment of patients with acute chest pain: design of a stepped wedge, cluster randomised trial. BMC Cardiovasc Disord 2013;13:77.
14. Mahler SA, Riley RF, Hiestand BC, et al. The HEART pathway randomized trial: identifying emergency department patients with acute chest pain for early discharge. Circ Cardiovasc Qual Outcomes 2015;8:195–203.
15. Mahler SA, Miller CD, Hollander JE, et al. Identifying patients for early discharge: performance of decision rules among patients with acute chest pain. Int J Cardiol 2013;168:795–802.
16. Oliver JJ, Streitz MJ, Hyams JM, et al. An external validation of the HEART pathway among emergency department patients with chest pain. Intern Emerg Med 2018;13:1249–55.
17. Oliver JJ, Streitz MJ, Hyams JM, et al. The HEART score as a prognostic tool for revascularization. Intern Emerg Med 2020;15:607–12.
18. Streitz MJ, Oliver JJ, Hyams JM, et al. A retrospective external validation study of the HEART score among patients presenting to the emergency department with chest pain. Intern Emerg Med 2018;13:727–48.
19. Weinstock MB, Weingart S, Orth F, et al. Risk for clinically relevant adverse cardiac events in patients with chest pain at hospital admission. JAMA Intern Med 2015;175:1207–12.
20. Goldman L, Cook EF, Johnson PA, Brand DA, Rouan GW, Lee TH. Prediction of the need for intensive care in patients who come to emergency departments with acute chest pain. N Engl J Med 1996;334:1498–504.
21. Liu N, Ng JC, Ting CE, et al. Clinical scores for risk stratification of chest pain patients in the emergency department: an updated systematic review. J Emerg Crit Care Med 2018;2:16.
22. Yang SM, Chan CH, Chan TN. HEART pathway and Emergency Department Assessment of Chest Pain Score-Accelerated Diagnostic Protocol application in a local emergency department of Hong Kong: an external prospective validation study. Hong Kong J Emerg Med 2020;27:30–8.
23. Stopyra JP, Riley RF, Hiestand BC, et al. The HEART pathway randomized controlled trial one-year outcomes. Acad Emerg Med 2019;26:41–50.
24. Ma CP, Wang X, Wang QS, Liu XL, He XN, Nie SP. A modified HEART risk score in chest pain patients with suspected nonST-segment elevation acute coronary syndrome. J Geriatr Cardiol 2016;13:64–9.
25. Bluher M. Obesity: global epidemiology and pathogenesis. Nat Rev Endocrinol 2019;15:288–98.
26. Zhang Z, Zhang H, Khanal MK. Development of scoring system for risk stratification in clinical medicine: a step-by-step tutorial. Ann Transl Med 2017;5:436.
27. Fesmire FM, Martin EJ, Cao Y, Heath GW. Improving risk stratification in patients with chest pain: the Erlanger HEARTS3 score. Am J Emerg Med 2012;30:1829–37.
28. Brieger D, Eagle KA, Goodman SG, et al. Acute coronary syndromes without chest pain, an underdiagnosed and undertreated high-risk group: insights from the Global Registry of Acute Coronary Events. Chest 2004;126:461–9.
29. Canto JG, Shlipak MG, Rogers WJ, et al. Prevalence, clinical characteristics, and mortality among patients with myocardial infarction presenting without chest pain. JAMA 2000;283:3223–9.

Article information Continued

Notes

Capsule Summary

What is already known

The History, Electrocardiography, Age, Risk Factors, and Troponin (HEART) score is a prognostic and clinical risk stratification tool to assign undifferentiated chest pain patients to low-, intermediate-, and high-risk groups for short-term major adverse cardiac events (MACE). Although some studies have investigated the relationship between each element of the HEART score and short-term MACE incidence, none have demonstrated the extent of the individual impact or identified whether all the elements have the same influence on the incidence of MACE.

What is new in the current study

In this retrospective study that sought to clarify the relative prognostic value of each HEART score component for MACE occurrence within 3 months, we developed and validated the modified HEART score to maximize its ability to predict short-term major adverse cardiac events.

Fig. 1.

Flow diagram for the enrollment of patients. ED, emergency department; ECG, electrocardiography; STEMI, ST segment elevation myocardial infarction; MACE, major adverse cardiac events.

Fig. 2.

Comparison of the History, Electrocardiography, Age, Risk Factors, and Troponin (HEART), modified HEART (mHEART), and Thrombolysis in Myocardial Infarction (TIMI) scores in the derivation group.

Fig. 3.

Receiver operating characteristic curves for the History, Electrocardiography, Age, Risk Factors, and Troponin (HEART), modified HEART (mHEART), and Thrombolysis in Myocardial Infarction (TIMI) scores in the prediction of major adverse cardiac events incidence within 3 months. (A) Derivation group and (B) validation group.

Table 1.

Baseline characteristics of the patients with chest pain

Variable Derivation group (n = 809) Validation group (n = 298) P-value
Age (yr) 58 (47–70) 60 (48–72) 0.078
Sex, male 514 (63.5) 159 (53.4) 0.002
Comorbidities
 Hypertension 363 (44.9) 121 (40.6) 0.204
 Diabetes mellitus 155 (19.2) 54 (18.1) 0.695
 Obesity 24 (3.0) 8 (2.7) 0.810
 Dyslipidemia 165 (20.4) 74 (24.8) 0.112
 Atherosclerotic disease 176 (21.8) 61 (20.5) 0.644
Smoking 171 (21.1) 60 (20.1) 0.716
Aspirin use in the past 7 days 176 (21.8) 61 (20.5) 0.644
Family history of CAD 48 (5.9) 21 (7.1) 0.488
Initial vital signs
 Systolic blood pressure (mmHg) 140 (120–140) 140 (120–151) 0.756
 Diastolic blood pressure (mmHg) 80 (70–90) 80 (70–90) 0.811
 Heart rate (/min) 80 (70–95) 84 (70–92) 0.876
 Respiratory rate (/min) 20 (20–20) 20 (20–20) 0.123
Initial troponin-I 7 (4–10) 7 (4–10) 0.230

Values are presented as median (25th–75th percentiles) or number (%).

CAD, coronary artery disease.

Table 2.

Components of the HEART score and clinical outcomes

Variable Derivation group (n = 809) Validation group (n = 298) P-value
History < 0.001
 0 175 (21.6) 12 (4.0)
 1 578 (71.4) 278 (93.3)
 2 56 (6.9) 8 (2.7)
Electrocardiography 0.003
 0 312 (38.6) 146 (49.0)
 1 386 (47.7) 110 (36.9)
 2 111 (13.7) 42 (14.1)
Age (yr) 0.206
 0 174 (21.5) 50 (16.8)
 1 357 (44.1) 136 (45.6)
 2 278 (34.4) 112 (37.6)
Risk factors 0.087
 0 240 (29.7) 79 (26.5)
 1 334 (41.3) 145 (48.7)
 2 235 (29.0) 74 (24.8)
Initial troponin-I 0.327
 0 707 (87.4) 266 (89.3)
 1 38 (4.7) 16 (5.4)
 2 64 (7.9) 16 (5.4)
Risk classification 0.137
 Low risk (0–3) 348 (43.0) 125 (41.9)
 Moderate risk (4–6) 378 (46.7) 153 (51.3)
 High risk (7–10) 83 (6.7) 20 (6.7)
MACE in 3 months 104 (12.9) 38 (12.8) 0.963

Values are presented as number (%).

HEART, History, Electrocardiography, Age, Risk Factors, and Troponin; MACE, major adverse cardiac events.

Table 3.

Univariate and multivariate analyses of the HEART score components in the derivation group

Variable Univariate analysis P-value Multivariate analysis P-value
OR (95% CI) OR (95% CI)
History
 0 1 - 1 -
 1 5.987 (2.154–16.636) 0.001 6.564 (1.932–22.302) 0.003
 2 45.917 (14.961–140.927) < 0.001 58.719 (14.576–236.552) < 0.001
Electrocardiography
 0 1 - 1 -
 1 1.114 (0.604–2.052) 0.730 0.812 (0.391–1.687) 0.577
 2 17.497 (9.649–31.729) < 0.001 7.723 (3.623–16.466) < 0.001
Age (yr)
 0 1 - - -
 1 2.302 (1.194–4.435) 0.013 - -
 2 2.269 (1.155–4.457) 0.017 - -
Risk factors
 0 1 - 1 -
 1 2.779 (1.351–5.716) 0.005 2.552 (0.943–6.907) 0.065
 2 7.537 (3.746–15.164) < 0.001 5.562 (2.077–14.890) < 0.001
Initial troponin-I
 0 1 - 1 -
 1 13.898 (6.850–28.198) < 0.001 7.857 (3.274–18.851) < 0.001
 2 31.619 (17.247–57.967) < 0.001 23.668 (11.146–50.256) < 0.001

HEART, History, Electrocardiography, Age, Risk Factors, and Troponin; OR, odds ratio; CI, confidence interval.

Table 4.

The modified HEART score for chest pain

Component Grading Score
History Slightly suspicious or non-suspicious 0
Moderately suspicious 1
Highly suspicious 2
Electrocardiography Normal 0
Nonspecific repolarization disturbance 1
Significant ST-depressions 2
Risk factors No known risk factors 0
1–2 risk factors 1
≥ 3 risk factorsa) or history of atherosclerotic diseaseb) 2
Troponin-I ≤ 1 × normal limit 0
1–3 × normal limit 1
≥ 3 × normal limit 2
Range 0–8

HEART, History, Electrocardiography, Age, Risk Factors, and Troponin.

a)

Risk factors: diagnosed hypertension, diagnosed hyperlipidemia, diagnosed diabetes mellitus, family history of coronary artery disease, current smoking status (<90 days), and obesity (body mass index ≥30 kg/m2).

b)

History of atherosclerotic disease: myocardial infarction, percutaneous intervention, coronary artery bypass graft, ischemic stroke, peripheral arterial disease, or carotid artery disease.

Table 5.

Cutoff values for the HEART, mHEART, and TIMI scores in the validation group

Variables Cutoff value of low risk Sensitivity (%) Specificity (%) PPV (%) NPV (%) P-valuea)
HEART score ≤3 97.4 47.7 21.4 99.2 < 0.001
mHEART score ≤2 97.4 54.2 23.7 99.3 < 0.001
TIMI score 0 97.4 49.6 22.0 99.2 < 0.001

HEART, History, Electrocardiography, Age, Risk Factors, and Troponin; mHEART, modified HEART; TIMI, Thrombolysis in Myocardial Infarction; PPV, positive predictive value; NPV, negative predictive value.

a)

Mann–Whitney U test.

Table 6.

Comparison of the incidence of MACE between low- and intermediate/high-risk groups in the validation group

MACE in 3 months Low risk (mHEART score ≤ 2) (n = 142) Intermediate/high risk (mHEART score ≥ 3) (n = 156) P-value
AMI 1 (0.7) 33 (21.2) < 0.001
PCI 1 (0.7) 31 (19.9) < 0.001
CABG 0 (0) 3 (1.9) 0.249
All-cause mortality 0 (0) 3 (1.9) 0.249
Overall 1 (0.7) 37 (23.7) < 0.001

Values are presented as number (%).

MACE, major adverse cardiac events; mHEART, modified History, Electrocardiography, Age, Risk Factors, and Troponin; AMI, acute myocardial infarction; CABG, coronary artery bypass graft.