Optimized Decision Tree for Heart Failure Classification: Balancing Interpretability and Predictive Performance on Clinical Data
DOI:
https://doi.org/10.51903/ana03n66Keywords:
Heart Failure Classification, Machine Learning, Decision Tree, Interpretability, Clinical ScreeningAbstract
Spotting heart failure (HF) early is super essential for reducing illness and death. Methods using machine learning, especially tree-based methods for sorting, are looking promising for helping doctors make choices by identifying which patients are at risk using standard clinical info. This research is about creating and testing a Decision Tree model to classify heart failure patients using a clinical dataset accessible to anyone. We use careful prep work (dealing with missing info, making things the right size, and picking out what’s important), followed by teaching the model online by using a clever way of speeding up the data and making sure our performance measures are solid. We evaluate the model’s performance using metrics such as accuracy, precision, recall, F1-score, and the area under the ROC curve (AUC). Our tests show that a Decision Tree that’s been tweaked just right does an outstanding job of sorting things and has the bonus of being easy to understand—which is key for doctors to actuauseecause it makes clear rules that doctors can look at. The research also looks at how the Decision Tree did compare to what other machine learning studies have found on heart data recently, pointing out the compromises between being simple and easy to understand versus how well it predicts in more complex or hard-to-understand models. What this paper adds to the table using a Decision Tree with data that’s free for anyone to use, (1) a set of rules that makes sense and can be turned into simple checks for doctors to use, and (3) a real-world comparison to basic ML ways that have been talked about in other papers. The results suggest that Decision Tree models could be a helpful and easy-to-understand tool for doing early checks for HF when there aren’t a lot of resources.
References
[1] D. Chicco and G. Jurman, “Machine Learning Can Predict Survival of Patients with Heart Failure from Serum Creatinine and Ejection Fraction Alone,” BMC Med. Inform. Decis. Mak., vol. 20, no. 1, pp. 16-, Feb. 2020, doi: 10.1186/s12911-020-1023-5.
[2] A. Sepharni, I. E. Hendrawan, C. Rozikin, and S. Karawang, “Klasifikasi Penyakit Jantung dengan Menggunakan Algoritma C4.5,” STRING (Satuan Tulisan Ris. dan Inov. Teknol., vol. 7, no. 2, pp. 117–126, Dec. 2022, doi: 10.30998/string.v7i2.12012.
[3] M. M. Ahsan, S. A. Luna, and Z. Siddique, “Machine-Learning-Based Disease Diagnosis: A Comprehensive Review,” Healthcare, vol. 10, no. 3, p. 541, Mar. 2022, doi: 10.3390/healthcare10030541.
[4] F. Goretti, B. Oronti, M. Milli, and E. Iadanza, “Deep Learning for Predicting Congestive Heart Failure,” Electronics, vol. 11, no. 23, p. 3996, Dec. 2022, doi: 10.3390/electronics11233996.
[5] M. Ozcan and S. Peker, “A Classification and Regression Tree Algorithm for Heart Disease Modeling and Prediction,” Healthc. Anal., vol. 3, p. 100130, Nov. 2023, doi: 10.1016/j.health.2022.100130.
[6] N. Nissa, S. Jamwal, and M. Neshat, “A Technical Comparative Heart Disease Prediction Framework Using Boosting Ensemble Techniques,” Computation, vol. 12, no. 1, p. 15, Jan. 2024, doi: 10.3390/computation12010015.
[7] R. A. El Arab et al., “Bridging the Gap: From AI Success in Clinical Trials to Real-World Healthcare Implementation—A Narrative Review,” Healthcare, vol. 13, no. 7, p. 701, Mar. 2025, doi: 10.3390/healthcare13070701.
[8] C. Metta, A. Beretta, R. Pellungrini, S. Rinzivillo, and F. Giannotti, “Towards Transparent Healthcare: Advancing Local Explanation Methods in Explainable Artificial Intelligence,” Bioengineering, vol. 11, no. 4, p. 369, Apr. 2024, doi: 10.3390/bioengineering11040369.
[9] E. Sblendorio, V. Dentamaro, A. Lo Cascio, F. Germini, M. Piredda, and G. Cicolini, “Integrating Human Expertise & Automated Methods for a Dynamic and Multi-Parametric Evaluation of Large Language Models’ Feasibility in Clinical Decision-Making,” Int. J. Med. Inform., vol. 188, p. 105501, Aug. 2024, doi: 10.1016/j.ijmedinf.2024.105501.
[10] J. Allgaier, L. Mulansky, R. L. Draelos, and R. Pryss, “How Does the Model Make predictions? A Systematic Literature Review on the Explainability Power of Machine Learning in Healthcare,” Artif. Intell. Med., vol. 143, p. 102616, Sep. 2023, doi: 10.1016/j.artmed.2023.102616.
[11] J. T. Santoso and B. Raharjo, “Innovation in Project Management Utilizing Machine Learning Technology,” J. Technol. Informatics Eng., vol. 2, no. 3, pp. 22–44, Dec. 2023, doi: 10.51903/jtie.v2i3.163.
[12] D. Adi, S. Rahardjo, M. Andriana, and S. H. Prasastono, “Consumer Behavior and Purchase Intentions: A Machine Learning-Based Sentiment Analysis of Social Media Data,” J. Manag. Informatics, vol. 3, no. 1, pp. 157–173, Apr. 2024, doi: 10.51903/jmi.v3i1.45.
[13] N. Rahmeisi, E. umar Gani, and A. Arfriandi, “Tinjauan Literatur: Pendekatan Machine Learning dalam Deteksi Serangan Web,” J. Ilm. Sist. Inf., vol. 4, no. 3, pp. 772–791, Nov. 2025, doi: 10.51903/3w0vwc80.
[14] C. A. ul Hassan et al., “Effectively Predicting the Presence of Coronary Heart Disease Using Machine Learning Classifiers,” Sensors, vol. 22, no. 19, p. 7227, Sep. 2022, doi: 10.3390/s22197227.
[15] D. Gala, H. Behl, M. Shah, and A. N. Makaryus, “The Role of Artificial Intelligence in Improving Patient Outcomes and Future of Healthcare Delivery in Cardiology: A Narrative Review of the Literature,” Healthcare, vol. 12, no. 4, p. 481, Feb. 2024, doi: 10.3390/healthcare12040481.
[16] A. Choudhury and O. Asan, “Impact of Accountability, Training, and Human Factors on the Use of Artificial Intelligence in Healthcare: Exploring the Perceptions of Healthcare Practitioners in the Us,” Hum. Factors Healthc., vol. 2, p. 100021, Dec. 2022, doi: 10.1016/j.hfh.2022.100021.
[17] Y. Wu, L. Zhang, U. A. Bhatti, and M. Huang, “Interpretable Machine Learning for Personalized Medical Recommendations: A LIME-Based Approach,” Diagnostics, vol. 13, no. 16, p. 2681, Aug. 2023, doi: diagnostics13162681.
[18] M. A. Alawsi, S. L. Zubaidi, N. S. S. Al-Bdairi, N. Al-Ansari, and K. Hashim, “Drought Forecasting: A Review and Assessment of the Hybrid Techniques and Data Pre-Processing,” Hydrology, vol. 9, no. 7, p. 115, Jun. 2022, doi: 10.3390/hydrology9070115.
[19] J.-C. ; Liu et al., “Unveiling the Potential: Remote Monitoring and Telemedicine in Shaping the Future of Heart Failure Management,” Life, vol. 14, no. 8, p. 936, Jul. 2024, doi: 10.3390/life14080936.
[20] M. M. Ali et al., “A Machine Learning Approach for Risk Factors Analysis and Survival Prediction of Heart Failure Patients,” Healthc. Anal., vol. 3, p. 100182, Nov. 2023, doi: 10.1016/j.health.2023.100182.
[21] M. S. Singh, K. Thongam, P. Choudhary, and P. K. Bhagat, “An Integrated Machine Learning Approach for Congestive Heart Failure Prediction,” Diagnostics, vol. 14, no. 7, p. 736, Mar. 2024, doi: 10.3390/diagnostics14070736.
[22] V. S. Yilmaz, M. Akdag, Y. Dalveren, R. O. Doruk, A. Kara, and A. Soylu, “Investigating the Impact of Two Major Programming Environments on the Accuracy of Deep Learning-Based Glioma Detection from MRI Images,” Diagnostics, vol. 13, no. 4, p. 651, Feb. 2023, doi: 10.3390/diagnostics13040651.
[23] N. G. Rezk, S. Alshathri, A. Sayed, and E. E. D. Hemdan, “Explainable AI for Chronic Kidney Disease Prediction in Medical IoT: Integrating GANs and Few-Shot Learning,” Bioengineering, vol. 12, no. 4, p. 356, Mar. 2025, doi: 10.3390/bioengineering12040356.
[24] A. I. Adler and A. Painsky, “Feature Importance in Gradient Boosting Trees with Cross-Validation Feature Selection,” Entropy, vol. 24, no. 5, p. 687, May 2022, doi: 10.3390/e24050687.
[25] Y. Wu et al., “Novel Binary Logistic Regression Model Based on Feature Transformation of XGBoost for Type 2 Diabetes Mellitus Prediction in Healthcare Systems,” Futur. Gener. Comput. Syst., vol. 129, pp. 1–12, Apr. 2022, doi: 10.1016/j.future.2021.11.003.
[26] I. Pantic and J. Paunovic Pantic, “Artificial Intelligence in Chromatin Analysis: A Random Forest Model Enhanced by Fractal and Wavelet Features,” Fractal Fract., vol. 8, no. 8, p. 490, Aug. 2024, doi: 10.3390/fractalfract8080490.
[27] Y. Aydın, C. Cakiroglu, G. Bekdaş, and Z. W. Geem, “Fatigue Predictive Modeling of Composite Materials for Wind Turbine Blades Using Explainable Gradient Boosting Models,” Coatings, vol. 15, no. 3, p. 325, Mar. 2025, doi: 10.3390/coatings15030325.
[28] F. Movahedi, R. Padman, and J. F. Antaki, “Limitations of Receiver Operating Characteristic Curve on Imbalanced Data: Assist Device Mortality Risk Scores,” J. Thorac. Cardiovasc. Surg., vol. 165, no. 4, pp. 1433-1442.e2, Apr. 2023, doi: 10.1016/j.jtcvs.2021.07.041.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Zaehol Fatah, Reza Atreji

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All articles published in this journal are open access and licensed under the terms of the Creative Commons Attribution-ShareAlike 4.0 International License (CC BY-SA 4.0).
Under this license:
-
Authors retain copyright of their work.
-
Others are free to:
-
Share — copy and redistribute the material in any medium or format;
-
Adapt — remix, transform, and build upon the material for any purpose, even commercially;
-
-
As long as they:
-
Give appropriate credit to the original author(s) and the source;
-
Provide a link to the license;
-
Indicate if changes were made;
-
Distribute their contributions under the same license as the original.
-
This ensures that derivative works will also remain free and open under the same terms.













.png)