Comparison of Support Vector Machine, Random Forest and XGBoost for Sentiment Analysis on Indodax

Moch. Alfarros Difa Naufalino; Muhammad Al-husaini; Rianto Rianto

doi:10.47709/cnahpc.v7i2.5894

Authors

Moch. Alfarros Difa Naufalino Siliwangi University
Muhammad Al-husaini Siliwangi University
Rianto Siliwangi University

DOI:

https://doi.org/10.47709/cnahpc.v7i2.5894

Keywords:

Feature Selection Chi-Square, Machine Learning, Sentiment Analysis, Support Vector Machine, Random Forest, XGBoost

Abstract

The rapid growth of digital assets like Bitcoin and cryptocurrencies has increased the need for secure trading platforms such as Indodax. With the growing number of users, reviews on platforms like Google Play Store provide valuable insights into user experience and satisfaction. This research applies Machine Learning methods to classify user review sentiments by comparing three main algorithms Support Vector Machine (SVM), Random Forest, and Extreme Gradient Boosting (XGBoost). One of the main challenge in sentiment analysis is the presence of irrelevant or redundant features, which can reduce model accuracy and increase computational costs. The Feature Selection Chi-Square technique is used to filter the most influential features, enhancing model efficiency without losing critical information. Experimental results show that SVM delivers the best performance compared to Random Forest and XGBoost. Before applying Chi-Square, SVM achieved 91% accuracy, which increased to 94% after applying the feature selection technique. The number of features used was reduced from 52,312 to 2,000 without significant information loss. This combination of SVM and Feature Selection Chi-Square proves to be an efficient and accurate solution for analyzing user sentiment on crypto trading platforms like Indodax. This method is expected to improve the responsiveness of trading applications to user needs and serve as a foundation for further research in Machine Learning-based sentiment analysis.

Downloads

Download data is not yet available.

References

Afriyani, S., Surono, S., & Solihin, I. M. (2024). Chi-Square Feature Selection with Pseudo-Labelling in Natural Language Processing. JTAM (Jurnal Teori Dan Aplikasi Matematika), 8(3), 896. https://doi.org/10.31764/jtam.v8i3.22751

Aida Sapitri, I., Fikry, M., Sains dan Teknologi, F., & Islam Negeri Sultan Syarif Kasim Riau, U. (2023). PENGKLASIFIKASIAN SENTIMEN ULASAN APLIKASI WHATSAPP PADA GOOGLE PLAY STORE MENGGUNAKAN SUPPORT VECTOR MACHINE. Jurnal TEKINKOM, 6(1). https://doi.org/10.37600/tekinkom.v6i1.773

Bhoria, H., Dhankhar, A., & Solanki, K. (2023). INDIAN JOURNAL OF SCIENCE AND TECHNOLOGY Chi-Square Feature Selection Technique for Student’s performance prediction. / Indian Journal of Science and Technology, 16(38), 3250–3257. https://doi.org/10.17485/IJST/v16i38.921

Chen Sami, D., Sugiharto, A., & Jie, F. (2024). CHI SQUARE FEATURE SELECTION FOR IMPROVING SENTIMENT ANALYSIS OF NEWS DATA PRIVACY TREATS. Journal of Theoretical and Applied Information Technology, 102(18). www.jatit.org

Erkamim, M., Suswadi, S., Subarkah, M. Z., & Widarti, E. (2023). Komparasi Algoritme Random Forest dan XGBoosting dalam Klasifikasi Performa UMKM. Jurnal Sistem Informasi Bisnis, 13(2), 127–134. https://doi.org/10.21456/vol13iss2pp127-134

Ernayanti, T., Mustafid, M., Rusgiyono, A., & Hakim, A. R. (2023). PENGGUNAAN SELEKSI FITUR CHI-SQUARE DAN ALGORITMA MULTINOMIAL NAÏVE BAYES UNTUK ANALISIS SENTIMEN PELANGGGAN TOKOPEDIA. Jurnal Gaussian, 11(4), 562–571. https://doi.org/10.14710/j.gauss.11.4.562-571

Mat, S. R. T., Razak, M. F. A., Kahar, M. N. M., Arif, J. M., & Firdaus, A. (2022). A Bayesian probability model for Android malware detection. ICT Express, 8(3), 424–431. https://doi.org/10.1016/j.icte.2021.09.003

Nurtikasari, Y., Syariful Alam, & Teguh Iman Hermanto. (2022). Analisis Sentimen Opini Masyarakat Terhadap Film Pada Platform Twitter Menggunakan Algoritma Naive Bayes. INSOLOGI: Jurnal Sains Dan Teknologi, 1(4), 411–423. https://doi.org/10.55123/insologi.v1i4.770

Oktavia, D., Ramadahan, Y. R., & Minarto. (2023). Analisis Sentimen Terhadap Penerapan Sistem E-Tilang Pada Media Sosial Twitter Menggunakan Algoritma Support Vector Machine (SVM). KLIK: Kajian Ilmiah Informatika Dan Komputer, 4(1), 407–417. https://doi.org/10.30865/klik.v4i1.1040

Pasek, P., Mahawardana, O., Sasmita, G. A., Agus, P., & Pratama, E. (2022). Analisis Sentimen Berdasarkan Opini dari Media Sosial Twitter terhadap “Figure Pemimpin” Menggunakan Python. In JITTER-Jurnal Ilmiah Teknologi dan Komputer (Vol. 3, Issue 1).

Permana, M. A., Widiastuti, S., & Saepudin, S. (2023). ANALISIS SENTIMEN PENGGUNAAN APLIKASI VIDEO CONFERENCE PADA ULASAN GOOGLE PLAY STOREMENGGUNAKAN METODE NBC (NAIVE BAYES CLASSIFIER). JURSISTEKNI (Jurnal Sistem Informasi Dan Teknologi Informasi), 178–191.

Petronella Purba, M., & Transver Wijaya, Y. (n.d.). Analisis Basic Emotion Masyarakat Pada Masa Pandemi COVID-19 dengan Metode LSTM-FastText………….…(Purba dan Wijaya) Analisis Basic Emotion Masyarakat Pada Masa Pandemi COVID-19 di Media Sosial Twitter Dengan Metode LSTM-FastText (Basic Emotion Analysis Of Community During The Covid-19 Pandemic On Twitter Social Media Using The LSTM-FastText Method).

Putri, D. J., Dwifebri, M., & Adiwijaya, A. (2023). Text Classification of Indonesian Translated Hadith Using XGBoost Model and Chi-Square Feature Selection. Building of Informatics, Technology and Science (BITS), 4(4). https://doi.org/10.47065/bits.v4i4.2944

Putri, N. B., & Wijayanto, A. W. (2022). Analisis Komparasi Algoritma Klasifikasi Data Mining Dalam Klasifikasi Website Phishing. Komputika?: Jurnal Sistem Komputer, 11(1), 59–66. https://doi.org/10.34010/komputika.v11i1.4350

Repina Kesuma, P., Dewi, T., Kusumanto, R. D., Risma, P., Oktarina, Y., Elektro, J. T., Sriwijaya, N., & Id, T. C. (2020). JOURNAL OF APPLIED SMART ELECTRICAL NETWORK AND SYSTEMS (JASENS) Desain Fuzzy Logic Controller Untuk Pengendali Pergerakan Mobile Manipulator (Vol. 1, Issue 1). http://journal.isas.or.id/index.php/JASENS

Rivanie, T., Pebrianto, R., Hidayat, T., Bayhaqy, A., Gata, W., & Novitasari, B. (2021). ANALISIS SENTIMEN TERHADAP KINERJA MENTERI KESEHATAN INDONESIA SELAMA PANDEMI COVID-19. In Jurnal Informatika (Vol. 21, Issue 1).

Sartina Jayanti, T., Habibi, C., & Setiana, E. (n.d.). Analisis Sentimen Penggunaan Aplikasi Traveloka di Twitter Menggunakan Model Klasifikasi. 2024.

Sunarko, G. S., Wasino, ), & Sutrisno, T. (2023). KLASTERISASI SENTIMEN ULASAN PENGGUNA APLIKASI BCA MOBILE PADA PLATFORM GOOGLE PLAY STORE DENGAN ALGORITMA K-MEANS CLUSTERING.

Tasnim, F., & Habiba, S. U. (2021). A Comparative Study on Heart Disease Prediction Using Data Mining Techniques and Feature Selection. International Conference on Robotics, Electrical and Signal Processing Techniques, 338–341. https://doi.org/10.1109/ICREST51555.2021.9331158

Wahyudi, R., Kusumawardhana, G., Purwokerto, A., Letjend, J., Soemarto, P., Purwanegara, K., Purwokerto, T., & Banyumas, K. (2021). Analisis Sentimen pada review Aplikasi Grab di Google Play Store Menggunakan Support Vector Machine. JURNAL INFORMATIKA, 8(2). http://ejournal.bsi.ac.id/ejurnal/index.php/ji

Yasir, M., Grace Haque, M., Suraji, R., & Author, C. (n.d.). Analisis Sentimen Terhadap Kontroversi Fatwa MUI Nomor 83 Tahun 2023 Tentang Pemboikotan Produk yang Terafiliasi Israel. 2024. https://doi.org/10.31933/jemsi.v5i4

Yudha, I. G. L., Sanjaya ER, N. A., Karyawati, A. A. I. N. E., Dwidasmara, I. B. G., Putra, I. G. N. A. C., & Mahendra, I. B. M. (2022). Article Classification Using Convolutional Neural Network (CNN) And Chi-Square Feature Selection. JELIKU (Jurnal Elektronik Ilmu Komputer Udayana), 11(3), 529.