Presented at the Cognitive Models and Artificial Intelligence Conference (BMYZ2023), Ankara, Türkiye, Oct 26, 2023

SETSCI Conference Proceedings, 2023, 15, Page (s): 18-21 , https://doi.org/10.36287/setsci.6.1.010

Published Date: 29 December 2023    | 1187     1

Multiple Birth Support Vector Machines (MB-SVM) were introduced as a powerful extension of SVM. Although the basic idea is like SVM, optimal non-parallel hyperplanes are used for each class category. One may find different implementations of this approach in the literature. One of these is the Least Squares MB-SVM. An appealing property of this implementation is that an analytical solution is obtained that is used for classification. On the other hand, this solution involves matrix computations of sizes depending on the number of attributes and the size of the data set. In this study, we propose to use the k-means clustering algorithm before applying the Least Squares MB-SVM algorithm to improve the computational performance of MB-SVM. The preliminary results with the Iris data set indicate that by using only a small number of examples obtained from the k-means clusters, comparable performance can be obtained with the LS-MB-SVM method.

Keywords - support vector machine, multiple birth, k-means

V. Vapnik and A. Chervonenkis, Theory of Pattern Recognition, Nauka, Moscow, 1974.

G. Arslan, U. Madran, and D. Soyoğlu. “An Algebraic Approach to Clustering and Classification with Support Vector Machines,” Mathematics, 10.1: 128, Jan. 2022.

Jayadeva, R. Khemchandani, and S. Chandra, “Twin Support Vector Machines for Pattern Classification”, IEEE Transactions on Pattern Analysis and Machine Intelligence., vol. 29 (5), pp. 905–910, May 2007.

Z.-X. Yang, Y.-H. Shao, and X.-S Zhang, “Multiple birth support vector machine for multi-class classification” Neural Comput & Applic, 22 (Suppl 1), 153-161, 2013. doi: 10.1007/s00521-012-1108-x

S.-G. Chen and X.-J Wu, “Multiple birth least squares support vector machine for multi-class classification” Int. J. Mach. Learn. & Cyber. 8, 1731-1742, 2017. doi: 10.1007/s13042-016-0554-7

J. Wang, X. Wu, and C. Zhang, “Support vector machines based on K-means clustering for real-time business intelligence systems”, International Journal of Business Intelligence and Data Mining, 1(1), 54-64, 2005.

R. A. Fisher (1988) Iris. UCI Machine Learning Repository. https://doi.org/10.24432/C56C76.

R Core Team (2020). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL https://www.R-project.org/

Dimitriadou, E.; Hornik, K.; Leisch, F.; Chang, C.-C.; Lin, C.-C. Package ‘e1071’. R Software Package. Available online: https://cran.r-project.org/web/packages/e1071 (accessed on 14 August 2021).