Support Vector Machine (SVM), since first proposed by Vapnik and his group at AT\&T laboratory has been extensively studied and discussed to develop its working principle of classification and regression. As a result, different types of SVM and
SVM Aggregation: SVM, SVM Ensemble, SVM Classification Tree
By Shaoning Pang
1. Introduction
Support Vector Machine (SVM), since first proposed by Vapnik and his group at AT\&T laboratory has been extensively studied and discussed to develop its working principle of classification and regression. As a result, different types of SVM and SVM extensions [1] have been proposed. Suykens introduced the quadratic cost function in SVM and proposed LSSVM (Least Squares Support Vector Machine). Mangasarian et al. used an implicit Lagrangian reformulation in SVM, and proposed LSVM (Lagrangian Support Vector Machine) and NSVM (Newton Support Vector Machine). Later, Lee and Mangasarian used a smooth unconstrained optimization in SVM, and had SSVM (Smooth Support Vector Machine). Recently, new interesting SVM models were published, such as, Chun-fu Lin's FSVM (Fuzzy Support Vector Machine). Zhang et al proposed HSSVMs (Hidden Space Support Vector Machines). Shilton et al. proposed an incremental version of SVM. All these SVM types have significantly enhanced the original SVM performance. Most importantly, they have applied the original SVM to suit different real application needs.
SVM aggregation, as an alternative aspect of SVM study, specializes on combining a family of concurrent SVMs for advanced artificial intelligence. The well known SVM aggregation methods are the One-against-all and One-against-one methods. The purpose of such aggregations is to expand SVM binary classification to multi-class classification. A typical procedure of SVM aggregation can be summarized as three steps, SVM model selection, convex aggregation, and aggregation training.
Over the last 5 years, I have been working on SVM aggregation, and have developed the original single SVM classification in our previous work, to SVM ensemble for classification, SVM classification tree (including 2-class SVM tree (2-SVMT), and Multi-class SVMT tree (m-SVMT)). Evolving SVM classification tree is an ongoing research topic of adapting SVMTto the incremental learning of data stream by evolving SVM and SVM tree structure.
2. SVM Ensemble
In SVM ensemble, individual SVMs are aggregated to make a collective decision in several ways such as the majority voting, least-squares estimation-based weighting, and the double layer hierarchical combing. The training SVM ensemble can be conducted in the way of bagging or boosting. In bagging, each individual SVM is trained independently using the randomly chosen training samples via a boostrap technique. In boosting, each individual SVM is trained using the training samples chosen according to the sample’s probability distribution that is updated in proportion to the error in the sample. SVM ensemble is essentially a type of cross-validation optimization of single SVM, having a more stable classification performance than other models. The details on SVM ensemble construction and application are described in [2,3].
SVM Aggregating Intelligence SVM, SVM Ensemble, SVM Classification Tree, and...At the first level research, the well known SVM aggregation methods are ...
A distributed SVM ensemble for image classification and annotation_互联网_IT... SVM Aggregation SVM, S... 暂无评价 5页 免费2014 Baidu 使用百度前...
SVM decision boundary ... 35页 免费 SVM Aggregation SVM, S... 暂无...D2 = “Text classification for unstructured data on the web” T = {this...
Semantic parsing with structured SVM ensemble classification models_专业资料。... and the aggregation method is based on a switching model using subtrees ...
(Classification And Regression Tree) Bagging(bootstrap , aggregation), Random...于是引入 ensemble classifiers: bagging, random forest, 和 boosting。 一般的,...
SVM decision boundary ... 35页 免费 SVM Aggregation SVM, S... 暂无...(0.0000000 1.0000000) * Classification tree: rpart(formula = Cluster ~ ....
Classification by decision tree induction ? ? ? ? ? Other classification methods Ensemble methods Prediction Accuracy and error measures Summary ? ? ? ...
Infinite Latent SVM for Classification and Multi-task Learning_计算机软件及应用_IT/计算机_专业资料。In?nite Latent SVM for Classi?cation and Multi-task ...
Diversified SVM Ensemble... 暂无评价 9页 免费 ... SVM Classification Metho... 暂无评价 10页 免费...a SVM is trained on the nodes of each tree. ...
lib svm 入门 tutorial 简... 8页 1财富值 A practical guide to SVM... 12页 免费 A Short SVM (Support Vec... 6页 1财富值 Classification ...
热门文档