Probabilistic Approach to One-Class Support Vector Machine

Abstract : Classification is one of the main problem addressed by machine learning algorithms. Among them the Support Vector Machine (SVM) has attracted a lot of interest and shown success in the past decades. SVM are originally tailored for binary classification. If we have only a few example of negative dataset we can turn to one-class SVM. In this paper we propose a probabilistic interpretation of the one-class SVM approach and an extension especially adapted in the case of highly imbalanced dataset. Indeed, we consider a binary classification problem where we represent the negative dataset by its two first moments, while still modeling the positive class by individual examples. The optimization problem is shown to have an equivalent formulation to a one-class SVM applied to the positive dataset after some preprocess-ing. The usual one-class SVM corresponding to the case where the negative class has mean 0 and identity variance. We show empirically, on a protein classification task and a text classification task, that our approach achieves similar statistical performance than the two mainstream approaches to imbalanced classification problems , while being more computationally efficient .
Type de document :
Pré-publication, Document de travail
2016
Liste complète des métadonnées

Littérature citée [36 références]  Voir  Masquer  Télécharger

https://hal-enpc.archives-ouvertes.fr/hal-01404973
Contributeur : Vincent Leclère <>
Soumis le : lundi 5 décembre 2016 - 15:20:18
Dernière modification le : vendredi 1 décembre 2017 - 01:19:12
Document(s) archivé(s) le : lundi 20 mars 2017 - 22:24:51

Fichier

aistats2017b-hal.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01404973, version 1

Collections

Citation

Vincent Leclère, Edouard Grave, Laurent El Ghaoui. Probabilistic Approach to One-Class Support Vector Machine. 2016. 〈hal-01404973〉

Partager

Métriques

Consultations de la notice

285

Téléchargements de fichiers

303