Kernelising the Proportional Odds Model through Kernel Learning techniques

Research areas:

• Methodology - Machine learning

Year:

2015

Type of Publication:

Article

Keywords:

Proportional Odds Model, Ordered logit, Ordinal Regression, Ordinal Classification, Kernel Trick, Kernel Learning

Authors:

• Pérez-Ortiz, María
• Gutiérrez, Pedro Antonio
• Cruz-Ramírez, Manuel
• Sánchez-Monedero, Javier
• Hervás-Martínez, César

Journal:

Neurocomputing

Volume:

126

Pages:

23-33

ISSN:

0925-2312

BibTex:

@article{neucom-kpom2014, author = "Mar{\'i}a P{\'e}rez-Ortiz and Pedro Antonio Guti{\'e}rrez and Manuel Cruz-Ram{\'i}rez and Javier S{\'a}nchez-Monedero and C{\'e}sar Herv{\'a}s-Mart{\'i}nez", abstract = "The classification of patterns into naturally ordered labels is referred to as ordinal regression, which is a very common setting for real world applications. One of the most widely used ordinal regression algorithms is the Proportional Odds Model (POM), despite the linearity of the resultant decision boundaries. Through different proposals, this paper explores the notions of kernel trick and empirical feature space to reformulate the POM method and obtain nonlinear decision boundaries. Moreover, a new technique for aligning the kernel matrix taking into account the ordinal problem information is proposed, as well as a regularised gradient ascent methodology which is used to select the optimal dimensionality for the empirical feature space. The capability of the different developed methodologies is evaluated by the use of a nonlinearly separable toy dataset and an extensive set of experiments over 28 ordinal datasets. The results indicate that the tested methodologies are competitive with respect to other state-of-the-art algorithms, and they significantly improve the original POM algorithm. ", awards = "JCR(2015): 2.392 Position: 31/130 (Q1) Category: COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE", comments = "JCR(2015): 2.392 Position: 31/130 (Q1) Category: COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE", doi = "10.1016/j.neucom.2014.09.085", issn = "0925-2312", journal = "Neurocomputing", keywords = "Proportional Odds Model, Ordered logit, Ordinal Regression, Ordinal Classification, Kernel Trick, Kernel Learning", note = "JCR(2015): 2.392 Position: 31/130 (Q1) Category: COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE", pages = "23--33", title = "{K}ernelising the {P}roportional {O}dds {M}odel through {K}ernel {L}earning techniques", url = "http://www.uco.es/grupos/ayrna/index.php/es/neucom-kpom", volume = "126", year = "2015", }

Note:

JCR(2015): 2.392 Position: 31/130 (Q1) Category: COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE

Abstract:

The classification of patterns into naturally ordered labels is referred to as ordinal regression, which is a very common setting for real world applications. One of the most widely used ordinal regression algorithms is the Proportional Odds Model (POM), despite the linearity of the resultant decision boundaries. Through different proposals, this paper explores the notions of kernel trick and empirical feature space to reformulate the POM method and obtain nonlinear decision boundaries. Moreover, a new technique for aligning the kernel matrix taking into account the ordinal problem information is proposed, as well as a regularised gradient ascent methodology which is used to select the optimal dimensionality for the empirical feature space. The capability of the different developed methodologies is evaluated by the use of a nonlinearly separable toy dataset and an extensive set of experiments over 28 ordinal datasets. The results indicate that the tested methodologies are competitive with respect to other state-of-the-art algorithms, and they significantly improve the original POM algorithm.

Comments:

JCR(2015): 2.392 Position: 31/130 (Q1) Category: COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE