Kernel Matrix-Based Heuristic Multiple Kernel Learning

oleh: Stanton R. Price, Derek T. Anderson, Timothy C. Havens, Steven R. Price

Format: Article
Diterbitkan: MDPI AG 2022-06-01

Deskripsi

Kernel theory is a demonstrated tool that has made its way into nearly all areas of machine learning. However, a serious limitation of kernel methods is knowing which kernel is needed in practice. <i>Multiple kernel learning</i> (MKL) is an attempt to learn a new tailored kernel through the aggregation of a set of valid known kernels. There are generally three approaches to MKL: fixed rules, heuristics, and optimization. Optimization is the most popular; however, a shortcoming of most optimization approaches is that they are tightly coupled with the underlying objective function and overfitting occurs. Herein, we take a different approach to MKL. Specifically, we explore different divergence measures on the values in the kernel matrices and in the <i>reproducing kernel Hilbert space</i> (RKHS). Experiments on benchmark datasets and a computer vision feature learning task in explosive hazard detection demonstrate the effectiveness and generalizability of our proposed methods.