Information Cut for Clustering using a Gradient Descent Approach (2009)
Robert Jenssen, Deniz Erdogmus, Jose C. Principe, Torbjørn Eltoft
We introduce a new graph cut for clustering which we call the Information Cut. It is derived using Parzen windowing to estimate an information theoretic distance measure between probability density...
The Laplacian Classifier (2009)
Robert Jenssen, Deniz Erdogmus, Jose C. Principe, Torbjørn Eltoft
Abstract—We develop a novel classifier in a kernel feature space related to the eigenspectrum of the Laplacian data matrix. The classification cost function measures the angle between class mean...
Robert Jenssen, Deniz Erdogmus, Josec. Principefellow, Torbjørn Eltoft
Abstract — Recent work has revealed a close connection between certain information theoretic divergence measures and properties of Mercer kernel feature spaces. Specifically, it has been proposed...
Robert Jenssen, Deniz Erdogmus, Josec. Principefellow, Torbjørn Eltoft
Abstract — Recent work has revealed a close connection between certain information theoretic divergence measures and properties of Mercer kernel feature spaces. Specifically, it has been proposed...
AN INFORMATION THEORETIC PERSPECTIVE TO KERNEL K-MEANS ∗ (2008)
Robert Jenssen, Torbjørn Eltoft
In this paper, we provide an information theoretic perspective to kernel K-means. We show that kernel K-means corresponds to maximizing an integrated squared error divergence measure between Parzen...
Information Theoretic Spectral Clustering (2008)
Robert Jenssen, Torbjørn Eltoft, Jose C. Principe
Abstract — We discuss a new information-theoretic framework for spectral clustering that is founded on the recently introduced Information Cut. A novel spectral clustering algorithm is proposed,...
Kernel Maximum Entropy Data Transformation and an Enhanced Spectral Clustering Algorithm (2008)
Robert Jenssen, Torbjørn Eltoft, Mark Girolami, Deniz Erdogmus
We propose a new kernel-based data transformation technique. It is founded on the principle of maximum entropy (MaxEnt) preservation, hence named kernel MaxEnt. The key measure is Renyi’s entropy...
Robert Jenssen, Deniz Erdogmus, Jose C. Principe, Torbjørn Eltoft
Abstract. This paper addresses the problem of efficient information theoretic, non-parametric data clustering. We develop a procedure for adapting the cluster memberships of the data patterns, in...
Cancelation of Continuous Wave Interferences in Loran-C Receivers using an Adaptive Predictor (2007)
Kjell Helge Strøm, Torbjørn Eltoft, Kjell Helge, Strm Torbjrn Eltoft
A new approach for cancelling carrier wave interference signals in Loran-C receivers is presented. The system, which we have called an Adaptive Predictor Interference Canceler, is based on a linear...
In this paper we introduce a new method for filling in gaps in a time series belonging to a set of simultaneously recorded, statistically dependent signals. By combining the properties of the...
Sparse Code Shrinkage Based on the Normal Inverse Gaussian Density Model (2007)
Robert Jenssen, Tor Arne Øig˚ard, Torbjørn Eltoft, Alfred Hanssen
In this paper we introduce the recent normal inverse Gaussian (NIG) probability density as a new model for sparsely coded data. The NIG density is a flexible, four-parameter density, which is highly...
Some Equivalences between Kernel Methods and Information Theoretic Methods (2006)
Robert Jenssen, Deniz Erdogmus, Jose C. Principe, Torbjørn Eltoft
Abstract. In this paper, we discuss some equivalences between two recently introduced statistical learning schemes, namely Mercer kernel methods and information theoretic methods. We show that Parzen...
The Laplacian PDF Distance: A Cost Function for Clustering in a Kernel Feature Space (2005)
Robert Jenssen, Deniz Erdogmus, Jose Principe, Torbjørn Eltoft
A new distance measure between probability density functions (pdfs) is introduced, which we refer to as the Laplacian pdf distance. The Laplacian pdf distance exhibits a remarkable connection to...
The Laplacian Spectral Classifier (2005)
Robert Jenssen, Deniz Erdogmus, Jose C. Principe, Torbjørn Eltoft
We develop a novel classifier in a kernel feature space defined by the eigenspectrum of the Laplacian data matrix. The classification cost function is derived from a distance measure between...
Eltoft: ICA filter bank for segmentation of textured images (2003)
Robert Jenssen, Torbjørn Eltoft
Independent component analysis (ICA) of textured images is presented as a computational technique for creating a new data dependent filter bank for use in texture segmentation. We show that the ICA...
Clustering using Renyi's Entropy (2003)
Robert Jenssen Kenneth, Deniz Erdogmus, Jose C. Principe, Torbjørn Eltoft
We propose a new clustering algorithm using Renyi's entropy as our similarity metric. The main idea is to assign a data pattern to the cluster, which among all possible clusters, increases its...
For Segmentation Of, Robert Jenssen, Torbjørn Eltoft
Independent component analysis (ICA) of textured images is presented as a computational technique for creating a new data dependent filter bank for use in texture segmentation. We show that the ICA...
Sparse Code Shrinkage Based On (2001)
The Normal Inverse, Robert Jenssen, Tor Arne Øig˚ard, Torbjørn Eltoft, Alfred Hanssen
In this paper we introduce the recent normal inverse Gaussian (NIG) probability density as a new model for sparsely coded data. The NIG density is a flexible, four-parameter density, which is highly...