Header logo is


2003


no image
Concentration Inequalities for Sub-Additive Functions Using the Entropy Method

Bousquet, O.

Stochastic Inequalities and Applications, 56, pages: 213-247, Progress in Probability, (Editors: Giné, E., C. Houdré and D. Nualart), November 2003 (article)

Abstract
We obtain exponential concentration inequalities for sub-additive functions of independent random variables under weak conditions on the increments of those functions, like the existence of exponential moments for these increments. As a consequence of these general inequalities, we obtain refinements of Talagrand's inequality for empirical processes and new bounds for randomized empirical processes. These results are obtained by further developing the entropy method introduced by Ledoux.

ei

PostScript [BibTex]

2003


PostScript [BibTex]


no image
Statistical Learning Theory, Capacity and Complexity

Schölkopf, B.

Complexity, 8(4):87-94, July 2003 (article)

Abstract
We give an exposition of the ideas of statistical learning theory, followed by a discussion of how a reinterpretation of the insights of learning theory could potentially also benefit our understanding of a certain notion of complexity.

ei

Web DOI [BibTex]


no image
Dealing with large Diagonals in Kernel Matrices

Weston, J., Schölkopf, B., Eskin, E., Leslie, C., Noble, W.

Annals of the Institute of Statistical Mathematics, 55(2):391-408, June 2003 (article)

Abstract
In kernel methods, all the information about the training data is contained in the Gram matrix. If this matrix has large diagonal values, which arises for many types of kernels, then kernel methods do not perform well: We propose and test several methods for dealing with this problem by reducing the dynamic range of the matrix while preserving the positive definiteness of the Hessian of the quadratic programming problem that one has to solve when training a Support Vector Machine, which is a common kernel approach for pattern recognition.

ei

PDF DOI [BibTex]

PDF DOI [BibTex]


no image
The em Algorithm for Kernel Matrix Completion with Auxiliary Data

Tsuda, K., Akaho, S., Asai, K.

Journal of Machine Learning Research, 4, pages: 67-81, May 2003 (article)

ei

PDF [BibTex]

PDF [BibTex]


no image
Constructing Descriptive and Discriminative Non-linear Features: Rayleigh Coefficients in Kernel Feature Spaces

Mika, S., Rätsch, G., Weston, J., Schölkopf, B., Smola, A., Müller, K.

IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(5):623-628, May 2003 (article)

Abstract
We incorporate prior knowledge to construct nonlinear algorithms for invariant feature extraction and discrimination. Employing a unified framework in terms of a nonlinearized variant of the Rayleigh coefficient, we propose nonlinear generalizations of Fisher‘s discriminant and oriented PCA using support vector kernel functions. Extensive simulations show the utility of our approach.

ei

DOI [BibTex]

DOI [BibTex]


no image
Tractable Inference for Probabilistic Data Models

Csato, L., Opper, M., Winther, O.

Complexity, 8(4):64-68, April 2003 (article)

Abstract
We present an approximation technique for probabilistic data models with a large number of hidden variables, based on ideas from statistical physics. We give examples for two nontrivial applications. © 2003 Wiley Periodicals, Inc.

ei

PDF GZIP Web [BibTex]

PDF GZIP Web [BibTex]


no image
Feature selection and transduction for prediction of molecular bioactivity for drug design

Weston, J., Perez-Cruz, F., Bousquet, O., Chapelle, O., Elisseeff, A., Schölkopf, B.

Bioinformatics, 19(6):764-771, April 2003 (article)

Abstract
Motivation: In drug discovery a key task is to identify characteristics that separate active (binding) compounds from inactive (non-binding) ones. An automated prediction system can help reduce resources necessary to carry out this task. Results: Two methods for prediction of molecular bioactivity for drug design are introduced and shown to perform well in a data set previously studied as part of the KDD (Knowledge Discovery and Data Mining) Cup 2001. The data is characterized by very few positive examples, a very large number of features (describing three-dimensional properties of the molecules) and rather different distributions between training and test data. Two techniques are introduced specifically to tackle these problems: a feature selection method for unbalanced data and a classifier which adapts to the distribution of the the unlabeled test data (a so-called transductive method). We show both techniques improve identification performance and in conjunction provide an improvement over using only one of the techniques. Our results suggest the importance of taking into account the characteristics in this data which may also be relevant in other problems of a similar type.

ei

Web [BibTex]


no image
Use of the Zero-Norm with Linear Models and Kernel Methods

Weston, J., Elisseeff, A., Schölkopf, B., Tipping, M.

Journal of Machine Learning Research, 3, pages: 1439-1461, March 2003 (article)

Abstract
We explore the use of the so-called zero-norm of the parameters of linear models in learning. Minimization of such a quantity has many uses in a machine learning context: for variable or feature selection, minimizing training error and ensuring sparsity in solutions. We derive a simple but practical method for achieving these goals and discuss its relationship to existing techniques of minimizing the zero-norm. The method boils down to implementing a simple modification of vanilla SVM, namely via an iterative multiplicative rescaling of the training data. Applications we investigate which aid our discussion include variable and feature selection on biological microarray data, and multicategory classification.

ei

PDF PostScript PDF [BibTex]

PDF PostScript PDF [BibTex]


no image
An Introduction to Variable and Feature Selection.

Guyon, I., Elisseeff, A.

Journal of Machine Learning, 3, pages: 1157-1182, 2003 (article)

ei

[BibTex]

[BibTex]


no image
New Approaches to Statistical Learning Theory

Bousquet, O.

Annals of the Institute of Statistical Mathematics, 55(2):371-389, 2003 (article)

Abstract
We present new tools from probability theory that can be applied to the analysis of learning algorithms. These tools allow to derive new bounds on the generalization performance of learning algorithms and to propose alternative measures of the complexity of the learning task, which in turn can be used to derive new learning algorithms.

ei

PostScript [BibTex]

PostScript [BibTex]


Thumb xl toc image
New electro-optic effect: Sum-frequency generation from optically active liquids in the presence of a dc electric field

Fischer, P., Buckingham, A., Beckwitt, K., Wiersma, D., Wise, F.

PHYSICAL REVIEW LETTERS, 91(17), 2003 (article)

Abstract
We report the observation of sum-frequency signals that depend linearly on an applied electrostatic field and that change sign with the handedness of an optically active solute. This recently predicted chiral electro-optic effect exists in the electric-dipole approximation. The static electric field gives rise to an electric-field-induced sum-frequency signal (an achiral third-order process) that interferes with the chirality-specific sum-frequency at second order. The cross-terms linear in the electrostatic field constitute the effect and may be used to determine the absolute sign of second- and third-order nonlinear-optical susceptibilities in isotropic media.

pf

DOI [BibTex]

DOI [BibTex]


Thumb xl toc image
Chiral and achiral contributions to sum-frequency generation from optically active solutions of binaphthol

Fischer, P., Wise, F., Albrecht, A.

JOURNAL OF PHYSICAL CHEMISTRY A, 107(40):8232-8238, 2003 (article)

Abstract
The nonlinear sum- and difference-frequency generation spectroscopies can be probes of molecular chirality in optically active systems. We present a tensorial analysis of the chirality-specific electric-dipolar sum-frequency-generation susceptibility and the achiral electric-quadrupolar and magnetic-dipolar nonlinearities at second order in isotropic media. The chiral and achiral contributions to the sum-frequency signal from the bulk of optically active solutions of 1,1'-bi-2-naphthol (2,2'-dehydroxy-1,1'-binaphthyl) can be distinguished, and the former dominates. Ab initio computations reveal the dramatic resonance enhancement that the isotropic component of the electric-dipolar three-wave mixing hyperpolarizability experiences. Away from resonance its magnitude rapidly decreases, as-unlike the vector component-it is zero in the static limit. The dispersion of the first hyperpolarizability is computed by a configuration interaction singles sum-over-states approach with explicit regard to the Franck-Condon active vibrational substructure for all resonant electronic states.

pf

DOI [BibTex]

DOI [BibTex]


no image
Synthetic gecko foot-hair micro/nano-structures as dry adhesives

Sitti, M., Fearing, R. S.

Journal of adhesion science and technology, 17(8):1055-1073, Taylor & Francis Group, 2003 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Teleoperated touch feedback from the surfaces at the nanoscale: modeling and experiments

Sitti, M., Hashimoto, H.

IEEE/ASME transactions on mechatronics, 8(2):287-298, IEEE, 2003 (article)

pi

[BibTex]

[BibTex]


no image
Scaled teleoperation system for nano-scale interaction and manipulation

Sitti, M., Aruk, B., Shintani, H., Hashimoto, H.

Advanced Robotics, 17(3):275-291, Taylor & Francis Group, 2003 (article)

pi

[BibTex]

[BibTex]


no image
Atomic force microscope probe based controlled pushing for nano-tribological characterization

Sitti, M.

IEEE/ASME Transactions on Mechatronics, 8(3), 2003 (article)

pi

[BibTex]


no image
Computational approaches to motor learning by imitation

Schaal, S., Ijspeert, A., Billard, A.

Philosophical Transaction of the Royal Society of London: Series B, Biological Sciences, 358(1431):537-547, 2003, clmc (article)

Abstract
Movement imitation requires a complex set of mechanisms that map an observed movement of a teacher onto one's own movement apparatus. Relevant problems include movement recognition, pose estimation, pose tracking, body correspondence, coordinate transformation from external to egocentric space, matching of observed against previously learned movement, resolution of redundant degrees-of-freedom that are unconstrained by the observation, suitable movement representations for imitation, modularization of motor control, etc. All of these topics by themselves are active research problems in computational and neurobiological sciences, such that their combination into a complete imitation system remains a daunting undertaking - indeed, one could argue that we need to understand the complete perception-action loop. As a strategy to untangle the complexity of imitation, this paper will examine imitation purely from a computational point of view, i.e. we will review statistical and mathematical approaches that have been suggested for tackling parts of the imitation problem, and discuss their merits, disadvantages and underlying principles. Given the focus on action recognition of other contributions in this special issue, this paper will primarily emphasize the motor side of imitation, assuming that a perceptual system has already identified important features of a demonstrated movement and created their corresponding spatial information. Based on the formalization of motor control in terms of control policies and their associated performance criteria, useful taxonomies of imitation learning can be generated that clarify different approaches and future research directions.

am

link (url) [BibTex]

link (url) [BibTex]


no image
Efficient charge recovery method for driving piezoelectric actuators with quasi-square waves

Campolo, D., Sitti, M., Fearing, R. S.

IEEE transactions on ultrasonics, ferroelectrics, and frequency control, 50(3):237-244, IEEE, 2003 (article)

pi

[BibTex]

[BibTex]


no image
Piezoelectrically actuated four-bar mechanism with two flexible links for micromechanical flying insect thorax

Sitti, M.

IEEE/ASME transactions on mechatronics, 8(1):26-36, IEEE, 2003 (article)

pi

[BibTex]