Header logo is de


2012


Quasi-Newton Methods: A New Direction
Quasi-Newton Methods: A New Direction

Hennig, P., Kiefel, M.

In Proceedings of the 29th International Conference on Machine Learning, pages: 25-32, ICML ’12, (Editors: John Langford and Joelle Pineau), Omnipress, New York, NY, USA, ICML, July 2012 (inproceedings)

Abstract
Four decades after their invention, quasi- Newton methods are still state of the art in unconstrained numerical optimization. Although not usually interpreted thus, these are learning algorithms that fit a local quadratic approximation to the objective function. We show that many, including the most popular, quasi-Newton methods can be interpreted as approximations of Bayesian linear regression under varying prior assumptions. This new notion elucidates some shortcomings of classical algorithms, and lights the way to a novel nonparametric quasi-Newton method, which is able to make more efficient use of available information at computational cost similar to its predecessors.

ei ps pn

website+code pdf link (url) [BibTex]

2012


website+code pdf link (url) [BibTex]


Entropy Search for Information-Efficient Global Optimization
Entropy Search for Information-Efficient Global Optimization

Hennig, P., Schuler, C.

Journal of Machine Learning Research, 13, pages: 1809-1837, -, June 2012 (article)

Abstract
Contemporary global optimization algorithms are based on local measures of utility, rather than a probability measure over location and value of the optimum. They thus attempt to collect low function values, not to learn about the optimum. The reason for the absence of probabilistic global optimizers is that the corresponding inference problem is intractable in several ways. This paper develops desiderata for probabilistic optimization algorithms, then presents a concrete algorithm which addresses each of the computational intractabilities with a sequence of approximations and explicitly adresses the decision problem of maximizing information gain from each evaluation.

ei pn

PDF Web Project Page [BibTex]

PDF Web Project Page [BibTex]


no image
Learning Tracking Control with Forward Models

Bócsi, B., Hennig, P., Csató, L., Peters, J.

In pages: 259 -264, IEEE International Conference on Robotics and Automation (ICRA), May 2012 (inproceedings)

Abstract
Performing task-space tracking control on redundant robot manipulators is a difficult problem. When the physical model of the robot is too complex or not available, standard methods fail and machine learning algorithms can have advantages. We propose an adaptive learning algorithm for tracking control of underactuated or non-rigid robots where the physical model of the robot is unavailable. The control method is based on the fact that forward models are relatively straightforward to learn and local inversions can be obtained via local optimization. We use sparse online Gaussian process inference to obtain a flexible probabilistic forward model and second order optimization to find the inverse mapping. Physical experiments indicate that this approach can outperform state-of-the-art tracking control algorithms in this context.

ei pn

PDF Web DOI [BibTex]

PDF Web DOI [BibTex]


no image
Approximate Gaussian Integration using Expectation Propagation

Cunningham, J., Hennig, P., Lacoste-Julien, S.

In pages: 1-11, -, January 2012 (inproceedings) Submitted

Abstract
While Gaussian probability densities are omnipresent in applied mathematics, Gaussian cumulative probabilities are hard to calculate in any but the univariate case. We offer here an empirical study of the utility of Expectation Propagation (EP) as an approximate integration method for this problem. For rectangular integration regions, the approximation is highly accurate. We also extend the derivations to the more general case of polyhedral integration regions. However, we find that in this polyhedral case, EP's answer, though often accurate, can be almost arbitrarily wrong. These unexpected results elucidate an interesting and non-obvious feature of EP not yet studied in detail, both for the problem of Gaussian probabilities and for EP more generally.

ei pn

Web [BibTex]

Web [BibTex]


no image
Kernel Topic Models

Hennig, P., Stern, D., Herbrich, R., Graepel, T.

In Fifteenth International Conference on Artificial Intelligence and Statistics, 22, pages: 511-519, JMLR Proceedings, (Editors: Lawrence, N. D. and Girolami, M.), JMLR.org, AISTATS , 2012 (inproceedings)

Abstract
Latent Dirichlet Allocation models discrete data as a mixture of discrete distributions, using Dirichlet beliefs over the mixture weights. We study a variation of this concept, in which the documents' mixture weight beliefs are replaced with squashed Gaussian distributions. This allows documents to be associated with elements of a Hilbert space, admitting kernel topic models (KTM), modelling temporal, spatial, hierarchical, social and other structure between documents. The main challenge is efficient approximate inference on the latent Gaussian. We present an approximate algorithm cast around a Laplace approximation in a transformed basis. The KTM can also be interpreted as a type of Gaussian process latent variable model, or as a topic model conditional on document features, uncovering links between earlier work in these areas.

ei pn

PDF Web [BibTex]

PDF Web [BibTex]


no image
Structure and aggregation of colloids immersed in critical solvents

Mohry, T. F., Maciolek, A., Dietrich, S.

Journal of Chemical Physics, 136(22), 2012 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Ewald sum for hydrodynamic interactions with periodicity in two dimensions

Bleibel, J.

Journal of Physics A: Mathematical and Theoretical, 45(22), 2012 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Nanodroplets at topographic steps

Bartsch, H.

Universität Stuttgart, Stuttgart, 2012 (mastersthesis)

icm

[BibTex]

[BibTex]


no image
Patchy worm-like micelles: solution structure studied by small-angle neutron scattering

Rosenfeldt, S., Luedel, F., Schulreich, C., Hellweg, T., Radulescu, A., Schmelz, J., Schmalz, H., Harnau, L.

Physical Chemistry Chemical Physics, 14, pages: 12750-12756, 2012 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Time correlations and persistence probability of a Brownian particle in a shear flow

Chakraborty, D.

European Physical Journal B, 85(8), Springer-Verlag Heidelberg, Heidelberg, 2012 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Local theory for ions in binary liquid mixtures

Bier, M., Gambassi, A., Dietrich, S.

The Journal of Chemical Physics, 137(3), American Institute of Physics, Woodbury, N.Y., 2012 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Effect of ions on confined near-critical binary aqueous mixture

Pousaneh, F., Ciach, A., Maciolek, A.

Soft Matter, 8(29):7567-7581, 2012 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Janus particles in critical liquids

Labbe-Laurent, M.

Universität Stuttgart, Stuttgart, 2012 (mastersthesis)

icm

[BibTex]

[BibTex]


no image
Surface integration approach: a new technique for evaluating geometry dependent forces between objects of various geometry and a plate

Dantchev, D., Valchev, G.

Journal of Colloid and Interface Science, 372(1):148-163, 2012 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Phase equilibria of binary liquid crystals

Klöss, Hans-Christian

Universität Stuttgart, Stuttgart, 2012 (mastersthesis)

icm

[BibTex]

[BibTex]


no image
Pinning of drops at superhydrophobic surfaces

Daschke, Lena

Universität Stuttgart, Stuttgart, 2012 (mastersthesis)

icm

[BibTex]

[BibTex]


no image
Stability of thin wetting films on chemically nanostructured surfaces

Checco, A., Ocko, B. M., Tasinkevych, M., Dietrich, S.

Physical Review Letters, 109(16), American Physical Society., Woodbury, N.Y., etc., 2012 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
The structure of fluids with impurities

Bier, M., Harnau, L.

Zeitschrift f\"ur physikalische Chemie, 226(7-8):807-814, Akademische Verlagsgesellschaft, Frankfurt am Main, 2012 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Impedance spectroscopy of ions at interfaces

Reindl, A.

Universität Stuttgart, Stuttgart, 2012 (mastersthesis)

icm

[BibTex]

[BibTex]


no image
Stepwise swelling of a thin film of lamellae-forming poly(styrene-b-butadiene) in cyclohexane vapor

Di, Zhenyu, Posselt, Dorthe, Smilgies, Detlef-M., Li, Ruipeng, Rauscher, Markus, Potemkin, Igor I., Papadakis, Christine M.

Macromolecules, 45(12):5185-5195, 2012 (article)

icm

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
A close look at proteins: submolecular resolution of two- and three-dimensionally folded cytochrome c at surfaces

Deng, Z., Thontasen, N., Malinowski, N., Rinke, G., Harnau, L., Rauschenbach, S., Kern, K.

Nano Letters, 12, pages: 2452-2458, 2012 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Field-induced breakup of emulsion droplets stabilized by colloidal particles

Kim, E. G., Stratford, K., Clegg, P. S., Cates, M. E.

Physical Review E, 85(2), 2012 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Surface of an evaporating liquid

Arnold, Daniel

Universität Stuttgart, Stuttgart, 2012 (mastersthesis)

icm

[BibTex]

[BibTex]


no image
Precursor films in wetting phenomena

Popescu, M. N., Oshanin, G., Dietrich, S., Cazabat, A. M.

Journal of Physics: Condensed Matter, 24, 2012 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Statics and dynamics of critical Casimir forces

Tröndle, M.

Universität Stuttgart, Stuttgart, 2012 (phdthesis)

icm

link (url) [BibTex]

link (url) [BibTex]


no image
First passages in bounded domains: When is the mean first passage time meaningful?

Mattos, Thiago G., Mejia-Monasterio, Carlos, Metzler, Ralf, Oshanin, Gleb

Physical Review E, 86(3), Published by the American Physical Society through the American Institute of Physics, Melville, NY, 2012 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Gelation, phase behavior, and dynamics of beta-lactoglobulin amyloid fibrils at varying concentrations and ionic strengths

Bolisetty, S., Harnau, L., Jung, J., Mezzenga, R.

Biomacromolecules, 13, pages: 3241-3252, 2012 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Interactions of distinct quadrupolar nematic colloids

Eskandari, Z., Silvestre, N. M., Tasinkevych, M., Telo da Gama, M. M.

Soft Matter, 8(39):10100-10106, Royal Society of Chemistry, Cambridge, UK, 2012 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Critical Casimir forces beyond the Derjaguin approximation

Brunner, Niklas

Universität Stuttgart, Stuttgart, 2012 (mastersthesis)

icm

[BibTex]

[BibTex]


no image
Transport of cargo by catalytic Janus micro-motors

Baraban, L., Tasinkevych, M., Popescu, M. N., Sanchez, S., Dietrich, S., Schmidt, O. G.

Soft Matter, 8(1):48-52, 2012 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Mesoscopic analysis of Gibbs’criterion for sessile nanodroplets on trapezoidal substrates

Dutka, F., Napiorkowski, M., Dietrich, S.

Journal of Chemical Physics, 136(6), 2012 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Complete wetting of elastically responsive substrates

Bernardino, N. R., Dietrich, S.

Physical Review E, 85(5), 2012 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
GPU-accelerated simulation of colloidal suspensions with direct hydrodynamic interactions

Kopp, M., Höfling, F.

The European Physical Journal - Special Topics, 210(1):101-117, 2012 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Liquid crystal boojum-colloids

Tasinkevych, M., Silvestre, N. M., da Gama, M. M. Telo

New Journal of Physics, 14, Institute of Physics Pub., Bristol, UK, 2012 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Crystalline inverted membrane grown on surfaces by electrospray ion beam deposition in vacuum

Rauschenbach, S., Rinke, G., Malinowski, N., Weitz, R., Dinnebier, R., Thontasen, N., Deng, Z., Lutz, T., Rollo, P., Costantini, G., Harnau, L., Kern, K.

Advanced Materials, 24, pages: 2761-2767, 2012 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Crystallization of flexible molecules

Held, Felix

Universität Stuttgart, Stuttgart, 2012 (mastersthesis)

icm

[BibTex]

[BibTex]

2007


no image
Monte Carlo simulation results for critical Casimir forces

Vasilyev, O., Gambassi, A., Maciolek, A., Dietrich, S.

EPL, 80, 2007 (article)

icm

DOI [BibTex]

2007


DOI [BibTex]


no image
Critical Casimir effect in superfluid wetting films

Maciolek, A., Gambassi, A., Dietrich, S.

Physical Review E, 76, 2007 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Inhomogeneous platelets and rod fluids

Harnau, L., Dietrich, S.

In Soft Matter, Vol. 3, pages: 156-311, Wiley-VCH, Weinheim, 2007 (incollection)

icm

[BibTex]

[BibTex]


no image
Complete wetting of pits and grooves

Tasinkevych, M., Dietrich, S.

European Physical Journal e: Soft Matter, 23(1):117-128, 2007 (article)

icm

[BibTex]

[BibTex]


no image
Experimental observation of structural crossover in binary mixtures of colloidal hard spheres

Baumgartl, J., Dullens, R. P. A., Dijkstra, M., Roth, R., Bechinger, C.

Physical Review Letters, 98, 2007 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Physical basis for characterizing native structures of proteins

Harano, Y., Roth, R., Sugita, Y., Ikeguchi, M., Kinoshita, M.

Chemical Physics Letters, 437(1 - 3):112-116, 2007 (article)

icm

[BibTex]

[BibTex]


no image
Importance of boundary conditions for fluctuation-induced forces between colloids at interfaces

Lehle, H., Oettel, M.

Physical Review E, 75(1), 2007 (article)

icm

[BibTex]

[BibTex]


no image
Colloid-colloid and colloid-wall interactions in driven suspensions

Krüger, M., Rauscher, M.

The Journal of Chemical Physics, 127(3), 2007 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Solvation of proteins: linking thermodynamics to geometry

Hansen-Goos, H., Roth, R., Mecke, K., Dietrich, S.

Physical Review Letters, 99, 2007 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Thermal noise influences fluid flow in thin films during spinodal dewetting

Fetzer, R., Rauscher, M., Seemann, R., Jacobs, K., Mecke, K.

Physical Review Letters, 99(11), 2007 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Phase behavior and effective interactions in colloidal suspensions

Grodon, C.

Universität Stuttgart, Stuttgart, 2007 (phdthesis)

icm

link (url) [BibTex]

link (url) [BibTex]