Header logo is


2011


no image
Learning, planning, and control for quadruped locomotion over challenging terrain

Kalakrishnan, Mrinal, Buchli, Jonas, Pastor, Peter, Mistry, Michael, Schaal, S.

International Journal of Robotics Research, 30(2):236-258, February 2011 (article)

am

[BibTex]

2011


[BibTex]


no image
STOMP: Stochastic trajectory optimization for motion planning

Kalakrishnan, M., Chitta, S., Theodorou, E., Pastor, P., Schaal, S.

In IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, May 9-13, 2011, clmc (inproceedings)

Abstract
We present a new approach to motion planning using a stochastic trajectory optimization framework. The approach relies on generating noisy trajectories to explore the space around an initial (possibly infeasible) trajectory, which are then combined to produced an updated trajectory with lower cost. A cost function based on a combination of obstacle and smoothness cost is optimized in each iteration. No gradient information is required for the particular optimization algorithm that we use and so general costs for which derivatives may not be available (e.g. costs corresponding to constraints and motor torques) can be included in the cost function. We demonstrate the approach both in simulation and on a dual-arm mobile manipulation system for unconstrained and constrained tasks. We experimentally show that the stochastic nature of STOMP allows it to overcome local minima that gradient-based optimizers like CHOMP can get stuck in.

am

link (url) Project Page [BibTex]

link (url) Project Page [BibTex]


no image
Collective dynamics of colloids at fluid interfaces

Bleibel, J., Dominguez, A., Oettel, M., Dietrich, S.

European Physical Journal E, 34(11), 2011 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Anomalous transport of a tracer on percolating clusters

Spanner, M., Höfling, F., Schröder-Turk, G. E., Mecke, K., Franosch, T.

Journal of Physics: Condensed Matter, 23(23), 2011 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Dynamics of colloids in confined geometries

Almenar, L., Rauscher, M.

Journal of Physics: Condensed Matter, 23(18), 2011 (article)

icm

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
The structure and melting transition of two-dimensional colloidal alloys

Law, A. D., Horozov, T. S., Buzza, D. M. A.

Soft Matter, 7(19):8923-8931, 2011 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Second harmonic light scattering from spherical polyelectrolyte brushes

Schürer, B., Hoffmann, M., Wunderlich, S., Harnau, L., Peschel, U., Ballauff, M., Peukert, W.

Journal of Physical Chemistry C, 115, pages: 18302-18309, 2011 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Simulation einer fast kritischen binären Flüssigkeit in einem Temperaturgradienten

Single, F.

Universität Stuttgart, Stuttgart, 2011 (mastersthesis)

icm

[BibTex]

[BibTex]


no image
Development of a Low-Pressure Fluidic Servo-Valve for Wearable Haptic Interfaces and Lightweight Robotic Systems"

Folgheraiter, M., Jordan, M., Benitez, L. M. V., Grimminger, F., Schmidt, S., Albiez, J., Kirchner, F.

In Informatics in Control, Automation and Robotics, pages: 239-252, Springer Berlin Heidelberg, Berlin, Heidelberg, 2011 (inproceedings)

Abstract
This document presents a low-pressure servo-valve specifically designed for haptic interfaces and lightweight robotic applications. The device is able to work with hydraulic and pneumatic fluidic sources, operating within a pressure range of (0{\thinspace}−{\thinspace}50 {\textperiodcentered}105Pa). All sensors and electronics were integrated inside the body of the valve, reducing the need for external circuits. Positioning repeatability as well as the capability to fine modulate the hydraulic flow were measured and verified. Furthermore, the static and dynamic behavior of the valve were evaluated for different working conditions, and a non-linear model identified using a recursive Hammerstein-Wiener parameter adaptation algorithm.

am

DOI [BibTex]

DOI [BibTex]


no image
Path Integral Control and Bounded Rationality

Braun, D. A., Ortega, P. A., Theodorou, E., Schaal, S.

In IEEE Symposium on Adaptive Dynamic Programming And Reinforcement Learning (ADPRL), 2011, clmc (inproceedings)

Abstract
Path integral methods [7], [15],[1] have recently been shown to be applicable to a very general class of optimal control problems. Here we examine the path integral formalism from a decision-theoretic point of view, since an optimal controller can always be regarded as an instance of a perfectly rational decision-maker that chooses its actions so as to maximize its expected utility [8]. The problem with perfect rationality is, however, that finding optimal actions is often very difficult due to prohibitive computational resource costs that are not taken into account. In contrast, a bounded rational decision-maker has only limited resources and therefore needs to strike some compromise between the desired utility and the required resource costs [14]. In particular, we suggest an information-theoretic measure of resource costs that can be derived axiomatically [11]. As a consequence we obtain a variational principle for choice probabilities that trades off maximizing a given utility criterion and avoiding resource costs that arise due to deviating from initially given default choice probabilities. The resulting bounded rational policies are in general probabilistic. We show that the solutions found by the path integral formalism are such bounded rational policies. Furthermore, we show that the same formalism generalizes to discrete control problems, leading to linearly solvable bounded rational control policies in the case of Markov systems. Importantly, Bellman?s optimality principle is not presupposed by this variational principle, but it can be derived as a limit case. This suggests that the information- theoretic formalization of bounded rationality might serve as a general principle in control design that unifies a number of recently reported approximate optimal control methods both in the continuous and discrete domain.

am

PDF [BibTex]

PDF [BibTex]


no image
Skill learning and task outcome prediction for manipulation

Pastor, P., Kalakrishnan, M., Chitta, S., Theodorou, E., Schaal, S.

In IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, May 9-13, 2011, clmc (inproceedings)

Abstract
Learning complex motor skills for real world tasks is a hard problem in robotic manipulation that often requires painstaking manual tuning and design by a human expert. In this work, we present a Reinforcement Learning based approach to acquiring new motor skills from demonstration. Our approach allows the robot to learn fine manipulation skills and significantly improve its success rate and skill level starting from a possibly coarse demonstration. Our approach aims to incorporate task domain knowledge, where appropriate, by working in a space consistent with the constraints of a specific task. In addition, we also present an approach to using sensor feedback to learn a predictive model of the task outcome. This allows our system to learn the proprioceptive sensor feedback needed to monitor subsequent executions of the task online and abort execution in the event of predicted failure. We illustrate our approach using two example tasks executed with the PR2 dual-arm robot: a straight and accurate pool stroke and a box flipping task using two chopsticks as tools.

am

link (url) Project Page Project Page [BibTex]

link (url) Project Page Project Page [BibTex]


no image
An Iterative Path Integral Stochastic Optimal Control Approach for Learning Robotic Tasks

Theodorou, E., Stulp, F., Buchli, J., Schaal, S.

In Proceedings of the 18th World Congress of the International Federation of Automatic Control, 2011, clmc (inproceedings)

Abstract
Recent work on path integral stochastic optimal control theory Theodorou et al. (2010a); Theodorou (2011) has shown promising results in planning and control of nonlinear systems in high dimensional state spaces. The path integral control framework relies on the transformation of the nonlinear Hamilton Jacobi Bellman (HJB) partial differential equation (PDE) into a linear PDE and the approximation of its solution via the use of the Feynman Kac lemma. In this work, we are reviewing the generalized version of path integral stochastic optimal control formalism Theodorou et al. (2010a), used for optimal control and planing of stochastic dynamical systems with state dependent control and diffusion matrices. Moreover we present the iterative path integral control approach, the so called Policy Improvement with Path Integrals or (PI2 ) which is capable of scaling in high dimensional robotic control problems. Furthermore we present a convergence analysis of the proposed algorithm and we apply the proposed framework to a variety of robotic tasks. Finally with the goal to perform locomotion the iterative path integral control is applied for learning nonlinear limit cycle attractors with adjustable land scape.

am

PDF [BibTex]

PDF [BibTex]


no image
Solvation forces in Ising films with long-range boundary fields: density-matrix renormalization-group study

Drzewinski, A., Maciolek, A., Barasinski, A.

Molecular Physics, 109(7-10):1133-1141, 2011 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Pulling and pushing a cargo with a catalytically active carrier

Popescu, M. N., Tasinkevych, M., Dietrich, S.

Europhysics Letters, 95(2), 2011 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Critical Casimir forces for Ising films with variable boundary fields

Vasilyev, O., Maciolek, A., Dietrich, S.

Physical Review E, 84(4), 2011 (article)

icm

DOI [BibTex]


no image
Study of \pi\pi correlations at LHC and RHIC energies in pp collisions within the quark-gluon string model

Nilsson, M. S., Bravina, L. V., Zabrodin, E. E., Malinina, L. V., Bleibel, J.

Physical Review D, 84(5), 2011 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Micro-rheology on (polymer-grafted) colloids using optical tweezers

Gutsche, C., Elmahdy, M. M., Kegler, K., Semenov, I., Stangner, T., Otto, O., Ueberschär, O., Keyser, U. F., Krüger, M., Rauscher, M., Weeber, R., Harting, J., Kim, Y. W., Lobaskin, V., Netz, R., Kremer, F.

Journal of Physics: Condensed Matter, 23(18), IOP Publishing, Bristol, 2011 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Debye-Scherrer rings from block copolymer films with powder-like order

Busch, P., Rauscher, M., Moulin, J.-F., Müller-Buschbaum, P.

Journal of Applied Crystallography, 44(2):370-379, 2011 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Effective interactions and equilibrium configurations of colloidal particles on a sessile droplet

Guzowski, J., Tasinkevych, M., Dietrich, S.

Soft Matter, 7(9):4189-4197, 2011 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Capillary interactions in Pickering emulsions

Guzowski, J., Tasinkevych, M., Dietrich, S.

Physical Review E, 84(3), 2011 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Critical Casimir forces steered by patterned substrates

Gambassi, A., Dietrich, S.

Soft Matter, 7(4):1247-1253, 2011 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Interaction strength between proteins and polyelectrolyte brushes: A small angle X-ray scattering study

Henzler, K., Haupt, B., Rosenfeldt, S., Harnau, L., Narayanan, T., Ballauff, M.

Physical Chemistry Chemical Physics, 13, pages: 17599-17605, 2011 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Annealing of single lamella nanoparticles of polyethylene

Rochette, C. N., Rosenfeldt, S., Henzler, K., Polzer, F., Ballauff, M., Tong, Q., Mecking, S., Drechsler, M., Narayanan, T., Harnau, L.

Macromolecules, 44(12):4845-4851, 2011 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Struktur dichter ionischer Flüssigkeiten

Dannenmann, O.

Universität Stuttgart, Stuttgart, 2011 (mastersthesis)

icm

[BibTex]

[BibTex]


no image
Bayesian robot system identification with input and output noise

Ting, J., D’Souza, A., Schaal, S.

Neural Networks, 24(1):99-108, 2011, clmc (article)

Abstract
For complex robots such as humanoids, model-based control is highly beneficial for accurate tracking while keeping negative feedback gains low for compliance. However, in such multi degree-of-freedom lightweight systems, conventional identification of rigid body dynamics models using CAD data and actuator models is inaccurate due to unknown nonlinear robot dynamic effects. An alternative method is data-driven parameter estimation, but significant noise in measured and inferred variables affects it adversely. Moreover, standard estimation procedures may give physically inconsistent results due to unmodeled nonlinearities or insufficiently rich data. This paper addresses these problems, proposing a Bayesian system identification technique for linear or piecewise linear systems. Inspired by Factor Analysis regression, we develop a computationally efficient variational Bayesian regression algorithm that is robust to ill-conditioned data, automatically detects relevant features, and identifies input and output noise. We evaluate our approach on rigid body parameter estimation for various robotic systems, achieving an error of up to three times lower than other state-of-the-art machine learning methods

am

link (url) [BibTex]

link (url) [BibTex]


The Oxidation of Fe(111)
The Oxidation of Fe(111)

Davies, R., Edwards, D., Gräfe, J., Gilbert, L., Davies, P., Hutchings, G., Bowker, M.

Surface Science, 605(17-18):1754-1762, 2011 (article)

Abstract
The oxidation of Fe(111) was studied using Auger electron spectroscopy (AES), low energy electron diffraction (LEED), X-ray photoelectron spectroscopy (XPS), ion scattering spectroscopy (ISS) and scanning tunnelling microscopy (STM). Oxidation of the crystal was found to be a very fast process, even at 200 K, and the Auger O signal saturation level is reached within ~ 50 × 10− 6 mbar s. Annealing the oxidised surface at 773 K causes a significant decline in apparent surface oxygen concentration and produces a clear (6 × 6) LEED pattern, whereas after oxidation at ambient temperature no pattern was observed. STM results indicate that the oxygen signal was reduced due to the nucleation of large, but sparsely distributed oxide islands, leaving mainly the smooth (6 × 6) structure between the islands. The reactivity of the (6 × 6) layer towards methanol was investigated using temperature programmed desorption (TPD), which showed mainly decomposition to CO and CO2, due to the production of formate intermediates on the surface. Interestingly, this removes the (6 × 6) structure by reduction, but it can be reformed from the sink of oxygen present in the large oxide islands simply by annealing at 773 K for a few minutes. The (6 × 6) appears to be a relatively stable, pseudo-oxide phase, that may be useful as a model oxide surface.

mms

DOI [BibTex]

DOI [BibTex]


no image
Trapping colloids near chemical stripes via critical Casimir forces

Tröndle, M., Zvyagolskaya, O., Gambassi, A., Vogt, D., Harnau, L., Bechinger, C., Dietrich, S.

Molecular Physics, 109, pages: 1169-1185, 2011 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Electrostatic interactions in critical solvents

Bier, M., Gambassi, A., Oettel, M., Dietrich, S.

Europhysics Letters, 95, 2011 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Structural investigation of thin diblock copolymer films using time-of-flight grazing-incidence small-angle neutron scattering

Metwalli, E., Moulin, J.-F., Rauscher, M., Kaune, G., Ruderer, M. A., Van Bürck, U., Haese-Seiller, M., Kampmann, R., Müller-Buschbaum, P.

Journal of Applied Crystallography, 44(1):84-92, 2011 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Complexation of beta-lactoglobulin fibrils and sulfated polysaccharides

Jones, O. G., Handschin, S., Adamcik, J., Harnau, L., Bolisetty, S., Mezzenga, R.

Biomacromolecules, 12, pages: 3056-3065, 2011 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Parallelisierung Stokesscher Dynamik für Graphikprozessoren zur Simulation kolloidaler Suspensionen

Kopp, M.

Universität Stuttgart, Stuttgart, 2011 (mastersthesis)

icm

[BibTex]

[BibTex]


no image
Diffusion in Wandnähe

Müller, J.

Universität Stuttgart, Stuttgart, 2011 (mastersthesis)

icm

[BibTex]

[BibTex]


no image
Learning variable impedance control

Buchli, J., Stulp, F., Theodorou, E., Schaal, S.

International Journal of Robotics Research, 2011, clmc (article)

Abstract
One of the hallmarks of the performance, versatility, and robustness of biological motor control is the ability to adapt the impedance of the overall biomechanical system to different task requirements and stochastic disturbances. A transfer of this principle to robotics is desirable, for instance to enable robots to work robustly and safely in everyday human environments. It is, however, not trivial to derive variable impedance controllers for practical high degree-of-freedom (DOF) robotic tasks. In this contribution, we accomplish such variable impedance control with the reinforcement learning (RL) algorithm PISq ({f P}olicy {f I}mprovement with {f P}ath {f I}ntegrals). PISq is a model-free, sampling based learning method derived from first principles of stochastic optimal control. The PISq algorithm requires no tuning of algorithmic parameters besides the exploration noise. The designer can thus fully focus on cost function design to specify the task. From the viewpoint of robotics, a particular useful property of PISq is that it can scale to problems of many DOFs, so that reinforcement learning on real robotic systems becomes feasible. We sketch the PISq algorithm and its theoretical properties, and how it is applied to gain scheduling for variable impedance control. We evaluate our approach by presenting results on several simulated and real robots. We consider tasks involving accurate tracking through via-points, and manipulation tasks requiring physical contact with the environment. In these tasks, the optimal strategy requires both tuning of a reference trajectory emph{and} the impedance of the end-effector. The results show that we can use path integral based reinforcement learning not only for planning but also to derive variable gain feedback controllers in realistic scenarios. Thus, the power of variable impedance control is made available to a wide variety of robotic systems and practical applications.

am

link (url) [BibTex]

link (url) [BibTex]


no image
Iterative path integral stochastic optimal control: Theory and applications to motor control

Theodorou, E. A.

University of Southern California, University of Southern California, Los Angeles, CA, 2011 (phdthesis)

am

PDF [BibTex]

PDF [BibTex]


no image
Learning of grasp selection based on shape-templates

Herzog, A.

Karlsruhe Institute of Technology, 2011 (mastersthesis)

am

[BibTex]

[BibTex]


High-resolution x-ray absorption spectroscopy of BaTiO${}_{3}$: Experiment and first-principles calculations
High-resolution x-ray absorption spectroscopy of BaTiO_3: Experiment and first-principles calculations

Chassé, A., Borek, S., Schindler, K., Trautmann, M., Huth, M., Steudel, F., Makhova, L., Gräfe, J., Denecke, R.

Physical Review B, 84, pages: 195135, 2011 (article)

Abstract
High resolution x-ray absorption spectroscopy (XAS) affords new insight into the microscopic properties of perovskite transition metal oxides. Interpretation of XAS spectra in transition metal oxides requires theoretical tools capable of describing relativistic and many-body effects. In this work, full relativistic (SPR-KKR) and multiplet calculations (CTM4XAS) are carried out and compared to experimental multiedge XAS spectra of BaTiO3 single crystals. The impact of relativistic and many-body effects on the calculated density of states and x-ray absorption near edge structure spectra are individually considered.

mms

DOI [BibTex]

DOI [BibTex]


no image
Magnetization of multicomponent ferrofluids

Szalai, I., Dietrich, S.

Journal of Physics: Condensed Matter, 23(32), 2011 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Space-resolved dynamics of a tracer in a disordered solid

Franosch, T., Spanner, M., Bauer, T., Schröder-Turk, G. E., Höfling, F.

Journal of Non-Crystalline Solids, 357(2):472-478, 2011 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Long-wavelength anomalies in the asymptotic behavior of mode-coupling theory

Schnyder, S. K., Höfling, F., Franosch, T., Voigtmann, T.

Journal of Physics: Condensed Matter, 23(23), 2011 (article)

icm

DOI [BibTex]

DOI [BibTex]


no image
Ferromagnetism of ZnO influenced by physical and chemical treatment

Chen, Y.

Universität Stuttgart, Stuttgart, 2011 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Herstellung und Charakterisierung von ultradünnen, funktionellen CoFeB Filmen

Streckenbach, F.

Hochschule Esslingen / Hochschule Aalen, Esslingen / Aalen, 2011 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Hydrogen adsorption on metal-organic frameworks

Streppel, B.

Universität Stuttgart, Stuttgart, 2011 (phdthesis)

mms

link (url) [BibTex]

link (url) [BibTex]


no image
Electron theory of fast and ultrafast dissipative magnetization dynamics

Fähnle, M., Illg, C.

{Journal of Physics: Condensed Matter}, 23, 2011 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Large-area hard magnetic L10-FePt nanopatterns by nanoimprint lithography

Bublat, T., Goll, D.

{Nanotechnology}, 22(31), 2011 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Hydrogen storage by cryoadsorption in ultrahigh-porosity metal-organic frameworks

Hirscher, M.

{Angewandte Chemie International Edition}, 50(3):581-582, 2011 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Amorphous grain boundary layers in the ferromagnetic nanograined ZnO films

Straumal, B. B., Mazilkin, A. A., Protasova, S. G., Myatiev, A. A., Straumal, P. B., Goering, E., Baretzky, B.

In 520, pages: 1192-1194, Hersonissos, Greece, 2011 (inproceedings)

mms

DOI [BibTex]

DOI [BibTex]


no image
Multilayer Fresnel zone plate for soft X-ray microscopy resolves sub-39 nm structures

Mayer, M., Grévent, C., Szeghalmi, A., Knez, M., Weigand, M., Rehbein, S., Schneider, G., Baretzky, B., Schütz, G.

{Ultramicroscopy}, 111, pages: 1706-1711, 2011 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Generalized Gilbert equation including inertial damping: derivation from an extended breathing Fermi surface model

Fähnle, M., Steiauf, D., Illg, C.

{Physical Review B}, 84, 2011 (article)

mms

DOI [BibTex]


no image
Hydrogen physisorption in high SSA microporous materials - A comparison between AX-21\textunderscore33 and MOF-177 at cryogenic conditions

Schlichtenmayer, M., Streppel, B., Hirscher, M.

{International Journal of Hydrogen Energy}, 36, pages: 586-591, 2011 (article)

mms

DOI [BibTex]

DOI [BibTex]