Icon--AD-black-48x48Icon--address-consumer-data-black-48x48Icon--appointment-black-48x48Icon--back-left-black-48x48Icon--calendar-black-48x48Icon--Checkbox-checkIcon--clock-black-48x48Icon--close-black-48x48Icon--compare-black-48x48Icon--confirmation-black-48x48Icon--dealer-details-black-48x48Icon--delete-black-48x48Icon--delivery-black-48x48Icon--down-black-48x48Icon--download-black-48x48Ic-OverlayAlertIcon--externallink-black-48x48Icon-Filledforward-right_adjustedIcon--grid-view-black-48x48Icon--info-i-black-48x48Icon--Less-minimize-black-48x48Icon-FilledIcon--List-Check-blackIcon--List-Cross-blackIcon--list-view-mobile-black-48x48Icon--list-view-black-48x48Icon--More-Maximize-black-48x48Icon--my-product-black-48x48Icon--newsletter-black-48x48Icon--payment-black-48x48Icon--print-black-48x48Icon--promotion-black-48x48Icon--registration-black-48x48Icon--Reset-black-48x48share-circle1Icon--share-black-48x48Icon--shopping-cart-black-48x48Icon--start-play-black-48x48Icon--store-locator-black-48x48Ic-OverlayAlertIcon--summary-black-48x48tumblrIcon-FilledvineIc-OverlayAlertwhishlist

Important Cookie Information

This website uses cookies for reasons of functionality, comfort, and statistics. You can change those settings at any time in the footer on "Privacy Settings".

Bosch Center for Artificial Intelligence

Our Research Field

Control Optimization Through Reinforcement Learning

What Motivates Us

Optimal process control requires expert knowledge of the system. Creating this knowledge base results in significant manual effort. Reinforcement learning techniques have the potential to reduce reliance on a human-expert knowledge base. Potential of reinforcement learning in solving complicated problems through experience has been demonstrated, but it lacks maturity for industrial applications.

Our Approach

Our goal is to automate initial set-up and enable life-long tuning of process control. We focus on learning control where we intend to exploit modelling knowledge and develop new exploration strategies to improve sample efficiency. Further, we explore approaches to ensure integrity and safety of the learned controllers as well as the learning process itself.

Application

As a company with a rich tradition in manufacturing, we explore the contribution of artificial intelligence to the vision of a self-calibrating factory. Reinforcement learning is a key enabler for automatic adaptation of machines. Our research focuses on transferable knowledge and solutions to decrease setup times as well as flexible control structures to increase performance potential.

Read more

  • Bosch BCAI - Publications - ICRA

    Doerr et al.

    "Model-Based Policy Search for Automatic Tuning of Multivariate PID Controllers"
    • Authors: Andreas Doerr, Duy Nguyen-Tuong, Alonso Marco, Stefan Schaal, and Sebastian Trimpe
    • Published in ICRA in 2017
  • Bosch BCAI - Publication - IFAC

    Schillinger et al.

    "Safe Active Learning and Bayesian Optimization for Tuning a PI-Controller"
    • Authors: Mark Schillinger, Benjamin Hartmann, Patric Skalecki, Mona Meister, Duy Nguyen-Tuong, and Oliver Nelles
    • Published in IFAC in 2017
  • Bosch BCAI - Publication - ECML

    Daniel et al.

    "Probabilistic Inference for Determining Options in Reinforcement Learning"
    • Authors: Christian Daniel, Herke van Hoof, Jan Peters, and Gerhard Neumann
    • Published in ECML in 2016
  • Bosch BCAI - Publication - ICML

    Vinogradska et al.

    "Stability of Controllers for Gaussian Process Forward Models"
    • Authors: Julia Vinogradska, Bastian Bischoff, Duy Nguyen-Tuong, Henner Schmidt, Anne Romer, and Jan Peters
    • Published in ICML in 2016
  • Bosch BCAI - Publication - ECML

    Bischoff et al.

    "Learning Throttle Valve Control Using Policy Search"
    • Authors: Bastian Bischo, Duy Nguyen-Tuong, Torsten Koller, Heiner Markert, and Alois Knoll
    • Published in ECML in 2014
  • Bosch BCAI - Publication - ISSAM

    Tietze et al.

    "Model-based Calibration of Engine Controller Using Automated Transient Design of Experiment"
    • Authors: Nils Tietze, Ulrich Konigorski, Christian Fleck, Duy Nguyen-Tuong
    • Published in ISSAM in 2014
  • Bosch BCAI - Publication - ICRA

    Bischoff et al.

    "Policy Search for Learning Robot Control Using Sparse Data"
    • Authors: B. Bischoff, D. Nguyen-Tuong, H. van Hoof, A. McHutchon, C. E. Rasmussen, A. Knoll, J. Peters, and M. P. Deisenroth
    • Published in ICRA in 2014
  • Bosch BCAI - Publication - ESANN

    Bischoff et al.

    "Hierarchical Reinforcement Learning for Robot Navigation"
    • Authors: B. Bischoff, D. Nguyen-Tuong, I-H. Lee, F. Streichert, and A. Knoll
    • Published in ESANN in 2013
  • Bosch BCAI - Publication - ESANN

    Bischoff et al.

    "Learning Control Under Uncertainty: A Probabilistic Value-Iteration Approach"
    • Authors: B. Bischoff, D. Nguyen-Tuong, H. Markert, and A. Knoll
    • Published in ESANN in 2013
  • Bosch BCAI - Publication - SCAI

    Bischoff et al.

    "Solving the 15-Puzzle Game Using Local Value-Iteration"
    • Authors: Bastian Bischoff, Duy Nguyen-Tuong, Heiner Markert, and Alois Knoll
    • Published in SCAI in 2013

Research Application

Bosch BCAI - Model Based Policy Search for Automatic Tuning of Multivariate PID Controllers

Model-Based Policy Search for Automatic Tuning of Multivariate PID Controllers

Learn moreIcon forward-right