Detail publikace

DETERMINATION OF Q-FUNCTION OPTIMUM GRID APPLIED ON ACTIVE MAGNETIC BEARING CONTROL TASK

BŘEZINA, T., KREJSA, J.

Originální název

DETERMINATION OF Q-FUNCTION OPTIMUM GRID APPLIED ON ACTIVE MAGNETIC BEARING CONTROL TASK

Typ

článek ve sborníku ve WoS nebo Scopus

Jazyk

angličtina

Originální abstrakt

Active magnetic bearing control task can be successfully solved using reinforcement learning based method called Q-learning. The main problem to solve is the convergence speed. Two-phase Q-learning can be used to speed up the learning process [2]. Efficient prelearning phase uses mathematical model, following tutorage phase runs on real system and uses conventional Q-learning. This method can increase learning speed significantly, however there are still certain issues remaining to solve in order to improve the overall performance of the controllers based on Q-learning. When the table is used as Q-function approximation, the learning speed and precision of found controllers depend highly on the Q-function table grid properties. The paper is denoted to the determination of optimum grid with respect to the properties of controllers found by given method. Comparison of the results with performance of referential PID controller is included. Obtained results indicate that using nonlinear grid of Q-function table approximation improves the performance in terms of quadratic control quality criterion values, however, regarding the robustness against variables observation error and action delay the effect of nonlinear grid is questionable, improving the robustness for reduced state definitions only and degrading the robustness for common state definition which considers rotor deflection, velocity and acceleration as system state variables

Klíčová slova

Reinforcement learning, Q-learning, Active Magnetic Bearing, Control

Autoři

BŘEZINA, T., KREJSA, J.

Rok RIV

2003

Vydáno

24. 3. 2003

Nakladatel

Institute of Mechanics of Solids Faculty of Mechanical Engineering Brno University of Technologi

Místo

Brno

ISBN

80-214-2312-9

Kniha

Mechtronics, Robotics and Biomechanics 2003

Číslo edice

1

Strany od

55

Strany do

56

Strany počet

2

BibTex

@inproceedings{BUT9733,
  author="Tomáš {Březina} and Jiří {Krejsa}",
  title="DETERMINATION OF Q-FUNCTION OPTIMUM GRID APPLIED ON ACTIVE MAGNETIC BEARING CONTROL TASK",
  booktitle="Mechtronics, Robotics and Biomechanics 2003",
  year="2003",
  number="1",
  pages="2",
  publisher="Institute of Mechanics of Solids
Faculty of Mechanical Engineering
Brno University of Technologi",
  address="Brno",
  isbn="80-214-2312-9"
}