All Topics  
Control theory

 

   Email Print
   Bookmark   Link






 

Control theory



 
 
Control theory is an interdisciplinary branch of engineering
Engineering

Engineering is the discipline and profession of applying Technology and science knowledge and utilizing natural laws and physical resources in order to design and implement materials, structures, machines, devices, systems, and process that safely realize a desired objective and meet specified criteria....
 and mathematics
Mathematics

Mathematics is the study of quantity, structure, space, change, and related topics of pattern and form. Mathematicians seek out patterns whether found in numbers, space, natural science, computers, imaginary abstractions, or elsewhere....
, that deals with the behavior of dynamical system
Dynamical system

The dynamical system concept is a mathematics formalization for any fixed "rule" which describes the time dependence of a point's position in its ambient space....
s. The desired output of a system is called the reference. When one or more output variables of a system need to follow a certain reference over time, a controller
Controller (control theory)

In control theory, a controller is a device which monitors and affects the operational conditions of a given dynamical system. The operational conditions are typically referred to as output variables of the system which can be affected by adjusting certain inputs variables....
 manipulates the inputs to a system to obtain the desired effect on the output of the system.

rol theory is

ider an automobile's cruise control
Cruise control

Cruise control is a system that automatically controls the rate of motion of a motor vehicle. The driver sets the speed and the system will take over the throttle of the car to maintain the same speed....
, which is a device designed to maintain a constant vehicle speed; the desired or reference speed, provided by the driver.






Discussion
Ask a question about 'Control theory'
Start a new discussion about 'Control theory'
Answer questions from other users
Full Discussion Forum



Encyclopedia


Control theory is an interdisciplinary branch of engineering
Engineering

Engineering is the discipline and profession of applying Technology and science knowledge and utilizing natural laws and physical resources in order to design and implement materials, structures, machines, devices, systems, and process that safely realize a desired objective and meet specified criteria....
 and mathematics
Mathematics

Mathematics is the study of quantity, structure, space, change, and related topics of pattern and form. Mathematicians seek out patterns whether found in numbers, space, natural science, computers, imaginary abstractions, or elsewhere....
, that deals with the behavior of dynamical system
Dynamical system

The dynamical system concept is a mathematics formalization for any fixed "rule" which describes the time dependence of a point's position in its ambient space....
s. The desired output of a system is called the reference. When one or more output variables of a system need to follow a certain reference over time, a controller
Controller (control theory)

In control theory, a controller is a device which monitors and affects the operational conditions of a given dynamical system. The operational conditions are typically referred to as output variables of the system which can be affected by adjusting certain inputs variables....
 manipulates the inputs to a system to obtain the desired effect on the output of the system.

Overview

Control theory is
  • a theory that deals with influencing the behavior of dynamical system
    Dynamical system

    The dynamical system concept is a mathematics formalization for any fixed "rule" which describes the time dependence of a point's position in its ambient space....
    s
  • an interdisciplinary subfield of science, which originated in engineering
    Engineering

    Engineering is the discipline and profession of applying Technology and science knowledge and utilizing natural laws and physical resources in order to design and implement materials, structures, machines, devices, systems, and process that safely realize a desired objective and meet specified criteria....
     and mathematics
    Mathematics

    Mathematics is the study of quantity, structure, space, change, and related topics of pattern and form. Mathematicians seek out patterns whether found in numbers, space, natural science, computers, imaginary abstractions, or elsewhere....
    , and evolved into use by the social sciences, like psychology
    Psychology

    Psychology is an academic and applied science discipline involving the science study of human mental functions and behavior. Occasionally it also relies on symbolic hermeneutics and critical theory, although these traditions are less pronounced than in other social sciences such as sociology....
    , sociology
    Control theory (sociology)

    Control theory, as an extension to the field of psychoanalysis, postulates human behaviors driven by the therapeutic function of taming the threatening otherness of one's surroundings....
     and criminology
    Criminology

    Criminology is the social science approach to the study of crime as an individual and social phenomenon. Criminological research areas include the incidence and forms of crime as well as its causes and consequences....
    .


An example

Consider an automobile's cruise control
Cruise control

Cruise control is a system that automatically controls the rate of motion of a motor vehicle. The driver sets the speed and the system will take over the throttle of the car to maintain the same speed....
, which is a device designed to maintain a constant vehicle speed; the desired or reference speed, provided by the driver. The system in this case is the vehicle. The system output is the vehicle speed, and the control variable is the engine's throttle
Throttle

A throttle is the mechanism by which the flow of a fluid is managed by constriction or obstruction. An engine's power can be increased or decreased by the restriction of inlet gases ....
 position which influences engine torque
Torque

Torque is the tendency of a force to rotate an object about an axis . Just as a force is a push or a pull, a torque can be thought of as a twist....
 output.

A simple way to implement cruise control is to lock the throttle position when the driver engages cruise control. However, on mountain terrain, the vehicle will slow down going uphill and accelerate going downhill. In fact, any parameter different than what was assumed at design time will translate into a proportional error in the output velocity, including exact mass of the vehicle, wind resistance, and tire pressure. This type of controller is called an open-loop controller
Open-loop controller

An open-loop controller, also called a non-feedback controller, is a type of Controller which computes its input into a system using only the current state and its mathematical model of the system....
 because there is no direct connection between the output of the system (the vehicle's speed) and the actual conditions encountered; that is to say, the system does not and can not compensate for unexpected forces.

In a closed-loop control system, a sensor monitors the output (the vehicle's speed) and feeds the data to a computer which continuously adjusts the control input (the throttle) as necessary to keep the control error to a minimum (to maintain the desired speed). Feedback on how the system is actually performing allows the controller (vehicle's on board computer) to dynamically compensate for disturbances to the system, such as changes in slope of the ground or wind speed. An ideal feedback control system cancels out all errors, effectively mitigating the effects of any forces that may or may not arise during operation and producing a response in the system that perfectly matches the user's wishes.

History


Although control systems of various types date back to antiquity, a more formal analysis of the field began with a dynamics analysis of the centrifugal governor
Centrifugal governor

A centrifugal governor is a specific type of governor that controls the speed of an engine by regulating the amount of fuel admitted, so as to maintain a near constant speed whatever the load or fuel supply conditions....
, conducted by the physicist James Clerk Maxwell
James Clerk Maxwell

James Clerk Maxwell was a Scotland Mathematical physics. His most significant achievement was the development of the classical electromagnetic theory, synthesizing all previous unrelated observations, experiments and equations of electricity, magnetism and even optics into a consistent theory....
 in 1868 entitled On Governors. This described and analyzed the phenomenon of "hunting", in which lags in the system can lead to overcompensation and unstable behavior. This generated a flurry of interest in the topic, during which Maxwell's classmate Edward John Routh generalized the results of Maxwell for the general class of linear systems. Independently, Adolf Hurwitz
Adolf Hurwitz

Adolf Hurwitz , was a Germany mathematician, and was described by Jean-Pierre Serre as "one of the most important figures in mathematics in the second half of the nineteenth century"....
 analyzed system stability using differential equations in 1877. This result is called the Routh-Hurwitz theorem.

A notable application of dynamic control was in the area of manned flight. The Wright Brothers
Wright brothers

The Wright brothers, Orville and Wilbur , were two United States who are generally credited with inventing and building the world's first successful fixed-wing aircraft and making the first controlled, powered and sustained heavier-than-air Flight#Mechanical flight, on December 17, 1903....
 made their first successful test flights on December 17, 1903 and were distinguished by their ability to control their flights for substantial periods (more so than the ability to produce lift from an airfoil, which was known). Control of the airplane was necessary for safe flight.

By World War II
World War II

World War II, or the Second World War , was a global military conflict which involved a Participants in World War II, including all of the great powers, organised into two opposing military alliances: the Allies of World War II and the Axis powers....
, control theory was an important part of fire-control system
Fire-control system

A fire-control system is a computer, often mechanical, which is designed to assist a weapon system in hitting its target. It performs the same task as a human gunner firing a weapon, but attempts to do so faster and more accurately....
s, guidance system
Guidance system

A guidance system is a device or group of devices used to navigation a ship, aircraft, missile, rocket, satellite, or other craft. Typically, this refers to a system that navigates without direct or continuous human control....
s and electronics
Electronics

Electronics refers to the flow of charge through nonmetal electrical conductor , whereas electrical refers to the flow of charge through metal electrical conductor....
. The Space Race
Space Race

File:Space race1.jpgThe Space Race was a competition of space exploration between the Soviet Union and the United States, which lasted roughly from 1957 to 1975....
 also depended on accurate spacecraft control. However, control theory also saw an increasing use in fields such as economics
Economics

File:Ballard Farmers' Market - vegetables.jpgEconomics is the Social sciences that studies the Production theory basics, Distribution , and Consumption of Good and Service ....
.

People in systems and control

Many active and historical figures made significant contribution to control theory, including, for example:
  • Alexander Lyapunov (1857-1918) in the 1890s marks the beginning of stability theory
    Stability theory

    In mathematics, stability theory deals with the stability of solutions for differential equations and dynamical systems....
    .
  • Harold S. Black
    Harold Stephen Black

    Harold Stephen Black was an American electrical engineer, who revolutionized the field of applied electronics by inventing the negative feedback amplifier in 1927....
     (1898-1983), invented the concept of negative feedback amplifiers in 1927. He managed to develop stable negative feedback amplifiers in the 1930s.
  • Harry Nyquist
    Harry Nyquist

    Harry Nyquist , was an important contributor to information theory....
     (1889-1976), developed the Nyquist stability criterion
    Nyquist stability criterion

    The Nyquist stability criterion, named after Harry Nyquist, provides a simple test for BIBO stability of a closed-loop control system by examining the open-loop system's Nyquist plot....
     for feedback systems in the 1930s.
  • Richard Bellman
    Richard Bellman

    Richard Ernest Bellman was an applied mathematics, celebrated for his invention of dynamic programming in 1953, and important contributions in other fields of mathematics....
     (1920-1984), developed dynamic programming
    Dynamic programming

    In mathematics and computer science, dynamic programming is a method of solving problems that exhibit the properties of overlapping subproblems and optimal substructure ....
     since the 1940s.
  • Norbert Wiener
    Norbert Wiener

    Norbert Wiener was an United States theoretical and applied math mathematician.Wiener was a pioneer in the study of stochastic processes and noise processes, contributing work relevant to electronic engineering, electronic communication, and control systems....
     (1894-1964) co-developed the Wiener-Kolmogorov filter
    Wiener filter

    In signal processing, the Wiener filter is a filter proposed by Norbert Wiener during the 1940s and published in 1949. Its purpose is to reduce the amount of noise present in a signal by comparison with an estimation of the desired noiseless signal....
     and coined the term cybernetics
    Cybernetics

    Cybernetics is the interdisciplinary study of the structure of regulatory systems. Cybernetics is closely related to control theory and systems theory....
     in the 1940s.
  • John R. Ragazzini
    John R. Ragazzini

    John Ralph Ragazzini was an United States electrical engineer and a professor of Electrical Engineering. Ragazzini was born in New York and received the degrees of B.S....
     (1912-1988) introduced digital control
    Digital control

    Digital control is a branch of control theory that uses digital computers to act as system controllers.Depending on the requirements, a digital control system can take the form of a microcontroller to an Application-specific integrated circuit to a standard desktop computer....
     and the z-transform
    Z-transform

    In mathematics and signal processing, the Z-transform converts a discrete_mathematics time-domain signal, which is a sequence of real number or complex numbers, into a complex frequency-domain representation....
     in the 1950s.


Classical control theory

To avoid the problems of the open-loop controller, control theory introduces feedback
Feedback

Feedback describes the situation when output from an event or phenomenon in the past will influence the same event/phenomenon in the present or future....
. A closed-loop controller
Controller (control theory)

In control theory, a controller is a device which monitors and affects the operational conditions of a given dynamical system. The operational conditions are typically referred to as output variables of the system which can be affected by adjusting certain inputs variables....
 uses feedback to control states
State (controls)

In control theory, states are what characterize a system. With linear systems states are not unique, but can be transformed into equivalent states using certain linear transformations....
 or output
Output

Output is the term denote either an exit or changes which exit a system and which activate/modify a process. It is an abstract concept, used in the model ing, system design and system exploitation....
s of a dynamical system
Dynamical system

The dynamical system concept is a mathematics formalization for any fixed "rule" which describes the time dependence of a point's position in its ambient space....
. Its name comes from the information path in the system: process inputs (e.g. voltage
Voltage

Electrical tension is the potential difference between two points of an electrical or electronic circuit, expressed in volts. It is the measurement of the potential for an electric field to cause an electric current in an electrical conductor....
 applied to an electric motor
Electric motor

An electric motor uses electrical energy to produce mechanical energy, nearly always by the interaction of magnetic fields and current-carrying conductors....
) have an effect on the process outputs (e.g. velocity or torque of the motor), which is measured with sensor
Sensor

A sensor is a device that measures a physical quantity and converts it into a signal which can be read by an observer or by an instrument. For example, a mercury thermometer converts the measured temperature into expansion and contraction of a liquid which can be read on a calibrated glass tube....
s and processed by the controller; the result (the control signal) is used as input to the process, closing the loop.

Closed-loop controllers have the following advantages over open-loop controller
Open-loop controller

An open-loop controller, also called a non-feedback controller, is a type of Controller which computes its input into a system using only the current state and its mathematical model of the system....
s:
  • disturbance rejection (such as unmeasured friction in a motor)
  • guaranteed performance even with model
    Mathematical model

    A mathematical model uses mathematics language to describe a system. Mathematical models are used not only in the natural sciences and engineering disciplines but also in the social sciences ; physicists, engineers, computer sciences, and economists use mathematical models most extensively....
     uncertainties, when the model structure does not match perfectly the real process and the model parameters are not exact
  • unstable
    Instability

    Instability in systems is generally characterized by some of the outputs or internal state growing without bounds. Not all systems that are not stability are unstable; systems can also be marginal stability or exhibit limit cycle behavior....
     processes can be stabilized
  • reduced sensitivity to parameter variations
  • improved reference tracking performance


In some systems, closed-loop and open-loop control are used simultaneously. In such systems, the open-loop control is termed feedforward
Feed-forward

Feed-forward is a term describing an element or pathway within a control system which passes a controlling signal from a source in the control system's external environment, often a command signal from an external operator, to a load elsewhere in its external environment....
 and serves to further improve reference tracking performance.

A common closed-loop controller architecture is the PID controller
PID controller

A proportional?integral?derivative controller is a generic control loop feedback mechanism widely used in industrial control systems. A PID controller attempts to correct the error between a measured process variable and a desired Setpoint by calculating and then outputting a corrective action that can adjust the process accordingly....
.

Closed-loop transfer function

The output of the system y(t) is fed back through a sensor measurement F to the reference value r(t). The controller C then takes the error e (difference) between the reference and the output to change the inputs u to the system under control P. This is shown in the figure. This kind of controller is a closed-loop controller or feedback controller.

This is called a single-input-single-output (SISO) control system; MIMO (i.e. Multi-Input-Multi-Output) systems, with more than one input/output, are common. In such cases variables are represented through vector
Coordinate vector

In linear algebra, a coordinate vector is an explicit representation of a vector in an Real_coordinate_space#Intuitive_overview as an ordered list of numbers or, equivalently, as an element of the coordinate space Fn....
s instead of simple scalar
Scalar (mathematics)

In linear algebra, real numbers are called scalars and relate to vectors in a vector space through the operation of scalar multiplication, in which a vector can be multiplied by a number to produce another vector....
 values. For some distributed parameter systems
Distributed parameter systems

A distributed parameter system is a system whose state space is infinite-dimension . A body whose state is heterogeneous has a distributed parameter....
 the vectors may be infinite-dimensional
Dimension (vector space)

In mathematics, the dimension of a vector space V is the cardinal number of a basis of V. It is sometimes called Hamel dimension or algebraic dimension to distinguish it from other types of dimension....
 (typically functions).

If we assume the controller C, the plant P, and the sensor F are linear
Linear

The word linear comes from the Latin word linearis, which means created by lines.In mathematics, a linear map or function f is a function which satisfies the following two properties......
 and time-invariant (i.e.: elements of their transfer function
Transfer function

A transfer function is a mathematical representation, in terms of spatial or temporal frequency, of the relation between the input and output of a system analysis....
 C(s), P(s), and F(s) do not depend on time), the systems above can be analysed using the Laplace transform
Laplace transform

In mathematics, the Laplace transform is one of the best known and most widely used integral transforms. It is commonly used to produce an easily solvable algebraic equation from an ordinary differential equation....
 on the variables. This gives the following relations:



Solving for Y(s) in terms of R(s) gives:



The expression is referred to as the closed-loop transfer function of the system. The numerator is the forward (open-loop) gain from r to y, and the denominator is one plus the gain in going around the feedback loop, the so-called loop gain. If , i.e. it has a large norm
Norm (mathematics)

In linear algebra, functional analysis and related areas of mathematics, a norm is a function that assigns a strictly positive length or size to all vectors in a vector space, other than the zero vector....
 with each value of s, and if , then Y(s) is approximately equal to R(s). This means simply setting the reference controls the output.

PID controller

The PID controller
PID controller

A proportional?integral?derivative controller is a generic control loop feedback mechanism widely used in industrial control systems. A PID controller attempts to correct the error between a measured process variable and a desired Setpoint by calculating and then outputting a corrective action that can adjust the process accordingly....
 is probably the most-used feedback control design. "PID" means Proportional-Integral-Derivative, referring to the three terms operating on the error signal to produce a control signal. If u(t) is the control signal sent to the system, y(t) is the measured output and r(t) is the desired output, and tracking error , a PID controller has the general form

The desired closed loop dynamics is obtained by adjusting the three parameters , and , often iteratively by "tuning" and without specific knowledge of a plant model. Stability can often be ensured using only the proportional term. The integral term permits the rejection of a step disturbance (often a striking specification in process control
Process control

Process control is a statistics and engineering discipline that deals with architectures, Mechanism s, and algorithms for controlling the output of a specific process....
). The derivative term is used to provide damping or shaping of the response. PID controllers are the most well established class of control systems: however, they cannot be used in several more complicated cases, especially if MIMO systems are considered.

Applying Laplace transformation results in the transformed PID controller equation

with the PID controller transfer function

Modern control theory

In contrast to the frequency domain analysis of the classical control theory, modern control theory utilizes the time-domain state space
State space (controls)

In control engineering, a state space representation is a mathematical model of a physical system as a set of input, output and state variables related by first-order differential equations....
 representation, a mathematical model of a physical system as a set of input, output and state variables related by first-order differential equations. To abstract from the number of inputs, outputs and states, the variables are expressed as vectors and the differential and algebraic equations are written in matrix form (the last one can be done when the dynamical system is linear and time invariant). The state space representation (also known as the "time-domain approach") provides a convenient and compact way to model and analyze systems with multiple inputs and outputs. With inputs and outputs, we would otherwise have to write down Laplace transforms to encode all the information about a system. Unlike the frequency domain approach, the use of the state space representation is not limited to systems with linear components and zero initial conditions. "State space" refers to the space whose axes are the state variables. The state of the system can be represented as a vector within that space.

Topics in control theory


Stability


The stability of a general dynamical system
Dynamical system

The dynamical system concept is a mathematics formalization for any fixed "rule" which describes the time dependence of a point's position in its ambient space....
 with no input can be described with Lyapunov stability
Lyapunov stability

In mathematics, the notion of Lyapunov stability occurs in the study of dynamical systems. In simple terms, if all solutions of the dynamical system that start out near an equilibrium point stay near forever, then is Lyapunov stable....
 criteria. A linear system
Linear system

A linear system is a mathematical model of a system based on the use of a linear operator.Linear systems typically exhibit features and properties that are much simpler than the general, nonlinear case....
 that takes an input is called bounded-input bounded-output (BIBO) stable
BIBO stability

In electrical engineering, specifically signal processing and control theory, BIBO stability is a form of Control theory#Stability for linear system Signal s and systems that take inputs....
 if its output will stay bounded
Bounded function

In mathematics, a function f defined on some Set X with real number or complex number values is called bounded, if the set of its values is bounded set....
 for any bounded input. Stability for nonlinear systems that take an input is input-to-state stability (ISS), which combines Lyapunov stability and a notion similar to BIBO stability. For simplicity, the following descriptions focus on continuous-time and discrete-time linear systems.

Mathematically, this means that for a causal linear system to be stable all of the poles
Pole (complex analysis)

In complex analysis, a mathematical discipline, a pole of a meromorphic function is a certain type of mathematical singularity that behaves like the singularity of at ....
 of its transfer function
Transfer function

A transfer function is a mathematical representation, in terms of spatial or temporal frequency, of the relation between the input and output of a system analysis....
 must satisfy some criteria depending on whether a continuous or discrete time analysis is used:
  • In continuous time, the Laplace transform
    Laplace transform

    In mathematics, the Laplace transform is one of the best known and most widely used integral transforms. It is commonly used to produce an easily solvable algebraic equation from an ordinary differential equation....
     is used to obtain the transfer function. A system is stable if the poles of this transfer function lie strictly in the closed left half of the complex plane
    Complex plane

    In mathematics, the complex plane is a geometric representation of the complex numbersestablished by the real axis and the orthogonal imaginary axis....
     (i.e. the real part of all the poles is less than zero).
  • In discrete time the Z-transform
    Z-transform

    In mathematics and signal processing, the Z-transform converts a discrete_mathematics time-domain signal, which is a sequence of real number or complex numbers, into a complex frequency-domain representation....
     is used. A system is stable if the poles of this transfer function lie strictly inside the unit circle
    Unit circle

    In mathematics, a unit circle is a circle with a 1 radius, i.e., a circle whose radius is 1. Frequently, especially in trigonometry, "the" unit circle is the circle of radius 1 centered at the origin in the Cartesian coordinate system in the Euclidean plane....
    . i.e. the magnitude of the poles is less than one).


When the appropriate conditions above are satisfied a system is said to be asymptotically stable
Asymptotic stability

In control theory, a continuous LTI system theory is exponentially stable if and only if the system has eigenvalues with strictly negative real parts....
: the variables of an asymptotically stable control system always decrease from their initial value and do not show permanent oscillations. Permanent oscillations occur when a pole has a real part exactly equal to zero (in the continuous time case) or a modulus equal to one (in the discrete time case). If a simply stable system response neither decays nor grows over time, and has no oscillations, it is marginally stable
Marginal stability

In the theory of dynamical systems, and control theory, a continuous linear system time-invariant system is marginally stable if and only if the real part of every eigenvalue in the system's transfer-function is non-positive, and all eigenvalues with zero real value are simple roots ....
: in this case the system transfer function has non-repeated poles at complex plane origin (i.e. their real and complex component is zero in the continuous time case). Oscillations are present when poles with real part equal to zero have an imaginary part not equal to zero.

Differences between the two cases are not a contradiction. The Laplace transform is in Cartesian coordinates and the Z-transform is in circular coordinates, and it can be shown that
  • the negative-real part in the Laplace domain can map onto the interior of the unit circle
  • the positive-real part in the Laplace domain can map onto the exterior of the unit circle


If a system in question has an impulse response
Impulse response

The impulse response of a system is its output when presented with a very brief input signal, an impulse. Mathematically, an impulse can be modeled as a Dirac delta function for continuous-time systems, or as the Kronecker delta for discrete-time systems....
 of

then the Z-transform
Z-transform

In mathematics and signal processing, the Z-transform converts a discrete_mathematics time-domain signal, which is a sequence of real number or complex numbers, into a complex frequency-domain representation....
 (see this example
Z-transform

In mathematics and signal processing, the Z-transform converts a discrete_mathematics time-domain signal, which is a sequence of real number or complex numbers, into a complex frequency-domain representation....
), is given by

which has a pole in (zero imaginary part
Imaginary number

In mathematics, an imaginary number is a complex number whose square value is a real number not greater than zero. The imaginary unit, denoted by i or j, is an example of an imaginary number....
). This system is BIBO (asymptotically) stable since the pole is inside the unit circle.

However, if the impulse response was

then the Z-transform is

which has a pole at and is not BIBO stable since the pole has a modulus strictly greater than one.

Numerous tools exist for the analysis of the poles of a system. These include graphical systems like the root locus
Root locus

In control theory, the root locus is the Locus of the Pole and zeros of a transfer function as the system gain K is varied on some interval....
, Bode plot
Bode plot

A Bode magnitude plot is a plot of logarithm magnitude versus frequency, plotted with a log-frequency axis, to show the transfer function or frequency response of a LTI system theory system....
s or the Nyquist plot
Nyquist plot

A Nyquist plot is used in control system and signal processing for assessing the stability of a system with feedback. It is represented by a graph in polar coordinates in which the gain and phase of a frequency response are plotted....
s.

Mechanical changes can make equipment (and control systems) more stable. Sailors add ballast to improve the stability of ships. Cruise ships use antiroll fins that extend transversely from the side of the ship for perhaps 30 feet (10 metres) and are continuously rotated about their axes to develop forces that oppose the roll.

Controllability and observability


Controllability
Controllability

Controllability is an important property of a control system, and the controllability property plays a crucial role in many control problems, such as stabilization of BIBO stability by feedback, or optimal control....
 and observability
Observability

Observability, in control theory, is a measure for how well internal states of a system can be inferred by knowledge of its external outputs. The observability and controllability of a system are mathematical duality ....
 are main issues in the analysis of a system before deciding the best control strategy to be applied, or whether it is even possible to control or stabilize the system. Controllability is related to the possibility of forcing the system into a particular state by using an appropriate control signal. If a state is not controllable, then no signal will ever be able to control the state. If a state is not controllable, but its dynamics are stable, then the state it is termed Stabilizable. Observability instead is related to the possibility of "observing", through output measurements, the state of a system. If a state is not observable, the controller will never be able to determine the behaviour of an unobservable state and hence cannot use it to stabilize the system. However, similar to the stabilizability condition above, if a state cannot be observed it might still be detectable.

From a geometrical point of view, looking at the states of each variable of the system to be controlled, every "bad" state of these variables must be controllable and observable to ensure a good behaviour in the closed-loop system. That is, if one of the eigenvalues of the system is not both controllable and observable, this part of the dynamics will remain untouched in the closed-loop system. If such an eigenvalue is not stable, the dynamics of this eigenvalue will be present in the closed-loop system which therefore will be unstable. Unobservable poles are not present in the transfer function realization of a state-space representation, which is why sometimes the latter is preferred in dynamical systems analysis.

Solutions to problems of uncontrollable or unobservable system include adding actuators and sensors.

Control specifications

Several different control strategies have been devised in the past years. These vary from extremely general ones (PID controller
PID controller

A proportional?integral?derivative controller is a generic control loop feedback mechanism widely used in industrial control systems. A PID controller attempts to correct the error between a measured process variable and a desired Setpoint by calculating and then outputting a corrective action that can adjust the process accordingly....
), to others devoted to very particular classes of systems (especially robotics
Robotics

Robotics is the science and technology of robots, and their design, manufacture, and application. Robotics has connections to electronics, mechanics, and software....
 or aircraft
Aircraft

An aircraft is a vehicle which is able to flight by being supported by the air, or in general, the atmosphere, of a planet. Examples include balloons, airplanes and helicopters....
 cruise control).

A control problem can have several specifications. Stability, of course, is always present: the controller must ensure that the closed-loop system is stable, regardless of the open-loop stability. A poor choice of controller can even worsen the stability of the open-loop system, which must normally be avoided. Sometimes it would be desired to obtain particular dynamics in the closed loop: i.e. that the poles have , where is a fixed value strictly greater than zero, instead of simply ask that .

Another typical specification is the rejection of a step disturbance; including an integrator
Integrator

An integrator is a device to perform the mathematical operation known as integral, a fundamental operation in calculus.The integration function is often part of engineering, physics, machine, chemical and science calculations....
 in the open-loop chain (i.e. directly before the system under control) easily achieves this. Other classes of disturbances need different types of sub-systems to be included.

Other "classical" control theory specifications regard the time-response of the closed-loop system: these include the rise time
Rise time

In electronics, when describing a voltage or current step function, rise time refers to the time required for a signal to change from a specified low value to a specified high value....
 (the time needed by the control system to reach the desired value after a perturbation), peak overshoot
Overshoot

The term overshoot has the following meanings:...
 (the highest value reached by the response before reaching the desired value) and others (settling time
Settling time

The settling time of an amplifier or other output device is the time elapsed from the application of an ideal instantaneous step input to the time at which the amplifier output has entered and remained within a specified error band, usually symmetrical about the final value....
, quarter-decay). Frequency domain specifications are usually related to robustness (see after).

Modern performance assessments use some variation of integrated tracking error (IAE,ISA,CQI).

Model identification and robustness

A control system must always have some robustness property. A robust control
Robust control

Robust control is a branch of control theory that explicitly deals with uncertainty in its approach to controller design. Controllers designed using robust control methods tend to be able to cope with small differences between the true system and the nominal model used for design....
ler is such that its properties do not change much if applied to a system slightly different from the mathematical one used for its synthesis. This specification is important: no real physical system truly behaves like the series of differential equations used to represent it mathematically. Typically a simpler mathematical model is chosen in order to simplify calculations, otherwise the true system dynamics can be so complicated that a complete model is impossible.

System identification The process of determining the equations that govern the model's dynamics is called system identification
System identification

System identification is a general term to describe mathematical tools and algorithms that build dynamical mathematical model from measured data....
. This can be done off-line: for example, executing a series of measures from which to calculate an approximated mathematical model, typically its transfer function
Transfer function

A transfer function is a mathematical representation, in terms of spatial or temporal frequency, of the relation between the input and output of a system analysis....
 or matrix. Such identification from the output, however, cannot take account of unobservable dynamics. Sometimes the model is built directly starting from known physical equations: for example, in the case of a mass-spring-damper
Damping

Damping is any effect, either deliberately engendered or inherent to a system, that tends to reduce the amplitude of oscillations of an oscillatory system....
 system we know that . Even assuming that a "complete" model is used in designing the controller, all the parameters included in these equations (called "nominal parameters") are never known with absolute precision; the control system will have to behave correctly even when connected to physical system with true parameter values away from nominal.

Some advanced control techniques include an "on-line" identification process (see later). The parameters of the model are calculated ("identified") while the controller itself is running: in this way, if a drastic variation of the parameters ensues (for example, if the robot's arm releases a weight), the controller will adjust itself consequently in order to ensure the correct performance.

Analysis Analysis of the robustness of a SISO control system can be performed in the frequency domain, considering the system's transfer function and using Nyquist and Bode diagrams. Topics include gain and phase margin
Bode plot

A Bode magnitude plot is a plot of logarithm magnitude versus frequency, plotted with a log-frequency axis, to show the transfer function or frequency response of a LTI system theory system....
 and amplitude margin. For MIMO and, in general, more complicated control systems one must consider the theoretical results devised for each control technique (see next section): i.e., if particular robustness qualities are needed, the engineer must shift his attention to a control technique including them in its properties.

Constraints A particular robustness issue is the requirement for a control system to perform properly in the presence of input and state constraints. In the physical world every signal is limited. It could happen that a controller will send control signals that cannot be followed by the physical system: for example, trying to rotate a valve at excessive speed. This can produce undesired behavior of the closed-loop system, or even break actuators or other subsystems. Specific control techniques are available to solve the problem: model predictive control
Model predictive control

Model Predictive Control, or MPC, is an advanced method of process control that has been in use in the processing industries such as chemical plants and oil refineries since the 1980s....
 (see later), and anti-wind up systems. The latter consists of an additional control block that ensures that the control signal never exceeds a given threshold.

System classifications


Linear control

For MIMO systems, pole placement can be performed mathematically using a state space representation
State space (controls)

In control engineering, a state space representation is a mathematical model of a physical system as a set of input, output and state variables related by first-order differential equations....
 of the open-loop system and calculating a feedback matrix assigning poles in the desired positions. In complicated systems this can require computer-assisted calculation capabilities, and cannot always ensure robustness. Furthermore, all system states are not in general measured and so observers must be included and incorporated in pole placement design.

Nonlinear control

Processes in industries like robotics
Robotics

Robotics is the science and technology of robots, and their design, manufacture, and application. Robotics has connections to electronics, mechanics, and software....
 and the aerospace industry typically have strong nonlinear dynamics. In control theory it is sometimes possible to linearize such classes of systems and apply linear techniques: but in many cases it can be necessary to devise from scratch theories permitting control of nonlinear systems. These, e.g., feedback linearization
Feedback linearization

Feedback linearization is a common approach used in controlling nonlinear systems. The approach involves coming up with a transformation of the nonlinear system into an equivalent linear system, through a change of variables and a suitable control input....
, backstepping
Backstepping

In control theory, backstepping is a technique developed circa 1990 by Petar V. Kokotovic and others for designing Lyapunov stability controls for a special class of nonlinear system dynamical systems....
, sliding mode control
Sliding mode control

In control theory, sliding mode control, or SMC, is a form of variable structure control . It is a nonlinear control method that alters the dynamic system of a nonlinear system by application of a high-frequency switching control....
, trajectory linearization control normally take advantage of results based on Lyapunov's theory. Differential geometry has been widely used as a tool for generalizing well-known linear control concepts to the non-linear case, as well as showing the subtleties that make it a more challenging problem.

Main control strategies

Every control system must guarantee first the stability of the closed-loop behavior. For linear system
Linear system

A linear system is a mathematical model of a system based on the use of a linear operator.Linear systems typically exhibit features and properties that are much simpler than the general, nonlinear case....
s, this can be obtained by directly placing the poles. Non-linear control systems use specific theories (normally based on Aleksandr Lyapunov
Aleksandr Lyapunov

Aleksandr Mikhailovich Lyapunov was a Russians mathematician, mechanician and physicist. His surname is sometimes Romanization of Russian as Ljapunov, Liapunov or Ljapunow....
's Theory) to ensure stability without regard to the inner dynamics of the system. The possibility to fulfill different specifications varies from the model considered and the control strategy chosen. Here a summary list of the main control techniques is shown:

Adaptive control : Adaptive control
Adaptive control

Adaptive control involves modifying the control law used by a controller to cope with the fact that the parameters of the system being controlled are slowly time-varying or uncertain....
 uses on-line identification of the process parameters, or modification of controller gains, thereby obtaining strong robustness properties. Adaptive controls were applied for the first time in the aerospace industry in the 1950s, and have found particular success in that field.

Hierarchical control : A Hierarchical control system
Hierarchical control system

A Hierarchical control system is a form of Control System in which a set of devices and governing software is arranged in a hierarchical tree . When the links in the tree are implemented by a computer network, then that hierarchical control system is also a form of Networked control system....
 is a type of Control System
Control system

A control system is a device or set of devices to manage, command, direct or regulate the behavior of other devices or systems.There are two common classes of control systems, with many variations and combinations: logic gate, and feedback or linear controls....
 in which a set of devices and governing software is arranged in a hierarchical tree
Tree (data structure)

In computer science, a tree is a widely-used data structure that emulates a hierarchical tree structure with a set of linked Vertex_. It is an acyclic connected graph where each node has a set of zero or more children nodes, and at most one parent node....
. When the links in the tree are implemented by a computer network
Computer network

A computer network is a group of interconnected computers. Networks may be classified according to a wide variety of characteristics. This article provides a general overview of some types and categories and also presents the basic components of a network....
, then that hierarchical control system is also a form of Networked control system
Networked control system

A Networked Control System is a control system wherein the control loops are closed through a real-time computer network. The defining feature of an NCS is that control and feedback signals are exchanged among the system's components in the form of information packages through a network....
.

Intelligent control : Intelligent control
Intelligent control

Intelligent control is a class of control techniques, that use various AI computing approaches like neural networks, Bayesian probability, fuzzy logic, machine learning, evolutionary computation and genetic algorithms....
 use various AI computing approaches like neural networks
Neural Networks

Neural Networks is the official journal of the three oldest societies dedicated to research in neural networks: International Neural Network Society, European Neural Network Society and Japanese Neural Network Society, published by Elsevier....
, Bayesian probability
Bayesian probability

Bayesian probability interprets the concept of probability as 'a measure of a state of knowledge' , and not as a frequentist . Broadly speaking, there are two views on Bayesian probability that interpret the 'state of knowledge' concept in different ways....
, fuzzy logic
Fuzzy logic

Fuzzy logic is a form of multi-valued logic derived from fuzzy set theory to deal with reasoning that is approximate rather than precise. In binary sets with binary logic, in contrast to fuzzy logic named also crisp logic, the variables may have a Membership function of only 0 or 1....
, machine learning
Machine learning

Machine learning is the subfield of artificial intelligence that is concerned with the design and development of algorithms that allow computers to improve their performance over time based on data, such as from sensor data or databases....
, evolutionary computation
Evolutionary computation

In computer science evolutionary computation is a subfield of artificial intelligence that involves combinatorial optimization problems.Evolutionary computation uses iterative progress, such as growth or development in a population....
 and genetic algorithms to control a dynamic system.

Optimal control : Optimal control
Optimal control

Optimal control theory, an extension of the calculus of variations, is a mathematical optimization method for deriving control theory. The method is largely due to the work of Lev Pontryagin and his collaborators in the Soviet Union and Richard Bellman in the United States....
 is a particular control technique in which the control signal optimizes a certain "cost index": for example, in the case of a satellite, the jet thrusts needed to bring it to desired trajectory that consume the least amount of fuel. Two optimal control design methods have been widely used in industrial applications, as it has been shown they can guarantee closed-loop stability. These are Model Predictive Control
Model predictive control

Model Predictive Control, or MPC, is an advanced method of process control that has been in use in the processing industries such as chemical plants and oil refineries since the 1980s....
 (MPC) and Linear-Quadratic-Gaussian control
Linear-quadratic-Gaussian control

In control theory, the Linear-Quadratic-Gaussian control problem is probably the most fundamental optimal control problem. It concerns uncertain linear systems disturbed by Additive white Gaussian noise, incomplete state information also disturbed by additive white Gaussian noise and quadratic cost functionals....
 (LQG). The first can more explicitly take into account constraints on the signals in the system, which is an important feature in many industrial processes. However, the "optimal control" structure in MPC is only a means to achieve such a result, as it does not optimize a true performance index of the closed-loop control system. Together with PID controllers, MPC systems are the most widely used control technique in process control
Process control

Process control is a statistics and engineering discipline that deals with architectures, Mechanism s, and algorithms for controlling the output of a specific process....
.

Robust control : Robust control
Robust control

Robust control is a branch of control theory that explicitly deals with uncertainty in its approach to controller design. Controllers designed using robust control methods tend to be able to cope with small differences between the true system and the nominal model used for design....
 deals explicitly with uncertainty in its approach to controller design. Controllers designed using robust control methods tend to be able to cope with small differences between the true system and the nominal model used for design. The early methods of Bode
Bode

Bode may refer to:in people by surname:*Boyd Henry Bode , American academic and philosopher*Denise Bode , American politician*Elert Bode , German actor...
 and others were fairly robust; the state-space methods invented in the 1960s and 1970's were sometimes found to lack robustness. A modern example of a robust control technique is H-infinity loop-shaping
H-infinity loop-shaping

H-infinity loop-shaping is a design methodology in modern control theory. It combines the traditional intuition of classical control methods with H infinity to achieve controllers whose stability and performance properties hold good in spite of small differences between the nominal plant assumed in design and the true plant encountered in pr...
 developed by Duncan McFarlane and Keith Glover of Cambridge University. Robust methods aim to achieve robust performance and/or stability
Stability theory

In mathematics, stability theory deals with the stability of solutions for differential equations and dynamical systems....
 in the presence of small modelling errors.

Stochastic control : Stochastic control
Stochastic control

Stochastic control is a subfield of control theory which addresses the design of a control methodology to address the probability of uncertainty in the data....
 deals with control design with uncertainty in the model. In typical stochastic control problems, it is assumed that there exist random noise and disturbances in the model and the controller, and the control design must take into account these random deviations.

Trim and Respond : Trim and Respond is a set point RESET sequence used to reduce energy use. For example, consider static pressure controls to an HVAC
HVAC

HVAC is an initialism or acronym that stands for "heating, Ventilation , and air conditioning". HVAC is sometimes referred to as climate control and is particularly important in the design of medium to large industrial and office buildings such as skyscrapers and in marine environments such as aquariums, where humidity and tem...
 VAV
Vav

VAV as a three-letter abbreviation may refer to* A variable air volume device, used in HVAC systems to control the flow of air* VaV Verbs and Adverbs - A method of controlling a robot through its state space...
 ducted system. Static pressure setpoint can be reset within the range 0.7 in. W.C. to 1.5 in. W.C. WHILE the commands to all dampers are <90%, THEN lower the duct static pressure set point by 0.04" W.C. every 2 minutes. WHEN the commands to two or more dampers reach 100%, THEN increases the set point by 0.06" W.C. every two minutes.

See also

Examples of control systems
  • Automation
    Automation

    Automation or industrial automation or numerical control is the use of control systems such as computers to control industry machinery and industrial processes, reducing the need for human intervention....
  • Deadbeat Controller
    Deadbeat controller

    A deadbeat controller is a classical feedback controller where the control gains are set using a table based on the plant system order and normalized natural frequency....
  • Distributed parameter systems
    Distributed parameter systems

    A distributed parameter system is a system whose state space is infinite-dimension . A body whose state is heterogeneous has a distributed parameter....
  • Fractional order control
    Fractional order control

    Fractional order control or is a field of control theory that uses the fractional order integrator as part of the control system design toolkit....
  • H-infinity loop-shaping
    H-infinity loop-shaping

    H-infinity loop-shaping is a design methodology in modern control theory. It combines the traditional intuition of classical control methods with H infinity to achieve controllers whose stability and performance properties hold good in spite of small differences between the nominal plant assumed in design and the true plant encountered in pr...
  • Hierarchical control system
    Hierarchical control system

    A Hierarchical control system is a form of Control System in which a set of devices and governing software is arranged in a hierarchical tree . When the links in the tree are implemented by a computer network, then that hierarchical control system is also a form of Networked control system....
  • PID controller
    PID controller

    A proportional?integral?derivative controller is a generic control loop feedback mechanism widely used in industrial control systems. A PID controller attempts to correct the error between a measured process variable and a desired Setpoint by calculating and then outputting a corrective action that can adjust the process accordingly....
  • Model predictive control
    Model predictive control

    Model Predictive Control, or MPC, is an advanced method of process control that has been in use in the processing industries such as chemical plants and oil refineries since the 1980s....
  • Process control
    Process control

    Process control is a statistics and engineering discipline that deals with architectures, Mechanism s, and algorithms for controlling the output of a specific process....
  • Robust control
    Robust control

    Robust control is a branch of control theory that explicitly deals with uncertainty in its approach to controller design. Controllers designed using robust control methods tend to be able to cope with small differences between the true system and the nominal model used for design....
  • Servomechanism
    Servomechanism

    A servomechanism, or servo is an automatic device that uses error-sensing feedback to correct the performance of a mechanism. The term correctly applies only to systems where the feedback or error-correction signals help control mechanical position or other parameters....
  • State space (controls)
    State space (controls)

    In control engineering, a state space representation is a mathematical model of a physical system as a set of input, output and state variables related by first-order differential equations....


Topics in control theory
  • Coefficient diagram method
    Coefficient diagram method

    Coefficient diagram method , developed and introduced by Prof. Shunji Manabe in 1991. CDM is an algebraic approach applied to a polynomial loop in the parameter space, where a special diagram called a coefficient diagram is used as the vehicle to carry the necessary information, and as the criteria of good design....
  • Control reconfiguration
    Control reconfiguration

    Control reconfiguration is an active approach in control theory to achieve Fault-Tolerant Control for dynamic systems . It is used when severe Fault , such as actuator or sensor outages, cause a break-up of the control loop, which must be restructured to prevent failure at the system level....
  • Feedback
    Feedback

    Feedback describes the situation when output from an event or phenomenon in the past will influence the same event/phenomenon in the present or future....
  • H infinity
  • Hankel singular value
    Hankel singular value

    In control theory, Hankel singular values, named after Hermann Hankel, provide a measure of energy for each state in a system. They are the basis for balanced model reduction, in which high energy states are retained while low energy states are discarded....
  • Lead-lag compensator
    Lead-lag compensator

    A lead-lag compensator is a component in a control system that improves an undesirable frequency response in a feedback and control system. It is a fundamental building block in classical control theory....
  • Radial basis function
    Radial basis function

    A radial basis function is a real-valued function whose value depends only on the distance from the Origin , so that ; or alternatively on the distance from some other point c, called a center, so that ....
  • Robotic unicycle
    Robotic unicycle

    The problem of creating a robotic unicycle, a self-powered unicycle that balances itself in three dimensions, is an interesting problem in robotics and control theory....
  • Root locus
    Root locus

    In control theory, the root locus is the Locus of the Pole and zeros of a transfer function as the system gain K is varied on some interval....
  • Signal-flow graph
    Signal-flow graph

    A signal-flow graph is a special type of block diagram?and directed graph?constrained by rigid mathematical rules, that is a graphical means of showing the relations among the variables of a set of linear algebraic relations....
    s
  • Stable polynomial
    Stable polynomial

    A polynomial is said to be stable if either:* all its roots lie in the open set left half-plane, or* all its roots lie in the open set unit disk....
  • Underactuation
    Underactuation

    Underactuation is a technical term used in robotics and control theory to describe mechanical devices that have a lower number of actuators than degrees of freedom ....


Other related topics
  • Automation and Remote Control
    Automation and Remote Control

    Automation and Remote Control - a Russian periodical, publication of Nauka Press distributed in English language exclusively by Springer Science+Business Media Science....
  • Bond graph
    Bond graph

    A bond graph is a graphical description of a physical dynamical system. It is an energy graphical technique for building mathematical models of dynamic systems....
  • Control engineering
    Control engineering

    Control engineering is the engineering discipline that applies control theory to design systems with predictable behaviors. The engineering activities focus on the mathematical modeling of systems of a diverse nature....
  • Controller (control theory)
    Controller (control theory)

    In control theory, a controller is a device which monitors and affects the operational conditions of a given dynamical system. The operational conditions are typically referred to as output variables of the system which can be affected by adjusting certain inputs variables....
  • Intelligent control
    Intelligent control

    Intelligent control is a class of control techniques, that use various AI computing approaches like neural networks, Bayesian probability, fuzzy logic, machine learning, evolutionary computation and genetic algorithms....
  • Mathematical system theory
  • Perceptual control theory
    Perceptual control theory

    Perceptual control theory is a psychological theory of animal and Human behavior originated by maverick scientist William T. Powers. In contrast with other theories of psychology and behavior, which assume that behavior is a function of perception ? that perceptual inputs determine or cause behavior ? PCT postulates that an organism's behavi...
  • Systems theory
    Systems theory

    Systems theory is an interdisciplinary field of science and the study of the nature of complex systems in nature, society, and science. More specifically, it is a framework by which one can analyze and/or describe any group of objects that work in concert to produce some result....
  • People in systems and control
    People in systems and control

    This is an alphabetical list of people who have made significant contributions in the fields of system analysis and control theory....
  • Time scale calculus
    Time scale calculus

    In mathematics, time scale calculus is a unification of the theory of difference equations with that of differential equations. Discovered in 1988 by the German mathematician Stefan Hilger, it has applications in any field that requires simultaneous modelling of discrete and continuous data....
  • Negative feedback amplifier

Further reading