A new procedure for determining the asymptotic stability with probability one of random-time-delay-controlled quasi-integrable Hamiltonian systems is proposed. Such a system is formulated as continuous–discrete hybrid system and the random time delay is modeled as a Markov jump process. A three-step approximation is taken to simplify such hybrid system: (i) the randomly periodic approximate solution property of the system is used to convert the random time delay control into the control without time delay but with delay time as parameter; (ii) a limit theorem is used to transform the hybrid system with Markov jump parameter into one without jump parameter; and (iii) the stochastic averaging method for quasi-integrable Hamiltonian systems is applied to reduce the system into a set of averaged Itô stochastic differential equations. An approximate expression for the largest Lyapunov exponent of the system is derived from the linearized averaged Itô equations and the necessary and sufficient condition for the asymptotic stability with probability one of the system is obtained. The application and effectiveness of the proposed procedure are demonstrated by using an example of stochastically driven two-degrees-of-freedom networked control system (NCS) with random time delay.

References

1.
Zhang
,
W.
,
Branichy
,
M. S.
, and
Phillips
,
S. M.
,
2001
, “
Stability of Networked Control System
,”
IEEE Control Syst.
,
21
(
1
), pp.
84
99
.
2.
Walsh
,
G. C.
,
Ye
,
H.
, and
Bushnell
,
L. G.
,
2002
, “
Stability Analysis of Networked Control Systems
,”
IEEE Trans. Control Syst. Technol.
,
10
(
3
), pp.
438
446
.
3.
Tipsuwan
,
Y.
, and
Chow
,
M. Y.
,
2003
, “
Control Methodologies in Networked Control Systems
,”
Control Eng. Pract.
,
11
(
10
), pp.
1099
1011
.
4.
Luck
,
R.
, and
Ray
,
A.
,
1990
, “
An Observer-Based Compensator for Distributed Delays
,”
Automatica
,
26
(
5
), pp.
903
908
.
5.
Nilsson
,
J.
,
Bernhardsson
,
B.
, and
Wittenmark
,
B.
,
1998
, “
Stochastic Analysis and Control of Real-Time Systems With Random Time Delays
,”
Automatica
,
34
(
1
), pp.
57
64
.
6.
Lin
,
H.
, and
Antsaklis
,
P. J.
,
2005
, “
Stability and Persistent Disturbance Attenuation Properties for a Class of Networked Control Systems: Switched System Approach
,”
Int. J. Control
,
78
(
18
), pp.
1447
1458
.
7.
Branicky
,
M. S.
,
1997
, “
Stability of Hybrid Systems: State of the Art
,” 36th
IEEE
Conference on Decision and Control
, San Diego, CA, Dec. 10–12, Vol.
1
, pp.
120
125
.
8.
Zhang
,
L. Q.
,
Shi
,
Y.
,
Chen
,
T. W.
, and
Huang
,
B.
,
2005
, “
A New Method for Stabilization of Networked Control Systems With Random Delays
,”
IEEE Trans. Autom. Control
,
50
(
8
), pp.
1177
1181
.
9.
Zhu
,
W. Q.
, and
Liu
,
Z. H.
,
2007
, “
Stochastic Averaging of Quasi-Integrable Hamiltonian Systems With Delayed Feedback Control
,”
J. Sound Vib.
,
299
(
1
), pp.
178
195
.
10.
Zhu
,
W. Q.
, and
Liu
,
Z. H.
,
2007
, “
Response of Quasi-Integrable Hamiltonian Systems With Delayed Feedback Bang-Bang Control
,”
Nonlinear Dyn.
,
49
(
1–2
), pp.
31
47
.
11.
Liu
,
Z. H.
, and
Zhu
,
W. Q.
,
2008
, “
Stochastic Hopf Bifurcation of Quasi-Integrable Hamiltonian Systems With Time-Delayed Feedback Control
,”
J. Theor. Appl. Mech.
,
46
(
3
), pp.
531
550
.
12.
Skorokhod
,
A. V.
,
2009
, Asymptotic Methods of the Theory of Stochastic Differential Equations,
American Mathematical Society
,
Providence, RI
.
13.
Pola
,
A.
,
1996
, “
Averaging of Impulse Systems With Markov Switchings and Fast Time
,”
Proc. Latvian Prob. Seminar
,
4
, pp.
9
18
.
14.
Tsarkov
,
Y.
,
2002
, “
Asymptotic Methods for Stability Analysis of Markov Impulse Dynamical Systems
,”
Nonlinear Dyn. Syst. Theory
,
2
(
1
), pp.
103
115
.
15.
Zhu
,
W. Q.
,
2006
, “
Nonlinear Stochastic Dynamics and Control in Hamiltonian Formulation
,”
ASME Appl. Mech. Rev.
,
59
(
4
), pp.
230
248
.
16.
Huang
,
Z. L.
, and
Zhu
,
W. Q.
,
2005
, “
Averaging Method for Quasi-Integrable Hamiltonian Systems
,”
J. Sound Vib.
,
284
(
1
), pp.
325
341
.
17.
Liu
,
Z. H.
, and
Zhu
,
W. Q.
,
2008
, “
Asymptotic Lyapunov Stability With Probability One of Quasi-Integrable Hamiltonian Systems With Delayed Feedback Control
,”
Automatica
,
44
(
7
), pp.
1923
1928
.
18.
Zhu
,
W. Q.
, and
Huang
,
Z. L.
,
1999
, “
Lyapunov Exponents and Stochastic Stability of Quasi-Integrable-Hamiltonian Systems
,”
ASME J. Appl. Mech.
,
66
(
1
), pp.
211
217
.
19.
Costa
,
O. L. V.
,
Fragoso
,
M. D.
, and
Todorov
,
M. G.
,
2013
,
Continuous-Time Markov Jump Linear System
,
Springer-Verlag
,
Berlin
.
20.
Krasovskii
,
N. N.
, and
Lidskii
,
E. A.
,
1961
, “
Analytical Design of Controllers in Systems With Random Attributes
,”
Autom. Remote Control
,
22
(
1–3
), pp.
1021
1025
.
21.
Huan
,
R. H.
,
Zhu
,
W. Q.
,
Ma
,
F.
, and
Ying
,
Z. G.
,
2015
, “
Stationary Response of a Class of Nonlinear Stochastic Systems Undergoing Markovian Jumps
,”
ASME J. Appl. Mech.
,
82
(
5
), p.
051008
.
22.
Khasminskii
,
R. Z.
,
1968
, “
On the Averaging Principle for Itô Stochastic Differential Equations
,”
Kibernetka
3
, pp.
260
279
.
You do not currently have access to this content.