Vision guided robots have become an important element in the manufacturing industry. In most current industrial applications, vision guided robots are controlled by a look-then-move method. This method cannot support many new emerging demands which require real-time vision guidance. Challenge comes from the speed of visual feedback. Due to cost limit, industrial robot vision systems are subject to considerable latency and limited sampling rate. This paper proposes new algorithms to address this challenge by compensating the latency and slow sampling of visual feedback so that real-time vision guided robot control can be realized with satisfactory performance. Statistical learning methods are developed to model the pattern of target's motion adaptively. The learned model is used to recover visual measurement from latency and slow sampling. The imaging geometry of the camera and all-dimensional motion of the target are fully considered. Tests are conducted to provide evaluation from different aspects.

References

1.
Corke
,
P. I.
,
1995
, “
Dynamic Issues in Robot Visual-Servo Systems
,”
International Symposium on Robotics Research
, Herrsching, Germany, October 21–24, pp.
488
498
.
2.
Corke
,
P.
, and
Good
,
M.
,
1996
, “
Dynamic Effects in Visual Closed-Loop Systems
,”
IEEE Trans. Rob. Autom.
,
12
(
5
), pp.
671
683
.10.1109/70.538973
3.
Wang
,
C.
,
Chen
,
W.
, and
Tomizuka
,
M.
,
2012
, “
Robot End-Effector Sensing With Position Sensitive Detector and Inertial Sensors
,”
IEEE International Conference on Robotics and Automation
, St. Paul, MN, May 14–18, pp.
5252
5257
.
4.
Wang
,
C.
,
Lin
,
C.-Y.
, and
Tomizuka
,
M.
,
2013
, “
Visual Servoing Considering Sensing Dynamics and Robot Dynamics
,”
6th IFAC Symposium on Mechatronic Systems
, Hangzhou, China, April 10–12, pp.
45
52
.
5.
Lin
,
C.-Y.
,
Wang
,
C.
, and
Tomizuka
,
M.
,
2013
, “
Visual Tracking With Sensing Dynamics Compensation Using the Expectation-Maximization Algorithm
,”
American Control Conference
, Washington, DC, June 17–19, pp.
6281
6286
.
6.
Namiki
,
A.
, and
Ishikawa
,
M.
,
2003
, “
Robotic Catching Using a Direct Mapping From Visual Information to Motor Command
,”
IEEE International Conference on Robotics and Automation
, Taipei, Taiwan, September 14–19, Vol.
2
, pp.
2400
2405
.
7.
Furukawa
,
N.
,
Namiki
,
A.
,
Taku
,
S.
, and
Ishikawa
,
M.
,
2006
, “
Dynamic Regrasping Using a High-Speed Multifingered Hand and a High-Speed Vision System
,”
IEEE International Conference on Robotics and Automation
, Orlando, FL, May 15–19, pp.
181
187
.
8.
Li
,
X. R.
, and
Jilkov
,
V.
,
2003
, “
Survey of Maneuvering Target Tracking, Part I - Dynamic Models
,”
IEEE Trans. Aerosp. Electron. Syst.
,
39
(
4
), pp.
1333
1364
.10.1109/TAES.2003.1261132
9.
Singer
,
R.
, and
Behnke
,
K.
,
1971
, “
Real-Time Tracking Filter Evaluation and Selection for Tactical Applications
,”
IEEE Trans. Aerosp. Electron. Syst.
,
7
(
1
), pp.
100
110
.10.1109/TAES.1971.310257
10.
Shim
,
H. C.
,
Kochem
,
M.
, and
Tomizuka
,
M.
,
1998
, “
Use of Accelerometer for Precision Motion Control of Linear Motor Driven Positioning System
,”
24th Annual Conference of the IEEE Industrial Electronics Society
, Aachen, Germany, August 31–September 4, Vol.
4
, pp.
2409
2414
.
11.
Lee
,
D. J.
, and
Tomizuka
,
M.
,
2001
, “
State/Parameter/Disturbance Estimation With an Accelerometer in Precision Motion Control of a Linear Motor
,”
ASME International Mechanical Engineering Congress and Exposition
, New York, November 11–16, pp.
11
16
.
12.
Jeon
,
S.
,
2010
, “
State Estimation Based on Kinematic Models Considering Characteristics of Sensors
,”
American Control Conference
, Baltimore, MD, June 30–July 2, pp.
640
645
.
13.
Dempster
,
A. P.
,
Laird
,
N. M.
, and
Rubinr
,
D. B.
,
1977
, “
Maximum Likelihood From Incomplete Data via the EM Algorithm
,”
J. R. Stat. Soc. Ser. B (Stat. Methodol.)
,
39
(
1
), pp.
1
38
.
14.
Lin
,
C.-Y.
,
Wang
,
C.
, and
Tomizuka
,
M.
,
2014
, “
Pose Estimation in Industrial Machine Vision Systems Under Sensing Dynamics: A Statistical Learning Approach
,”
IEEE International Conference on Robotics and Automation
, Hong Kong, China, May 31–June 7.
15.
Wang
,
C.
,
Lin
,
C.-Y.
, and
Tomizuka
,
M.
,
2013
, “
Visual Servoing for Robot Manipulators Considering Sensing and Dynamics Limitations
,”
ASME
Dynamic Systems and Control Conference
, Palo Alto, CA, October 21–23, Paper No. DSCC2013-3833.10.1115/DSCC2013-3833
You do not currently have access to this content.