Abstract

In this paper, two integrated target identification and acquisition algorithms and a graphical user interface (GUI) simulation tool for automated assembly of parallel manipulators are proposed. They seek to identify the target machine part from the workspace, obtain its location and pose parameters, and accomplish its assembling task while avoiding the collision with other items (obstacles). Fourier descriptors (FDs) and support vector machine (SVM) are adopted in this approach. The image of task area of workspace is obtained through machine vision, and the target assembling parts are identified. To acquire the location and pose information of the target, a modulus-shift matching (MSM) algorithm is proposed and integrated into the FD and SVM approaches, which could efficiently obtain the pose parameters while eliminating the effect of choice of starting point. The simulation results of two integrated algorithms, FD-MSM and SVM-MSM, are then compared and analyzed. In addition, a GUI is designed to visualize and assist the assembly process. An application on delta parallel robot with an extra rotational degree of freedom (DOF) is presented.

References

1.
Bai
,
P.
,
Mei
,
J.
,
Huang
,
T.
, and
Chetwynd
,
D. G.
,
2016
, “
Kinematic Calibration of Delta Robot Using Distance Measurements
,”
Proc. Inst. Mech. Eng. Part C
,
230
(
3
), pp.
414
424
. 10.1177/0954406215603739
2.
Zhang
,
N.
, and
Shang
,
W.
,
2016
, “
Dynamic Trajectory Planning of a 3-DOF Under-Constrained Cable-Driven Parallel Robot
,”
Mech. Mach. Theory
,
98
, pp.
21
35
. 10.1016/j.mechmachtheory.2015.11.007
3.
Pierrot
,
F.
,
Reynaud
,
C.
, and
Fournier
,
A.
,
1990
, “
DELTA: A Simple and Efficient Parallel Robot
,”
Robotica
,
8
(
2
), pp.
105
109
. 10.1017/S0263574700007669
4.
Vischer
,
P.
, and
Clavel
,
R.
,
1998
, “
Kinematic Calibration of the Parallel Delta Robot
,”
Robotica
,
16
(
2
), pp.
207
218
. 10.1017/S0263574798000538
5.
Patel
,
Y. D.
, and
George
,
P. M.
,
2012
, “
Parallel Manipulators Applications—A Survey
,”
Mod. Mech. Eng.
,
2
(
3
), p.
57
. 10.4236/mme.2012.23008
6.
Pérez
,
L.
,
Rodríguez
,
Í.
,
Rodríguez
,
N.
,
Usamentiaga
,
R.
, and
García
,
D. F.
,
2016
, “
Robot Guidance Using Machine Vision Techniques in Industrial Environments: A Comparative Review
,”
Sensors
,
16
(
3
), p.
335
. 10.3390/s16030335
7.
Nash
,
S. R.
,
Leddy
,
C. A.
, and
Quevedo
,
H. A.
,
2019
, “
System for Real-Time Moving Target Detection Using Vision Based Image Segmentation
,” U.S. Patent Application 10/319,098,
Raytheon Co
.
8.
Fraser
,
S.
,
Nikora
,
V.
,
Williamson
,
B. J.
, and
Scott
,
B. E.
,
2017
, “
Automatic Active Acoustic Target Detection in Turbulent Aquatic Environments
,”
Limnol. Oceanogr.: Methods
,
15
(
2
), pp.
184
199
. 10.1002/lom3.10155
9.
Chen
,
H.
,
Zhao
,
X.
,
Tan
,
M.
, and
Sun
,
S.
,
2017
, “
Computer Vision-Based Detection and State Recognition for Disconnecting Switch in Substation Automation
,”
Int. J. Robot. Autom.
,
32
, p.
1
. 10.2316/journal.206.2017.1.206-4624
10.
Van Gerven
,
M.
, and
Bohte
,
S.
,
2017
, “
Artificial Neural Networks as Models of Neural Information Processing
,”
Front. Comput. Neurosci.
,
11
, p.
114
. 10.3389/fncom.2017.00114
11.
Sufikarimi
,
H.
, and
Mohammadi
,
K.
,
2017
, “
Speed Up Biological Inspired Object Recognition, HMAX
,”
2017 3rd Iranian Conference on Intelligent Systems and Signal Processing (ICSPIS)
,
Shahrood, Iran
,
Dec. 20–21
,
IEEE
, pp.
183
187
.
12.
Zhang
,
H. Z.
,
Lu
,
Y. F.
,
Kang
,
T. K.
, and
Lim
,
M. T.
,
2016
, “
B-HMAX: A Fast Binary Biologically Inspired Model for Object Recognition
,”
Neurocomputing
,
218
, pp.
242
250
. 10.1016/j.neucom.2016.08.051
13.
Wang
,
C.
,
Zhang
,
Y.
,
Song
,
J.
,
Liu
,
Q.
, and
Dong
,
H.
,
2019
, “
A Novel Optimized SVM Algorithm Based on PSO With Saturation and Mixed Time-Delays for Classification of Oil Pipeline Leak Detection
,”
J. Syst. Sci. Syst. Eng.
,
7
(
1
), pp.
75
88
. 10.1080/21642583.2019.1573386
14.
Chen
,
Q. S.
,
Defrise
,
M.
, and
Deconinck
,
F.
,
1994
, “
Symmetric Phase-Only Matched Filtering of Fourier-Mellin Transforms for Image Registration and Recognition
,”
IEEE Trans. Pattern Anal. Mach. Intell.
,
12
, pp.
1156
1168
.
15.
Wang
,
L.
,
Ye
,
X. F.
,
Wang
,
G.
, and
Wang
,
L.
,
2017
, “
A Fast Hierarchical MRF Sonar Image Segmentation Algorithm
,”
Int. J. Robot. Autom.
,
32
(
1
), pp.
48
54
. 10.2316/journal.206.2017.1.206-4739
16.
Zhang
,
X.
,
He
,
G.
, and
Yuan
,
J.
,
2009
, “
A Rotation Invariance Image Matching Method Based on Harris Corner Detection
,”
2nd International Congress on Image and Signal Processing
,
Tianjin, China
,
Oct. 17–19
, pp.
1
5
. https://pdfs.semanticscholar.org/ad03/3dad86f8e9534e6b7cd1de896fb9bf0b3fc2.pdf
17.
Eid
,
A. H. M.
, and
Cholewo
,
T. J.
,
2015
, “
Methods of Content-Based Image Identification
,” U.S. Patent 9,064,316,
Lexmark International Inc
.
18.
Xie
,
J.
,
Fang
,
Y.
,
Zhu
,
F.
, and
Wong
,
E.
,
2015
, “
Deepshape: Deep Learned Shape Descriptor for 3d Shape Matching and Retrieval
,”
28th IEEE Conference on Computer Vision and Pattern Recognition
,
Boston, MA
,
June 7–12
, pp.
1275
1283
.
19.
Vincent
,
L.
,
1994
,
Shape in Picture
,
O.
Ying Lie
,
A.
Toet
,
D.
Foster
,
H. J. A. M.
Heijmans
, and
P.
Meer
, eds.,
Springer
,
Berlin
, pp.
197
208
.
20.
Gong
,
S.
,
Li
,
G.
,
Zhang
,
Y.
,
Li
,
C.
, and
Yu
,
L.
,
2019
, “
Application of Static Gesture Segmentation Based on an Improved Canny Operator
,”
J. Eng.
,
2019
(
15
), pp.
543
546
. 10.1049/joe.2018.9377
21.
Thilagamani
,
S.
, and
Shanthi
,
N.
,
2014
, “
Gaussian and Gabor Filter Approach for Object Segmentation
,”
ASME J. Comput. Inf. Sci. Eng.
,
14
(
2
), p.
021006
. 10.1115/1.4026458
22.
Afzali
,
A.
,
Mofrad
,
F. B.
, and
Pouladian
,
M.
,
2018
, “
Inter-Patient Modelling of 2D Lung Variations From Chest X-Ray Imaging Via Fourier Descriptors
,”
J. Med. Syst.
,
42
(
11
), p.
233
. 10.1007/s10916-018-1058-7
23.
Demir
,
B.
,
Sayinci
,
B.
,
Çetin
,
N.
,
Yaman
,
M.
, and
Çömlek
,
R.
,
2019
, “
Shape Discrimination of Almond Cultivars by Elliptic Fourier Descriptors
,”
Erwerbs-Obstbau
,
61
(
3
), pp.
1
12
. 10.1007/s10341-019-00423-7
24.
Zhang
,
D.
, and
Lu
,
G.
,
2003
, “
A Comparative Study of Curvature Scale Space and Fourier Descriptors for Shape-Based Image Retrieval
,”
J. Vis. Commun. Image Represent.
,
14
(
1
), pp.
39
57
. 10.1016/S1047-3203(03)00003-8
25.
Qi
,
S.
,
Ma
,
J.
,
Lin
,
J.
,
Li
,
Y.
, and
Tian
,
J.
,
2015
, “
Unsupervised Ship Detection Based on Saliency and S-HOG Descriptor From Optical Satellite Images
,”
IEEE Geosci. Rem. Sens. Lett.
,
12
(
7
), pp.
1451
1455
. 10.1109/LGRS.2015.2408355
26.
Pare
,
S.
,
Bhandari
,
A. K.
,
Kumar
,
A.
, and
Singh
,
G. K.
,
2017
, “
An Optimal Color Image Multilevel Thresholding Technique Using Grey-Level Co-Occurrence Matrix
,”
Expert. Syst. Appl.
,
87
, pp.
335
362
. 10.1016/j.eswa.2017.06.021
27.
Varish
,
N.
, and
Pal
,
A. K.
,
2018
, “
A Novel Image Retrieval Scheme Using Gray Level Co-Occurrence Matrix Descriptors of Discrete Cosine Transform Based Residual Image
,”
Appl. Intell.
,
48
(
9
), pp.
2930
2953
. 10.1007/s10489-017-1125-7
28.
Shirai
,
K.
,
Madokoro
,
H.
,
Takahashi
,
S.
, and
Sato
,
K.
,
2014
, “
Parallel Implementation of Saliency Maps for Real-Time Robot Vision
,”
2014 14th International Conference on Control, Automation and Systems (ICCAS 2014)
,
KINTEX, Seoul, South Korea
,
Oct. 22–25
,
IEEE
, pp.
1046
1051
.
29.
Raja
,
P.
, and
Pugazhenthi
,
S.
,
2012
, “
Optimal Path Planning of Mobile Robots: A Review
,”
Int. J. Phys. Sci.
,
7
(
9
), pp.
1314
1320
. 10.5897/IJPS11.1745
30.
Moran
,
K.
,
Li
,
B.
,
Bernal-Cárdenas
,
C.
,
Jelf
,
D.
, and
Poshyvanyk
,
D.
,
2018
, “
Automated Reporting of GUI Design Violations for Mobile Apps
,”
The 40th International Conference on Software Engineering
,
Gothenburg, Sweden
,
May 27–June 3
,
ACM
, pp.
165
175
.
31.
Bayasgalan
,
M.
,
2018
, “
Graphical User Interface Design of FIR Filter
,”
Open Access Library J.
,
5
(
12
), p.
1
.
32.
Wang
,
D. G.
,
Hu
,
Y. L.
,
Sun
,
J. J.
, and
Li
,
Y.
,
2016
, “
Estimation of the Water–Oil–Gas Relative Permeability Curve From Immiscible WAG Coreflood Experiments Using the Cubic B-Spline Model
,”
Petrol. Sci.
,
13
(
3
), pp.
507
516
. 10.1007/s12182-016-0102-9
You do not currently have access to this content.