Understanding of the shape and size of different features of the human body from scanned data is necessary for automated design and evaluation of product ergonomics. In this paper, a computational framework is presented for automatic detection and recognition of important facial feature regions, from scanned head and shoulder polyhedral models. A noise tolerant methodology is proposed using discrete curvature computations, band-pass filtering, and morphological operations for isolation of the primary feature regions of the face, namely, the eyes, nose, and mouth. Spatial disposition of the critical points of these isolated feature regions is analyzed for the recognition of these critical points as the standard landmarks associated with the primary facial features. A number of clinically identified landmarks lie on the facial midline. An efficient algorithm for detection and processing of the midline, using a point sampling technique, is also presented. The results obtained using data of more than 20 subjects are verified through visualization and physical measurements. A color based and triangle skewness based schemes for isolation of geometrically nonprominent features and ear region are also presented.
Issue Section:
Research Papers
Keywords:
anthropometry,
band-pass filters,
ergonomics,
face recognition,
image sampling,
mesh processing,
computerized anthropometry,
facial landmarks,
ergonomics
Topics:
Algorithms,
Computation,
Ear,
Ergonomics,
Filtration,
Noise (Sound),
Shapes,
Erosion,
Facial recognition,
Design,
Visualization
1.
Robinette
, K.
, Blackwell
, S.
, Daanen
, H. A. M.
, Fleming
, S.
, Boehmer
, M.
, Brill
, T.
, Hoeferlin
, D.
, and Burnsides
, D.
, 2002, “Civilian American and European Surface Anthropometry Resource(CAESAR), Final Report
,” Report No. AFRL-HE-WP-TR-2002-0169.2.
Shah
, J. J.
, 1991, “Conceptual Development of Form Features and Feature Modelers
,” Res. Eng. Des.
0934-9839, 2
, pp. 93
–108
.3.
Shah
, J. J.
, and Rogers
, M. T.
, 1993, “Assembly Modeling as an Extension of Feature-Based Design
,” Res. Eng. Des.
0934-9839, 5
, pp. 218
–237
.4.
Comey
, J.
, and Clark
, D. E. R.
, 1993, “Efficient Face-Based Feature Recognition
,” Proceedings of the ACM on Solid Modeling
, pp. 313
–322
.5.
Regli
, W. C.
, Gupta
, S. K.
, and Nau
, D. S.
, 1995, “Extracting Alternative Machining Features: An Algorithmic Approach
,” Res. Eng. Des.
0934-9839, 7
(3
), pp. 173
–192
.6.
Shah
, J. J.
, Anderson
, D.
, Kim
, S. Y.
, and Joshi
, S.
, 2001, “A Discourse on Geometric Feature Recognition From CAD Models
,” ASME J. Comput. Inf. Sci. Eng.
1530-9827, 1
, pp. 41
–51
.7.
Iyer
, N.
, Jayanti
, S.
, Lou
, K.
, Kalyanaraman
, Y.
, and Ramani
, K.
, 2005, “Shape-Based Searching for Product Lifecycle Applications
,” Comput.-Aided Des.
0010-4485, 37
(13
), pp. 1435
–1446
.8.
Zhang
, E.
, Mischaikow
, K.
, and Turk
, G.
, 2005, “Feature Based Surface Parameterization and Texture Mapping
,” ACM Trans. Graphics
0730-0301, 24
(1
), pp. 1
–27
.9.
Mitra
, N. J.
, Guibas
, L. J.
, and Pauly
, M.
, 2006, “Partial and Approximate Symmetry Detection for 3D Geometry
,” Proceedings of the ACM SIGGRAPH
, pp. 560
–568
.10.
Jones
, J. T.
, Reidsema
, C.
, and Smith
, A.
, 2006, “Automated Feature Recognition System for Supporting Conceptual Engineering Design
,” International Journal of Knowledge-Based and Intelligent Engineering Systems
1327-2314, 10
(6
), pp. 477
–492
.11.
Gal
, R.
, and Cohen-Or
, D.
, 2006, “Salient Geometric Features for Partial Shape Matching and Similarity
,” ACM Trans. Graphics
0730-0301, 25
(1
), pp. 130
–150
.12.
Langerak
, T. R.
, and Vergeest
, J.
, 2007, “Feature Recognition of User-Defined Freeform Features
,” Comput.-Aided Des.
0010-4485, 4
(1–4
), pp. 529
–538
.13.
Madan
, J.
, Rao
, P. V. M.
, and Kundra
, T. K.
, 2007, “Die-Casting Feature Recognition for Automated Parting Direction and Parting Line Determination
,” ASME J. Comput. Inf. Sci. Eng.
1530-9827, 7
, pp. 236
–248
.14.
Attene
, M.
, Robbiano
, F.
, Spagnuolo
, M.
, and Falcidieno
, B.
, 2009, “Characterization of 3D Shape Parts for Semantic Annotation
,” Comput.-Aided Des.
0010-4485, 41
, pp. 756
–763
.15.
Brunelli
, R.
, and Poggio
, T.
, 1993, “Face Recognition: Features Versus Templates
,” IEEE Trans. Pattern Anal. Mach. Intell.
0162-8828, 15
(10
), pp. 1042
–1052
.16.
Lin
, C.
, and Lin
, W.
, 1996, “Extracting Facial Features by an Inhibitory Mechanism Based on Gradient Distributions
,” Pattern Recogn.
0031-3203, 29
(12
), pp. 2079
–2101
.17.
Wu
, H.
, Yokoyama
, T.
, Pramadihanto
, D.
, and Yachida
, M.
, 1996, “Face and Facial Feature Extraction From Color Image
,” Proceedings of the Second IEEE International Conference on Automatic Face and Gesture Recognition
, pp. 345
–350
.18.
Yow
, K. C.
, and Cipolla
, R.
, 1997, “Feature-Based Human Face Detection
,” Image Vis. Comput.
0262-8856, 15
(9
), pp. 713
–735
.19.
Jeng
, S.
, Liao
, H. Y.
, Han
, C. C.
, Chern
, M. Y.
, and Liu
, Y. T.
, 1998, “Facial Feature Detection Using Geometrical Face Model: An Efficient Approach
,” Pattern Recogn.
0031-3203, 31
(3
), pp. 273
–282
.20.
Pighin
, F.
, Hecker
, J.
, Lischinski
, D.
, Szeliski
, R.
, and Salesin
, H. D.
, 1998, “Synthesizing Realistic Facial Expressions From Photographs
,” Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques
, pp. 75
–84
.21.
Blanz
, V.
, and Vetter
, T.
, 1999, “A Morphable Model for the Synthesis of 3D Faces
,” Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques
, pp. 187
–194
.22.
Hjelmas
, E.
, and Low
, B. K.
, 2001, “Face Detection: A Survey
,” Comput. Vis. Image Underst.
1077-3142, 83
, p. 236274
.23.
Shen
, T.
, Huang
, J.
, and Menq
, C.
, 2001, “Multiple-Sensor Planning and Information Integration for Automatic Coordinate Metrology
,” ASME J. Comput. Inf. Sci. Eng.
1530-9827, 1
, pp. 167
–179
.24.
Wang
, J.
, and Sung
, E.
, 1999, “Frontal-View Face Detection and Facial Feature Extraction Using Color and Morphological Operations
,” Pattern Recogn. Lett.
0167-8655, 20
, pp. 1053
–1068
.25.
Cristinance
, D.
, Cootes
, T.
, and Scott
, I.
, 2004, “A Multi-Stage Approach to Facial Feature Detection
,” Proceedings of the Machine Vision Conference
, pp. 231
–240
.26.
Viola
, P.
, 2004, “Robust Real-Time Face Detection
,” Int. J. Comput. Vis.
0920-5691, 57
(2
), pp. 137
–154
.27.
Shih
, F. Y.
, and Chuang
, C. F.
, 2004, “Automatic Extraction of Head and Face Boundaries and Facial Features
,” Inf. Sci. (N.Y.)
0020-0255, 158
, pp. 117
–130
.28.
Bronstein
, M. A.
, Bronstein
, M. M.
, and Kimmel
, R.
, 2006, “Robust Expression-Invariant Face Recognition From Partially Missing Data, Part III
,” A.
Leonardis
, H.
Bischof
, and A.
Pinz
, eds., ECCV 2006, Part III, LNCS 3953
, Springer-Verlag
, Berlin Heidelberg
, pp. 396
–408
.29.
Cristinance
, D.
, and Cootes
, T.
, 2006, “Feature Detection and Tracking With Constrained Local Models
,” Proceedings of the 17th British Machine Vision Conference
, BMVC 2006, 4-7 September, Edinburgh
, pp. 929
–938
.30.
Cristinance
, D.
, and Cootes
, T. F.
, 2006, “Facial Feature Detection and Tracking With Automatic Template Selection
,” Proceedings of the Seventh International Conference on Automatic Face and Gesture Recognition
, pp. 429
–434
.31.
Wilson
, P. I.
, and Fernandez
, J.
, 2006, “Facial Feature Detection Using Haar Classifiers
,” Journal of Computing Sciences in Colleges
1937-4771, 21
(4
), pp. 127
–133
.32.
Mahoor
, M. H.
, and Abdel-Mottaleb
, M.
, 2006, “Facial Features Extraction in Color Images Using Enhanced Active Shape Model
,” Proceedings of the Seventh International Conference on Automatic Face and Gesture Recognition
, FGR'06, Southampton, UK
, April 10-12, pp. 138
–143
.33.
Chatting
, D. J.
, 2006, “Making Recognisable Faces
,” Proceedings of the Seventh International Conference on Automatic Face and Gesture Recognition
, FGR'06, Southampton, U
K, April 10-12, pp. 144
–148
.34.
Asteriadis
, S.
, Nikolaidis
, N.
, and Pitas
, I.
, 2009, “Facial Feature Detection Using Distance Vector Fields
,” Pattern Recogn.
0031-3203, 42
, pp. 1388
–1398
.35.
Xu
, C.
, Li
, S.
, Tan
, T.
, and Quan
, L.
, 2009, “Automatic 3D Face Recognition From Depth and Intensity Gabor Features
,” Pattern Recogn.
0031-3203, 42
, pp. 1895
–1905
.36.
Ren
, C.
, and Dai
, D.
, 2010, “Incremental Learning of Bidirectional Principal Components for Face Recognition
,” Pattern Recogn.
0031-3203, 43
, pp. 318
–330
.37.
Lam
, K. -M.
, and Yan
, H.
, 1996, “Locating and Extracting the Eye in Human Face Images
,” Pattern Recogn.
0031-3203, 29
(5
), pp. 771
–779
.38.
Chen
, H.
, and Bhanu
, B.
, 2007, “Human Ear Recognition in 3D
,” IEEE Trans. Pattern Anal. Mach. Intell.
0162-8828, 29
(4
), pp. 718
–737
.39.
Matts
, P. J.
, 2008, “New Insights Into Skin Appearance and Measurement
,” J. Investig. Dermatol. Symp. Proc.
1087-0024, 13
, pp. 6
–9
.40.
Bastys
, A.
, Kranauskas
, J.
, and Masiulis
, R.
, 2009, “Iris Recognition by Local Extremum Points of Multiscale Taylor Expansion
,” Pattern Recogn.
0031-3203, 42
, pp. 1869
–1877
.41.
Nanni
, L.
, and Lumini
, A.
, 2009, “Fusion of Color Spaces for Ear Authentication
,” Pattern Recogn.
0031-3203, 42
, pp. 1906
–1913
.42.
Petajan
, E.
, and Graf
, H. P.
, 1996, “Robust Face Analysis for Automatic Speechreading and Character Animation
,” Proceedings of the Second IEEE International Conference on Automatic Face and Gesture Recognition
, Killington, VT, Oct. 14–16, pp. 357
–362
.43.
Baskan
, S.
, Bulut
, M. M.
, and Atalay
, V.
, 2002, “Projection Based Method for Segmentation of Human Face and its Evaluation
,” Pattern Recogn. Lett.
0167-8655, 23
, pp. 1623
–1629
.44.
Lu
, X.
, Jain
, A.
, and Colbry
, D.
, 2006, “Matching 2.5D Face Scans to 3D Models
,” IEEE Trans. Pattern Anal. Mach. Intell.
0162-8828, 28
(1
), pp. 31
–43
.45.
Kakadiaris
, I. A.
, Passalis
, G.
, Toderici
, G.
, Murtuza
, M. N.
, Lu
, Y.
, Karampatzi-akis
, N.
, and Theoharis
, T.
, 2007, “Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach
,” IEEE Trans. Pattern Anal. Mach. Intell.
0162-8828, 29
(4
), pp. 640
–649
.46.
Chew
, W. J.
, Ang
, L.
, and Seng
, K. P.
, 2008, “Automatic Model Based Face Feature Detection System
,” Proceedings of the International Symposium on Information Technology
, Vol. 2
, pp. 26
–28
.47.
Colombo
, A.
, Cusano
, C.
, and Schettini
, R.
, 2006, “3D Face Detection Using Curvature Analysis
,” Pattern Recogn.
0031-3203, 39
, pp. 444
–455
.48.
Tanaka
, J. W.
, and Farah
, M. J.
, 1993, “Parts and Wholes in Face Recognition
,” Q. J. Exp. Psychol. A
0272-4987, 46
(2
), pp. 225
–245
.49.
Wang
, C. L.
, 2004, “CyberTape: An Interactive Measurement Tool on Polyhedral Surface
,” Comput. Graph.
0097-8930, 28
, pp. 731
–745
.50.
Alaa
, E.
, 2003, “Statistical Variation of Three Dimensional Face Models
,” MS thesis, IT-University of Copenhagen, Denmark.51.
Farkas
, L. G.
, 1995, Anthropometry of the Head and Face
, 2nd ed., Lippincott Williams & Wilkins
.52.
Meunier
, P.
, Tack
, D.
, Ricci
, A.
, Bossi
, L.
, and Angel
, H.
, 2000, “Helmet Accommodation Analysis Using 3D Laser Scanning
,” Appl. Ergon
0003-6870, 31
, pp. 361
–369
.53.
Flynn
, P. J.
, and Jain
, A. K.
, 1989, “On Reliable Curvature Estimation
,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
, pp. 110
–116
.54.
Taubin
, G.
, 2004, “Estimating the Tensor of Curvature of a Surface From Polyhedral Approximation
,” Proceedings of the Fifth International Conference on Computer Vision
, pp. 902
–907
.55.
Page
, D. L.
, Sun
, Y.
, Koschan
, A. F.
, and Abidi
, M. A.
, 2002, “Normal Vector Voting: Crease Detection and Curvature Estimation on Large, Noisy Meshes
,” Graphical Models
1524-0703, 64
, pp. 199
–229
.56.
Meyer
, M.
, Desbrun
, M.
, Schröder
, P.
, and Barr
, A. H.
, 2002, “Discrete Differential-Geometry Operators for Triangulated 2-Manifolds
,” Proceedings of International Workshop on Visualization and Mathematics
, Berlin-Dahlem, Germany, H.
Christian
, H. K.
Polthier
, eds., Springer-Verlag
, Heidelberg
, pp. 35
–57
. (http://www.cs.caltech.edu/~mmeyer/Publications/diffGeomOps.pdfhttp://www.cs.caltech.edu/~mmeyer/Publications/diffGeomOps.pdf).57.
Gunduz
, A.
, and Krim
, H.
, 2003, “Facial Feature Extraction Using Topological Methods
,” Proceedings of the International Conference on Image Processing
, pp. 673
–676
.58.
Rössl
, C.
, Kobbelt
, L.
, and Seidel
, H. P.
, 2000, “Extraction of Feature Lines on Triangulated Surfaces Using Morphological Operators
,” Proceedings of the 2000 AAAI Symposium
, pp. 71
–75
.59.
2007,
Assessment of the NIOSH Head-and-Face Anthropometric Survey on U.S. Respirator Users
, J. C.
Bailar
III, E. A.
Meyer
, and R.
Pool
, eds., National Academic Press
, Washington
, pp. 38
–40
.Copyright © 2010
by American Society of Mechanical Engineers
You do not currently have access to this content.
