Preface

Preface

The AMDO2002 workshop took place at the Universitat de les Illes Balears (UIB) on 21-23 November, 2002, sponsored by the International Association for Pattern Recognition (IAPR) Technical Committee, the CICYT (Comision Interministerial de Ciencia y Tecnologia, Spanish Government), the European Commission (Human Potential Programme: High Level Scientific Conferences) and the Mathematics and Computer Science Department of the UIB. The subject of the workshop was ongoing research in articulated motion on a sequence of images and sophisticated models for deformable objects. The goals of these areas are to understand and interpret the motion of complex objects that can be found in sequences of images in the real world. These topics (geometric and physics deformable models, motion analysis, articulated models and animation, visualization of deformable models, 3D recovery from motion, single or multiple human motion analysis and synthesis, applications of deformable models and motion analysis, face tracking, recovering and recognition models, etc.) are actually very interesting ways of important research to solve more general problems. Another objective of this workshop was to relate fields using computer graphics, computer animation or applications in several disciplines combining synthetic and analytical images. In this regard it is of particular interest to encourage links between researchers in areas of computer vision and computer graphics who have common problems and frequently use similar techniques. The workshop included five sessions of presented papers and two tutorials. Invited speakers treating various aspects of the topics were: Haptic-based Deformable Solid of Arbitrary Topology by Professor H. Qin from the State University of New York at Stony Brook (USA); Passive 3D Human Motion Capture: Vision-Based Tracking Meets Computer Animation by Professor I. Kakadiaris from Houston University (USA) and Dynamic Scene Analysis: recent results by Professor N. Perez de la Blanca from University of Granada (Spain).

November 2002

F. J. Perales and E. R. Hancock Program Co-Chairs AMDO’2002

Organization

AMDO’2002 is organized by the department of Mathematics and Computer Science, Universitat de les Illes Balears (UIB) in cooperation with IAPR (International Association for Pattern Recognition) and AERFAI (Spanish Association for Pattern Recognition and Image Analysis).

Program Committee General Workshop Co-Chairs:

Organizing Chairs:

Tutorial Chairs:

Perales F. J., Mathematics and Computer Science Department, UIB (Spain) Hancock E.R., Department of Computer Science, University of York (UK) Gonzalez M., Igelmo A., Mas R., Mascar´o P. M., Mir. A, Palmer P., Perales F., Buades, J. M., UIB (Spain) Gonzalez M., Mas R., Mir A., Perales F. (UIBSpain)

III

Programm Committee Aloimonos, Y. Aggarwal, J. K. Ayache, N. Badler, N. I. Boulic, R. Brunet, P. Cipolla, R. Cohen, I. Davis, L. S. Del Bimbo, A. Gong, S. Kakadiaris, I. A. Kittler, J. Kunii, T. L. Huang, T. S. Jain, A. Medioni, G. Metaxas, D. Nagel, H.-H. Nastar, C. Pentland, A. Perez de la Blanca, N. Qin, H. Sanfeliu, A. Seron, F. Shirai, Y. Susin, A. Terzopoulos, D. Teixeira, J. C. Thalmann, D. Villanueva, J.

University of Maryland, USA University of Texas, USA INRIA, Shopia-Antipolis, France University of Pennsylvania, USA EPFL, Switzerland University Polytechnic Catalonia, Spain University of Cambrige, UK University of Southern California, USA University of Maryland, USA University di Firenze, Italy QM & Westfield Coll, UK University of Houston, USA University of Surrey, UK University of Hosei, Japan University of Urbana-Champaing, USA University Michigan State, USA University of Southern California, USA University of Pennsylvania, USA Ins. f¨ ur Alg. und Kognitive System, Germany LUV, France Media Lab, MIT, USA Univeristy of Granada, Spain Stony Brook University, New York , USA IRI, CSIC-UPC, Spain University of Zaragoza, Spain University of Osaka, Japan University Polytechnic Catalonia, Spain University of Toronto, Canada FCTUC, Portugal EPFL, Switzerland UAB-CVC, Spain

Sponsoring Institutions IAPR (International Association for Pattern Recognition) European Commission (Human Potential Programme) MCyT (Ministerio de Ciencia y Tecnologia, Spanish Government) TIC20015233-E Mathematics and Computer Science Department, Universitat de les Illes Balears (UIB)

Table of Contents

Articulated Motion and Deformable Objects AMDO2002 Virtual Clay: Haptics-based Deformable Solids of Arbitrary Topology . . . . . K. T. McDonnell, H. Qin

1

g-HDAF Multiresolution Deformable Models . . . . . . . . . . . . . . . . . . . . . . . . . . 21 I.A. Kakadiaris, M. Papadakis, L. Shen, D. Kouri, and D. Hoffman Muscle-driven motion simulation based on deformable human model constructed from real anatomical slice data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32 H. Inaba, S. Miyazaki, and J. Hasegawa Model Acquisition Using Shape-from-Shading . . . . . . . . . . . . . . . . . . . . . . . . . . 45 A. Robles-Kelly, E. R. Hancock A Computational Algebraic Topology Model for the Deformation of Curves 58 P. Poulin, M.F. Auclair-Fortier, D. Ziou, M. Allili P3 DMA: A Physical 3D Deformable Modelling and Animation System . . . . 71 M. Mascar´ o P., A. Mir, F. Perales A Novel Approach to Generate Multiple Shape Models for Tracking Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 84 D. Ponsa, X. Roca Real-time Human Motion Analysis based on Silhouette Contour and Color Blob Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97 R. Hoshino, D. Arita, S. Yonemoto, R. Taniguchi Human Body Model Acquisition and Motion Capture Using Voxel Data . . 110 I. Miki´c, M. Trivedi, E. Hunter, P. Cosman 3D Body Reconstruction for Immersive Interaction . . . . . . . . . . . . . . . . . . . . . 126 I. Cohen and M. W. Lee Wide-Range Tracking of Hands in Real-Time . . . . . . . . . . . . . . . . . . . . . . . . . . 139 Y. Iwai, T. Mashita, M. Yachida Recognition, Tracking, and Reconstruction of Human Motion . . . . . . . . . . . . 153 J. Sullivan, M. Eriksson, S. Carlsson Tracking the Human Body using Multiple Predictors . . . . . . . . . . . . . . . . . . . 164 R. M. Jesus, A. J. Abrantes, J. S. Marques

V

Motion Estimation of Articulated Objects from Perspective Views . . . . . . . 177 X. Zhang, Y. Liu, T. S. Huang Gesture and Posture Estimation by Using Locally Linear Regression . . . . . . 190 Y. Iwai, K. Manjoh, M. Yachida aSpaces: Action Spaces for Recognition and Synthesis of Human Actions . . 203 J. Gonz` alez, X. Varona, X. Roca, J. J. Villanueva Face Recognition Based on Efficient Facial Scale Estimation . . . . . . . . . . . . . 216 T. Hirayama, Y. Iwai, M. Yachida Eyebrow Movement Analysis over Real-time Video Sequences for Synthetic Representation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 229 A. C. Andr´es del Valle, J.L. Dugelay Software Laboratory for Physical Based Human Body Animation . . . . . . . . 236 F. Rojas, S. Baldassarri, F. J. Ser´ on Computer Visual System Analyzing the Influence of Stimulants on Human Motion. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 247 R. S. Choras, M. Choras Recovering Non-Rigid 3D Shape using a Plane+Parallax Approach. . . . . . . 258 N. Perez de la Blanca, A. Garrido

Author Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 264

VI

Virtual Clay: Haptics-based Deformable Solids of Arbitrary Topology K. T. McDonnell, H. Qin Department of Computer Science, State University of New York at Stony Brook Stony Brook, NY 117944400

g-HDAF Multiresolution Deformable Models I.A. Kakadiaris1 , M. Papadakis2 , L. Shen1 , D. Kouri3 , and D. Hoffman4 1

4

Department of Computer Science, University of Houston, Houston, TX 77204-3010 2 Department of Mathematics, University of Houston, Houston, TX 77204-3010, 3 Department of Physics, University of Houston, Houston, TX 77204-5003, Department of Chemistry and Ames Laboratory, Iowa State University, Ames, IS, 50011

Muscle-driven motion simulation based on deformable human model constructed from real anatomical slice data H. Inaba, S. Miyazaki, and J. Hasegawa Graduate School of Computer and Cognitive Sciences, Chukyo University 101 Tokodachi, Kaizu-cho, Toyota-city, Aichi, 470-0393 Japan.

Model Acquisition Using Shape-from-Shading A. Robles-Kelly, E. R. Hancock Department of Computer Science, University of York,York YO1 5DD, UK.

A Computational Algebraic Topology Model for the Deformation of Curves P. Poulin1 , M.F. Auclair-Fortier1 , D. Ziou1 , M. Allili2 1

DMI, Universit´e de Sherbrooke, Sherbrooke, Canada, J1K 2R1 DCSM, Bishops University, Lennoxville, Canada, J1M 1Z7

2

P3 DMA: A Physical 3D Deformable Modelling and Animation System M. Mascar´o P., A. Mir, F. Perales Departament de Matem` atiques i Inform` atica Unitat de Gr` afics i Visi´ o, Universitat de les Illes Balears Crta. de Valldemossa, Km. 7,5 07071 Palma de Mallorca

A Novel Approach to Generate Multiple Shape Models for Tracking Applications D. Ponsa, X. Roca Centre de Visi´ o per Computador, Universitat Aut` onoma de Barcelona, 08193-Bellaterra (Barcelona), Spain

Real-time Human Motion Analysis based on Silhouette Contour and Color Blob Analysis R. Hoshino1 , D. Arita1 , S. Yonemoto2 , R. Taniguchi1 1

2

Department of Intelligent Systems, Kyushu University HTTP://LIMU.IS.KYUSHU-U.AC.JP Department of Intelligent Systems, Kyushu Sangyo University

Human Body Model Acquisition and Motion Capture Using Voxel Data I. Miki´c1 , M. Trivedi1 , E. Hunter2 , P. Cosman1 1

1Department of Electrical and Computer Engineering, 9500 Gilman Drive, La Jolla, California 92093- 0407 2 Q3DM, Inc., [email protected]

3D Body Reconstruction for Immersive Interaction I. Cohen and M. W. Lee Institute for Robotics and Intelligent Systems, University of Southern California Los Angeles, CA 90089-0273

Wide-Range Tracking of Hands in Real-Time Y. Iwai, T. Mashita, M. Yachida Graduate School of Engineering Science, Osaka University 1-3, Machikaneyama, Toyonaka, Osaka 560-8531, JAPAN

Recognition, Tracking, and Reconstruction of Human Motion J. Sullivan, M. Eriksson, S. Carlsson Computational Vision and Active Perception Laboratory (CVAP), KTH, SE-100 44 Stockholm, Sweden.

Tracking the Human Body using Multiple Predictors R. M. Jesus1 , A. J. Abrantes1 , J. S. Marques2 1

2

Instituto Superior de Engenharia de Lisboa, Postfach 351-218317001, Rua Conselheiro Em´ıdo Navarro, no 1, 1940-014 Lisboa, Portugal Instituto de Sistemas e Rob´ otica, Instituto Superior T´ecnico, Av. Rovisco Pais, 1049-001 Lisboa, Portugal

Motion Estimation of Articulated Objects from Perspective Views X. Zhang, Y. Liu, T. S. Huang Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, P.R. China, 200030

Gesture and Posture Estimation by Using Locally Linear Regression Y. Iwai, K. Manjoh, M. Yachida Graduate School of Engineering Science, Osaka University 1-3, Machikaneyama, Toyonaka, Osaka 560-8531, JAPAN

aSpaces: Action Spaces for Recognition and Synthesis of Human Actions J. Gonz`alez, X. Varona, X. Roca, and J. J. Villanueva Computer Vision Center & Dept. de Inform` atica, Universitat Aut` onoma de Barcelona Edifici O, 08193 Bellaterra(Barcelona), Spain, [email protected], [email protected], WWW home page: http://www.cvc.uab.es

Face Recognition Based on Efficient Facial Scale Estimation T. Hirayama, Y. Iwai, M. Yachida OSAKA UNIVERSITY, Graduate School of Engineering Science

Eyebrow Movement Analysis over Real-time Video Sequences for Synthetic Representation A. C. Andr´es del Valle, J.L. Dugelay Institut Eur´ecom. Multimedia Communications Department. 2229, route des Crˆetes B.P. 193 06904 Sophia Antipolis cedex France

Software Laboratory for Physical Based Human Body Animation F. Rojas1 , S. Baldassarri2 , F. J. Ser´on2 1

Area de Electr´ onica y Nuevas Tecnolog´ıas, Instituto Tecnol´ ogico de Arag´ on, Mar´ıa de Luna 8, 50018-Zaragoza, Espaa 2 Grupo de Inform´ atica Gr´ afica Avanzada, Dep. de Inform´ atica e Ingenier´ıa de Sistemas, Centro Polit´ecnico Superior-Universidad de Zaragoza, Mar´ıa de Luna 1, 50018-Zaragoza, Espaa

Computer Visual System Analyzing the Influence of Stimulants on Human Motion. R. S. Choras, M. Choras Institute of Telecommunication, University of Technology and Agriculture, ul. Prof. Kaliskiego 7, 85-792, Bydgoszcz, Poland

Recovering Non-Rigid 3D Shape using a Plane+Parallax Approach. N. Perez de la Blanca, A. Garrido Department of Computer Science and AI, University of Granada, 18071, Granada, Spain

Author Index

Abrantes, A. J., 164 Allili, M., 58 Andr´es del Valle, A. C., 229 Arita, D., 97 Auclair-Fortier, M.F., 58 Baldassarri, S., 236 Carlsson, S., 153 Choras, M., 247 Choras, R. S., 247 Cohen, I., 126 Cosman, P., 110 Dugelay, J.L., 229

Manjoh, K., 190 Marques, J. S., 164 Mascar´ o, M., 71 Mashita, T., 139 McDonnell, K. T., 1 Miki´c, I., 110 Mir, A., 71 Miyazaki, S., 32 Papadakis, M., 21 Perales, F., 71 Perez de la Blanca, N., 258 Ponsa, D., 84 Poulin, P., 58

Eriksson, M., 153

Qin, H., 1

Garrido, A., 258 Gonz` alez, J., 203

Robles, A., 45 Roca, X., 84, 203 Rojas, F., 236

Hancock, E.R., 45 Hasegawa, J., 32 Hirayama, T., 216 Hoffman, D., 21 Hoshino, R., 97 Huang, T. S., 177 Hunter, E., 110 Inaba, H., 32 Iwai, Y., 139, 190, 216 Jesus, R. M., 164

Ser´ on, F. J., 236 Shen, D., 21 Sullivan, J., 153 Taniguchi, R., 97 Trivedi, M., 110 Varona, X., 203 Villanueva, J. J., 203

Kakadiaris, I. A., 21

Yachida, M., 139, 190, 216 Yonemoto, S., 97

Lee, M. W., 126 Liu, Y., 177

Zhang, X., 177 Ziou, D., 58