Animation and Performance Capture Using Digitized Models

1. Front Matter

   PDF

2. Introduction

   1. Introduction

      • Edilson de Aguiar

      Pages 1-5

3. Part I: Background and Basic Definitions

   1. Front Matter

      Pages 7-7

      PDF

   2. Preliminary Techniques

      • Edilson de Aguiar

      Pages 9-18

   3. Interactive Shape Deformation and Editing Methods

      • Edilson de Aguiar

      Pages 19-27

   4. Recording Studio: Data Acquisition and Data Processing

      • Edilson de Aguiar

      Pages 29-36

4. Part II: Natural Animation of Digitized Models

   1. Front Matter

      Pages 37-37

      PDF

   2. Problem Statement and Preliminaries

      • Edilson de Aguiar

      Pages 39-43

   3. Poisson-Based Skeleton-Less Character Animation

      • Edilson de Aguiar

      Pages 45-54

   4. Laplacian-Based Skeleton-Less Character Animation

      • Edilson de Aguiar

      Pages 55-61

5. Part III: Towards Performance Capture Using Deformable Mesh Tracking

   1. Front Matter

      Pages 63-63

      PDF

   2. Problem Statement and Preliminaries

      • Edilson de Aguiar

      Pages 65-73

   3. Video-Based Tracking of Scanned Humans

      • Edilson de Aguiar

      Pages 75-86

   4. Feature Tracking for Mesh-Based Performance Capture

      • Edilson de Aguiar

      Pages 87-99

   5. Video-Based Performance Capture

      • Edilson de Aguiar

      Pages 101-117

   6. High-Quality 3D Videos

      • Edilson de Aguiar

      Pages 119-124

6. Part IV: Processing Mesh Animations

   1. Front Matter

      Pages 125-125

      PDF

   2. Problem Statement and Preliminaries

      • Edilson de Aguiar

      Pages 127-132

   3. Reconstructing Fully-Rigged Characters

      • Edilson de Aguiar

      Pages 133-148

   4. Designing Non-photorealistic Animation Collages

      • Edilson de Aguiar

      Pages 149-162

The realistic generation of virtual doubles of real-world actors has been the focus of computer graphics research for many years. However, some problems still remain unsolved: it is still time-consuming to generate character animations using the traditional skeleton-based pipeline, passive performance capture of human actors wearing arbitrary everyday apparel is still challenging, and until now, there is only a limited amount of techniques for processing and modifying mesh animations, in contrast to the huge amount of skeleton-based techniques. In this thesis, we propose algorithmic solutions to each of these problems. First, two efficient mesh-based alternatives to simplify the overall character animation process are proposed. Although abandoning the concept of a kinematic skeleton, both techniques can be directly integrated in the traditional pipeline, generating animations with realistic body deformations. Thereafter, three passive performance capture methods are presented which employ a deformable model as underlying scene representation. The techniques are able to jointly reconstruct spatio-temporally coherent time-varying geometry, motion, and textural surface appearance of subjects wearing loose and everyday apparel. Moreover, the acquired high-quality reconstructions enable us to render realistic 3D Videos. At the end, two novel algorithms for processing mesh animations are described. The first one enables the fully-automatic conversion of a mesh animation into a skeletonbased animation and the second one automatically converts a mesh animation into an animation collage, a new artistic style for rendering animations. The methods described in the thesis can be regarded as solutions to specific problems or important building blocks for a larger application. As a whole, they form a powerful system to accurately capture, manipulate and realistically render realworld human performances, exceeding the capabilities of many related capture techniques. By this means, we are able to correctly capture the motion, the timevarying details and the texture information of a real human performing, and transform it into a fully-rigged character animation, that can be directly used by an animator, or use it to realistically display the actor from arbitrary viewpoints.

• 3D
• 3D graphics
• Performance
• animation
• character animation
• computer graphics
• model
• rendering
• tracking

From the reviews:

“This book is an adaptation of a PhD thesis and, reflecting its origins, it is written in a scholastic style, well suited for self study or for a formal course on animation of digital characters … . offer computationally economic alternatives to the classical pipeline process of computer animation and so the community of digital character animation has gained more efficient tools to work. For all these considerations, we can say that this book by Dr. de Aguiar is a great contribution to the field.” (Cesar Alberto Bravo Pariente, NoticIEEEro, Vol. 22 (4), August, 2011)

• Disney Research Pittsburgh, Carnegie Mellon University, Pittsburg, USA

  Edilson Aguiar

Policies and ethics