Description

This course is intended to provide key ideas in the creation of believable synthetic characters. These characters may have certain levels of intelligence or be controllable and responsive to user's input. This course will consider three types of synthetic characters: Passive, controllable, and intelligent characters. Passive characters are created manually through off-line production process. Most of movie characters in recent computer-generated feature films can be classified as passive. Controllable characters include game characters that are controllable using game controllers and responsive to events in virtual environments. Intelligent characters include artificial pets and virtual humans. The state of the art will be surveyed in the class.

Instructor

Jehee Lee

Class hours

Monday and Wednesday 2:30-3:45pm

Pre-Requisites

Undergraduate computer graphics

Programming skills for C or C++

Programming skills for OpenGL are not required, but recommended

Grading policy

Term project: 50 %

Classroom presentation: 30 %

Homework & Course participation: 20%

    Introduction to synthetic character design (Slide)

    Organizational Meeting

• Project group 2: 성준경, 홍현민, 어상준
• Project group 3: 최봉욱, 이지은, 이택희
• Project group 4: 오두영, 조선영, 강아름보라, 이강훈
• Project group 5: 임예니, 윤승현, 안상진

• [성준경] Jessica K. Hodgins, Wayne L. Wooten, David C. Brogan, James F. O'Brien, Animating human athletics. 71-78, Siggraph 95. Available from http://www-2.cs.cmu.edu/~jkh/ 
• [윤승현] Pratt, Jerry, Pratt, Gill 1999. Exploiting Natural Dynamics in the Control of a 3D Bipedal Walking Simulation. Proceedings of the International Conference on Climbing and Walking Robots (CLAWAR99), Portsmouth, UK, September 1999. Available from www.ai.mit.edu/projects/leglab/publications/publications.html

• [임예니] Asimo from Honda, http://world.honda.com/robot/, Article
• H6 and H7 from Univ. of Tokyo, http://www.jsk.t.u-tokyo.ac.jp/research/h6/H6_H7.html
• [어상준] WABIAN from Waseda Univ., http://www.takanishi.mech.waseda.ac.jp/, Article

• [이택희] Andrew Witkin, Michael Kass, Spacetime Constraints, Siggraph 88. Available from http://ironman.srv.cs.cmu.edu/~aw/gallery.html
• [안상진] Anderson, F.C. and Pandy M.G. Dynamic Optimzation of Human Walking. Journal of Biomechanical Engineering, vol 123, pp. 381-390, 2001b.
• Anderson, F.C. and Pandy, M.G. A Dynamic Optimization Solution for Vertical Jumping in Three Dimensions. Computer Methods in Biomechanics and Biomedical Engineering, Vol. 2, pp. 201-231, 1999. Available from http://www.stanford.edu/group/nmbl/research/publist.html

• [최봉욱] Xiaoyuan Tu and Demetri Terzopoulos, Artificial Fishes: Physics, Locomotion, Perception, Behavior, Siggraph 94.
• [강아름보라] Radekk Grzeszczuk and Demetri Terzopoulos, Automated Learning of Muscle-Actuated Locomotion Through Control Abstraction, Siggraph 95. Available from http://www.mrl.nyu.edu/~dt/

• [홍현민] Verbs and Adverbs: Multidimensional motion interpolation, IEEE CG&A, 1998, Available from http://www.vuse.vanderbilt.edu/~bobbyb/publications.html
• [조선영] Zoran Popovic and Andrew Witkin, Physically Based Motion Transformation, Siggraph 99. Available from http://www.cs.washington.edu/homes/zoran/

• Dr. Min Gyu Choi will give a talk about motion planning for biped synthetic characters using mocap data. He is a post-doc of the school of Electric and Engineering at SNU.
• Min Gyu Choi, Jehee Lee, Sung Yong Shin, Planning Biped Locomotion Using Motion Capture Data and Probabilistic Roadmaps, ACM Transactions on Graphics. Available from http://mrl.snu.ac.kr/research/ProjectPlanning/planning.htm
• Presentation Material

• [이지은] Ken Perlin and Athomas Goldberg, Improv: A system for scripting interactive actors in virtual worlds, Siggraph 96. Available from http://mrl.nyu.edu/publications/index.html
• [오두영] R. Amit and Maja J. Mataric, Parametric primitives for motor representation and control, Int. Conf. on Robotics and Automation (ICRA), 2002. Available from http://www-robotics.usc.edu/~agents/Links/publications.html

    Term project proposal

• Emotional chatting
• Initial-X
• Evolutionary NPC
• Growing chicken

• Jun-Kyu Oh, a senior programmer at Taff System, will give a talk about his experience in on-line game development.

• [안상진] R. A. Brooks, A robust layered control system for a mobile robot, IEEE Journal of Robotics and Automation, 1986, available from http://www.ai.mit.edu/people/brooks/publications.shtml.  The same author's paper "Intelligence Without Representation" also provides an excellent insight in this field.

• [홍현민] S. Y. Yoon, B. Blumberg, and G. Schneider, Motivation Driven Learning for Interactive Synthetic Characters, Autonomous Agents, 2000. Article

• [임예니] B. Blumberg, M. Downie, Y. Ivanov, M. Berlin, M. P. Johnson, and B. Tomlinson, Integrated Learning for Interactive Synthetic Characters, Siggraph 2002, Available from http://web.media.mit.edu/~bruce/whatsnew.html

• [이강훈] Karl Sims, Evolving 3D Morphology and Behavior by Competition, Alife 94, Available from http://www.genarts.com/karl/
• Also look at the same author's paper "Evolving Virtual Creatures", Siggraph 94.

• [성준경] P. Maes, T. Darrell, B. Blumberg, and A. Pentland. The ALIVE System: Wireless, Full-Body interaction with Autonomous Agents, 1996, Available from http://www.media.mit.edu/characters/resources.html

• [이지은] W. S. Reilly and Joseph Bates, Building Emotional Agents, 1992. Available from http://www-2.cs.cmu.edu/afs/cs.cmu.edu/project/oz/web/papers.html

• [윤승현] C. Breazeal and B. Scassellati, Infant-like Social Interactions Between a Robot and a Human Caretaker, Special issue of Adaptive Behavior on Simulation Models of Social Agents, 2000. Available from http://www.ai.mit.edu/projects/sociable/publications.html

    No class (Children's day)

    Intermediate term project presentation

• [어상준] Introduction to Hybrid Naive Bayes HMM (tentative title)
• [5조 중간 발표]

    No class (University Festival)

• [이강훈] M. Mateas and A. Stern, Architecture, Authorial Idioms and Early Observations of the Interactive Drama Facade, 2002. Available from http://www-2.cs.cmu.edu/afs/cs.cmu.edu/project/oz/web/papers.html
• [강아름보라] G. Welch and G. Bishop, An Introduction to the Kalman Filter.

• [조선영] S. Grand, D. Cliff, and A. Malhotra, Creatures: Artificial Life Autonomous Software Agents for Home Entertainment. Article.
• [윤승현] Numerical Recipes, Sec 2.6: Singular Value Decomposition.

• [이택희] C. Bregler and J. Malik, Tracking People with Twists and Exponential Maps, CVPR 98. Available from http://mrl.nyu.edu/~bregler/
• [홍현민] Principle Component Analysis, see http://www.cis.hut.fi/~jhollmen/dippa/node30.html#SECTION00610000000000000000

• [최봉욱J. Deutscher, A. Blake, and I. Reid, Articulated Body Motion Capture by Annealed Particle Filtering, CVPR 2000. Available from http://www.cs.ucsb.edu/~cs265/papers/Body%20motion.pdf
• [임예니] Duda, Hart, and Stork, Pattern Classification, Sec 10.4.3: K-mean clustering

• [강아름보라] I. Essa and A. P. Pentland, Facial Expression Recognition using a Dynamic Model and Motion Energy, ICCV 95. Available from http://www.cc.gatech.edu/fac/irfan/research/pubs/index.html
• [이택희] Fraley and Raftery, Model-based clustering, discriminant analysis, and density estimation. Available from http://www.stat.washington.edu/fraley/

• [오두영] C. Bregler, A. Hertzmann, and H. Biermann, Recovering Non-Rigid 3D Shape from Image Streams, CVPR 200. Available from http://mrl.nyu.edu/~bregler/

    No class

    Final term project presentation

• Group 2 received 3 first-place votes and 2 second-place votes.
• Group 3 received 4 first-place votes and 5 second-place votes.
• Group 4 received 4 first-place votes and 4 second-place votes.
• Group 5 received 2 first-place votes and  2 second-place votes.
• Someone gave two second-place votes instead of a first-place vote.