Applied Perception For Visual Computing (4541.762)

2012 Fall

Co-instructors

Carol O'Sullivan

E-mail: carol.osullivan (at) cs (dot) tcd (dot) ie

Office: 302-311-3

Phone: 02-880-1611

 

Jehee Lee

E-mail: jehee (at) cse (dot) snu (dot) ac (dot) kr

Office: 302-325

Phone: 02-880-1845

Teaching Assistance

Kibeom Youn

E-mail: kibeom.youn (at) mrl (dot) snu (dot) ac (dot) kr

Office: 302-312-1

Phone: 02-880-1864

Class Hour

Monday and Wednesday, 15:30 to 16:50

Class Room

302-106

Webpage

http://mrl.snu.ac.kr/courses/courses.html

Textbooks

The course will be delivered via a combination of lectures, guest speakers and student presentations.

 

Recommended references

-       Visual Perception From a Computer Graphics Perspective, CRC Press.

Course Introduction

In most areas of Computer Science, there are many advantages to be gained by understanding and applying principles of human perception. This is particularly true for the domain of Visual Computing. In recent decades, researchers and practitioners from computer graphics, virtual reality, computer vision, image processing, visualization, experimental psychology, neuroscience, eye-movement analysis, and other related fields have been applying perceptual methods to assess and enhance the quality of computer-generated scenes, animations, and virtual environments.

In this seminar course, students will be introduced to the field of Applied Perception for Visual Computing, and related topics in audio, haptic and multisensory systems. In addition, foundational material in Human Perception and psychophysical methods will be covered.

Grading Policy

Course participation 50%, Term project/paper 50%

 

Tentative schedule (will change depending on the schedule of guest speakers)

Week 1

9/ 3

Course introduction( ppt )

9/ 5

Light Perception( ppt )

Week 2

9/10

Color

9/12

High Dynamic Range Images and Tone Mapping( ppt )

Week 3

9/17

Student presentation

-       (Hwangpil Park)   Push it Real: Perceiving Causality in Virtual Interactions, SIGGRAPH 2012.

-       (Jungdam Won)   Seeing is Believing: Body Motion Dominates in Multisensory Conversations, SIGGRAPH 2010.

9/19

Student presentation

-        (Zhiqiang Ma)   A Perception-based Color Space for Illumination-invariant Image Processing, SIGGRAPH 2008.

Week 4

9/24

Student presentation

-       (Jiwon Jeong)   Render me Real? Investigating the Effect of Render Style on the Perception of Animated Virtual Humans, SIGGRAPH 2012.

-       (Jonathan Boelike)   Fool Me Twice: Exploreing and Exploiting Error Tolerance in Physics-Based Animation, ACM ToG 2010.

9/26

Student presentation

-       (Minji Yoon)   Imperceptible Relaxation of Collision Avoidance Constraints in Virtual Crowds, SIGGRAPH ASIA 2011.

-       (tian iok TIONN)   Self-Animating Images: Illusory Motion Using Repeated Asymmetric Patterns, SIGGRAPH 2008.

Week 5

10/ 1

No class (추석)

10/ 3

No class (개천절)

Week 6

10/ 8

Student presentation

-       (Kyungho lee)   Perceptually Based Tone Mapping for Low-Light Conditions, SIGGRAPH 2011

-       (Youngho Kim)   How Well Do Line Drawings Depict Shape? SIGGRAPH 2009 설명: 설명: 설명: 설명: 설명: 설명: 설명: 설명: 설명: ACM DOI

10/10

Student presentation

-       (Dennis Rosen)   Simulating Virtual Environments within Virtual Environments as the Basis for a Psychophysics of Presence설명: 설명: 설명: 설명: 설명: 설명: 설명: 설명: 설명: ACM DOI

 

Perceiving Realism in Virtual Worlds

 

Week 7

10/15

Perceiving Realism in Virtual Worlds continued.

 

10/17

Psychophysics:  How to run perception experiments in Visual Computing?   http://dl.acm.org/citation.cfm?id=1401243

 

Week 8

10/22

Psychophysics:  How to run perception experiments in Visual Computing? continued

 

10/24

Guest Speaker: Isabelle Buelthoff

Title : Face Perception. using a morphable face model to determine what makes a face look Asian or Caucasian and what makes a face attractive and why?

 

Week 9

10/29

Student presentation

-       (Keehong Youn) Evaluating the effectiveness of orientation indicators with an awareness of individual differences. ACM TAP 2012. http://dl.acm.org/citation.cfm?id=2207218

-       (Junbong Song) The Generalized Perceived Input Point Model and How to Double Touch Accuracy by Extracting Fingerprints. CHI 2010. http://www.patrickbaudisch.com/publications/2010-HolzBaudisch-CHI10-TheGeneralizedPerceivedInputPointModelAndRidgePad.pdf

10/31

Student presentation

-        (Heonjin Park) Emerging ImagesACM DOI

 

-       (Jan Hättig) Crowd Light: Evaluating the Perceived Fidelity of Illuminated Dynamic Scenes Adrian Jarabo, Tom Van Eyck, Veronica Sundstedt, Kavita Bala, Diego Gutierrez and Carol O'Sullivan, Computer Graphics Forum (Eurographics 2012), 31(2), (2012) http://giga.cps.unizar.es/~ajarabo/pubs/crowdsEG12/

Week 10

11/ 5

Guest Speaker: Fiona Newell  (Trinity College Dublin)

Title: Using principles of multisensory integration in the development of targeted interventions, games and entertainment

11/ 7

Statistical Analysis of Experimental Data

http://www.psychology.nottingham.ac.uk/staff/pal/stats/c82mst/c82mst

 

Week 11

11/12

Title: Perception in Virtual Environments: Distance and Avatars

 

Guest Speaker: Robert E. Bodenheimer (Vanderbilt University)

 

11/14

Statistical Analysis of Experimental Data cont..

 

l  Project Details

Pick a problem that could benefit from perceptual evaluation.

This problem can either be from your own research project, be inspired by a paper you read, or any other source. By 5pm on Tuesday, November 20th, please email Prof. O’Sullivan Two Power point Slides as follows:

 

Slide 1: The statement of the research problem, why it is important, and how perceptual evaluation can help to solve it.

 

Slide 2: An overview of how you intend to design and execute the evaluation study, and analyze the results.

 

In Class on Weds November 21st, you will be given 5 minutes to present your proposal: (2 minutes presentation and 3 minutes discussion).

Write a 6-10 page report on your design, giving full details of the background to the proposal, the experimental methods you would use and reasons for same, the design of the experiment, and the statistical analysis methods you would use. For bonus points, actually run a pilot experiment on some participants and analyze the results! Prepare Four Power point Slides presenting your project (1: problem statement, 2: experimental design, 3: analysis of results, 4: conclusions).

 

Submit the slides by email to Prof. O’Sullivan by 5pm on Friday, December 7th. You may submit the report by 9am, Monday, 12/17

You will present your project in class on either Monday December 10th or Weds December 12th.

 

Week 12

11/19

Design, Analysis and Report of Experiments: Case Study

https://www.scss.tcd.ie/~hoyetl/English/Projects/pushit.html

 

11/21

Guest Speaker: Niko Troje (Queen’s University)

Title : People perception: The visual processing of biological motion

 

Week 13

11/26

Student presentations of project proposals

 

11/28

No class

Week 14

12/3

Image Quality Metrics in Graphics

http://www.mpi-inf.mpg.de/resources/hdr/iqm-evaluation/

 

12/5

Guest Speaker: Andrew Watson (NASA)

 

Title: Vision Models and Visual Quality

 

Abstract:

One grand challenge for the engineering of multimedia quality has been to develop algorithms that can convert physical measurements – of displays, of images, of graphics, or of video sequences – into metrics that have perceptual meaning. These metrics should enable automated detection of artifacts, and optimization of positive multimedia attributes. In the last decade, we and others have made some progress towards this goal. The progress has been achieved by joining display and image measurements to simplified models of processing in the human visual system. In this talk I will describe several of the key concepts and components of these models, and will show how the models can be applied to key problems in display design and image and video processing.  This research may also provide insights for computer graphics applications.

 

Bio:

Andrew B. Watson did undergraduate work at Columbia University and received a PhD in Psychology from the University of Pennsylvania. He subsequently held postdoctoral positions at the University of Cambridge in England and at Stanford University in California. Since 1982 he has worked at NASA Ames Research Center in California, where he is the Senior Scientist for Vision Research, and where he works on models of vision and their application to visual technology. He is the author of over 100 papers on topics such as spatial and temporal sensitivity, motion perception, image quality, and neural models of visual coding and processing. He is the author of six patents, in areas such as image compression, video quality, and detection of artifacts in display manufacturing. In 2000, he founded the Journal of Vision (http://journalofvision.org) where he now serves as Editor-in-Chief. Dr. Watson is a Fellow of the Optical Society of America, of the Association for Research in Vision and Ophthalmology, and of the Society for Information Display. He also serves as the Vice Chair for Vision Science and Human Factors of the International Committee on Display Measurement. In 1990, he received NASA’s H. Julian Allen Award for outstanding scientific paper, and in 1993 he was appointed Ames Associate Fellow for exceptional scientific achievement. He is the 2007 recipient of the Otto Schade Award from the Society for Information Display, and the 2008 winner of the Special Recognition Award from the Association for Research in Vision and Ophthalmology. In 2011, he received the Presidential Rank Award from the President of the United States.

 

Week 15

12/10

Student project presentations

 

NOTE: later starting time

3:50pm: Jeong Jiwon

4pm:   Kim Youngho

4:10pm: Lee Kyungho

4:20pm: Park Hoenjin

4:30pm: Park Hwangpil

 

 

12/12

Student project presentations

 

3:30pm: Rosen Dennis

3:40pm: Son JunBong

3:50pm: Won Jungdam

4pm:   Yoon Minji

4:10pm: Youn KeeHong

4:20pm: Tionn Tian iok

4:30pm: Haettig Jan