Learning a family of motor skills from a single motion clip

Seoul National University
Responsive image

The parameterized motor skills of obstacle jump, jump, backflip, cartwheel and kick motions.


Abstract

We present a new algorithm that learns a parameterized family of motor skills from a single motion clip. The motor skills are represented by a deep policy network, which produces a stream of motions in physics simulation in response to user input and environment interaction by navigating continuous action space. Three novel technical components play an important role in the success of our algorithm. First, it explicitly constructs motion parameterization that maps action parameters to their corresponding motions. Simultaneous learning of motion parameterization and motor skills significantly improves the performance and visual quality of learned motor skills. Second, continuous-time reinforcement learning is adopted to explore temporal variations as well as spatial variations in motion parameterization. Lastly, we present a new automatic curriculum generation method that explores continuous action space more efficiently. We demonstrate the flexibility and versatility of our algorithm with highly dynamic motor skills that can be parameterized by task goals, body proportions, physical measurements, and environmental conditions.

Publication

Seyoung Lee, Sunmin Lee, Yongwoo Lee, and Jehee Lee. 2021.
Learning a family of motor skills from a single motion clip
ACM Trans. Graph. 40, 4, 93. (SIGGRAPH 2021)

Video


Bibtex

@article{Lee:2021:Parameterized,
    author = {Lee, Seyoung and Lee, Sunmin and Lee, Yongwoo and Lee, Jehee},
    title = {Learning a family of motor skills from a single motion clip},
    journal = {ACM Trans. Graph.},
    volume = {40},
    number = {4},
    year = {2021},
    articleno = {93},
}