SEED Research & Announcements Blogs Publications Open Source Careers Contact Us Research & Announcements Blogs Publications Open Source Careers Contact Us

Objective Metrics for Evalutating Gesture Generation are Almost Useless

How do you evaluate something as subjective and ephemeral as human body language for natural and lifelike qualities?

There are many approaches to generating gestures for game characters based on speech. But the lack of of a standard way of judging the appropriateness and human-like qualities of those gestures has been a stumbling block to progress in the field.

The GENEA Challenge on speech-driven gesture generation brings together researchers who use different methods to generate and evaluate non-verbal behaviour. The goal is to stimulate discussion about how to improve both the generation methods and the evaluation of the results.

SEED’s Taras Kucherenko has been instrumental in creating and advancing the GENEA Challenge and talks about some recent surprising results when comparing automated tools with user studies.

Research Paper

The research paper on the GENEA Challenge was published in ACM Transactions on Graphics, April 2024. Authors: Taras Kucherenko, Pieter Wolfert, Youngwoo Yoon, Carla Viegas, Teodor Nikolov, Mihail Tsakov, and Gustav Eje Henter.

Check out the GENEA Challenge 2022 paper here.

Related News

Gigi Lightning Talks

SEED
Sep 26, 2024
SEED brought together developers to show off their prowess using the Gigi rapid prototyping platform for real-time rendering.

SEED's Adventure in Gameplay Innovation

SEED
Sep 13, 2024
SEED is branching out into the world of game mechanics, storytelling magic, and interactive wonders.

A Position-Based Material Point Method

SEED
Aug 29, 2024
A novel formulation of Material Point Method that is stable at any time-step, and significantly improves the utility of MPM for real-time applications.