DanceDJ: A 3D Dance Animation Authoring System for Live Performance

Naoya Iwamoto (Waseda University)
Takuya Kato (Waseda University) *joint first-author
Hubert P.H. Shum (Northumbria University)
Ryo Kakitsuka (Waseda University)
Kenta Hara (Meiji University)
Shigeo Morishima (Waseda Research Institute for Science and Engineering)



Abstract


Dance is an important component of live performance for expressing emotion and presenting visual context. Human dance performances typically require expert knowledge of dance choreography and professional rehearsal, which are too costly for casual entertainment venues and clubs. Recent advancements in character animation and motion synthesis have made it possible to synthesize virtual 3D dance characters in real-time. The major problem in existing systems is a lack of an intuitive interfaces to control the animation for real-time dance controls. We propose a new system called the DanceDJ to solve this problem. Our system consists of two parts. The first part is an underlying motion analysis system that evaluates motion features including dance features such as the postures and movement tempo, as well as audio features such as the music tempo and structure. As a pre-process, given a dancing motion database, our system evaluates the quality of possible timings to connect and switch different dancing motions. During run-time, we propose a control interface that provides visual guidance. We observe that disk jockeys (DJs) effectively control the mixing of music using the DJ controller, and therefore propose a DJ controller for controlling dancing characters. This allows DJs to transfer their skills from music control to dance control using a similar hardware setup. We map different motion control functions onto the DJ controller, and visualize the timing of natural connection points, such that the DJ can effectively govern the synthesized dance motion. We conducted two user experiments to evaluate the user experience and the quality of the dance character. Quantitative analysis shows that our system performs well in both motion control and simulation quality.

Demo




Publication


DanceDJ: A 3D Dance Animation Authoring System for Live Performance
Naoya Iwamoto (Waseda University)
Takuya Kato (Waseda University) *joint first-author
Hubert P.H. Shum (Northumbria University)
Ryo Kakitsuka (Waseda University)
Kenta Hara (Meiji University)
Shigeo Morishima (Waseda Research Institute for Science and Engineering)
ACE2017 (Full Paper), London (UK), 2017.12.14-12.16.
[ Paper (wil be soon) ] [ Video (Youtube) ] [ ACE2017 (HP) ]


DanceDJ: ライブパフォーマンスのための実時間ダンス編集システムの提案
岩本尚也, 柿塚亮
共同開発者: 加藤卓哉, Hubert P.H. Shum, 原健太, 森島繁生
CEDEC2017 (インタラクティブセッション), パシフィコ横浜, 2017.08.30-09.01.
[ Poster ] [ セッション紹介ページ ] [ CEDEC2017 (HP) ]


Dance DJ: ライブパフォーマンスのためのダンス動作ミックスシステム
岩本尚也, 加藤卓哉, 原健太, 柿塚亮, 森島繁生
第24回 インタラクティブシステムとソフトウェアに関するワークショップ(WISS2016) (デモ), 滋賀県長浜, 2016.12.14-16.
[ Paper ] [ WISS2016 (HP) ]


Dance DJ
Music Human Interaction Research Group
(メンバー: 岩本尚也, 加藤卓哉, 原健太, 柿塚亮)
第6回 アプリケーションコンテスト レコチョク賞受賞, 早稲田大学大熊小講堂, 2016.07.29.
[ 発表動画 (Youtube) ] [ 第6回アプリケーションコンテスト (HP) ]




back

Copyright © 2015 Digital Dance Group

developed by kosakasakas.