Prof. Daijin Kim Develops Virtual K-Pop Dance Teacher to Make Dance Learning Easier
Prof. Daijin Kim of the Intelligent Media Lab has developed a virtual dance teacher that can make learning famous K-Pop dances easier at home by precisely tracking 3D body joints. He presented the relevant technical paper at ICIP 2015 (IEEE International Conference on Image Processing 2015).
Prof. Kim and his team successfully developed the precise 3D tracking of 15 human body joints using big data of the human body and the relational information among human body joints and its tracking performance showed a 4.5 cm error on average among 15 human body joints.
In order to develop the virtual K-Pop dance teacher, the team selected a hundred K-POP dance routines that were performed by a professional dancer and collected the moves of 15 body joints of each dancing movement. They then extracted the moves of 15 body joints from a dance learner using the developed precise 3D tracking of body joints and evaluated the average similarity between the body joint movements of the dance learner and those of the professional dancer.
They also developed a score monitoring method based on the similarity and represented how much each body part of a dance learner is deviated from the corresponding body part of a professional dancer. The brightness of each body part specifies the similarity of dance movements of each body part (See Figure 1).
The submitted paper was selected as one of the top 10 papers among 1,098 accepted papers. This implied that the developed technology of precisely tracking 3D body joints was recognized as outstanding.
This work was supported by the project “Development of K-Pop dance retrieval based on biomechanics and posture accuracy analysis” by the Ministry of Culture, Sports and Tourism (MCST) and the Korea Creative Content Agency (KOCCA) in the Culture Technology (CT) Research & Development Program 2015.
Dance movement of a dance teacher (left) and a dance learner (right). In the right figure, body parts of the dance learner are represented with brighter sticks as they are those of the dance teacher.