PROJECT: Blending Calligraphy and Choreography

Given a Chinese calligraphy, the shape or some features in the calligraphy may motivate a dance performers create certain dance motions. Different features in the calligraphy may motivate different dance motions. We believe that there should be some associations between Chinese calligraphy and dance motion. In the project, we are going to formulate those associations and to build an application which allows dance performers to design dance movements incorporating Chinese calligraphy for art performance.

A. When choreography is to be generated from calligraphy:
1. The input can be a scanned calligraphic image, a stylus captured in real-time or ChangJie codes inputted in real-time.
2 The Chinese characters are obtained. They are analyzed to extracted features.
3. Use the derived associations to associate the features in Chinese characters with
the parameters of a human dance motion.
4. Render the 3D animation of the resulting dance using the parameters of a human dance motion.
B. When calligraphy is to be generated from choreography:
1. Dance motions are created by dance performers and captured by our motion capture system.
2. Dance motion data is generated by the motion capture system.
3. Extract features from the dance motion data.
4. Use the derived association to associate the dance features with the features of Chinese characters.
5. Generate the resulting Chinese characters using the features obtained.
Any suggestions or comments are welcome. Please send them to Howard Leung.