Generating Virtual 3D Painting and Music through Body Motion



News and event

System Architecture

Video Demos

Research Publications




News and Event


Body Brush News

Hong Kong Museum of Art:

Ming Pao Weekly :

Hong Kong Museum of Art:


Siggrapg 2003 News

BODY-BRUSH shows in "Emerging Technologies" of Siggraph 2003

San Diego, California, USA


Prix Ars Electronica 2002 News

BODY-BRUSH shows in "Interactive Art" of Prix Ars Electronica 2002

Linz, Austria


CNN report on BODY-BRUSH


'Body brush' paints on virtual canvas

High-art goes high-tech

March 29, 2002 Posted: 8:54 AM EST (1354 GMT)

Images using the "body brush" represent a digital reproduction of an artist's movements.  
From Kristie Lu Stout

HONG KONG, China (CNN) -- In the brief history of modern art, the paintbrush has been replaced by mixed-media collage, the silk screen, even naked models covered in blue paint. Now, the tools of the trade are due for a digital upgrade.

Researchers in Asia have developed a new tool that enables artists to paint on a three-dimensional canvas. So instead of holding a wooden handle with bristles at the end, the artists themselves are acting as the brush.

Enter the "body brush" -- an interface that maps the movements of an artist in a 3-D space, translating action into art.

Hong Kong artist Young Hay developed the body brush with professor of computer science Horace Yip of Hong Kong's City University.

Together, they learned how to capture movement with infrared illumination sensors, which interact with advanced motion-analysis software.

"This interface treats the body as a brush," says Hay. "Traditionally, we rely on the hands to use the tools to apply the paint on the canvas, but with this interface we can treat the body as a whole as a dynamic brush."

CNN's Kristie Lu Stout reports on the fusion of technology and art to create a whole-body painting. (March 28)

Play video

So how does it work?

"On the floor there is a color palette," says Yip, gesturing to the corners of the room. "This corner's red, that corner's yellow and so on.

"So you pick the color you want to draw ... the brush is dependent on where [an artist] enters this three-dimensional canvas space. He can control what color he ... wants to pick. So you enter from that corner, pick up the red. Pick up the red and come in and do the body movements, and then out comes the color stroke in red."

Too inhuman?

The effect? Vibrant splashes of color inspired by the abstract expressionist Jackson Pollock and his "action painting," a technique used to reflect the physical energy of the painter as he splashed color onto his canvas.

Artist Young Hay believes the "body brush" may be embraced by the art community because it creates a unique type of relationship with the machine.  

"Anyone without any training can come into this room, run around and jump around and out comes a beautiful painting," says Yip.

"But at the same time, if you really want to control the color and the width of the brushstroke and to control the geometric form of the three-dimensional painting, you need some practice. So it has all the interesting attributes of a game -- easy to learn, difficult to master."

But it may not be that hard to sell the body brush to the art community.

A lot of artists are initially reluctant to use machines, says Hay, since they often think technology is cold or inhuman.

"But with the body, by using the body to interact with the machine, [they] could create a new relationship with the machine."

Indeed, a device that may inspire new strokes of genius.



BBC report on BODY-BRUSH

(open "Click Art" )


NHK report on BODY-BRUSH


Spanish TV (Telecino) report on BODY-BRUSH


Report by ZDNet


Report by


Report from Russia


Report from Japan


Report from Vietnam



One of China's most renowned painters, Wu Guanzhong, turned his body into a brush and composed a 3-D drawing using CityU's innovative Body-Brush technology on campus on 13 March.



Six Dances Interacted with "Body-Brush"

choreograph and dance by Mui Cheuk Yin and Daniel Yeung
"body-brush" rendering directed by Young Hay

Venue: CityU Gallery
6/F Amenities Building, City University of Hong Kong
Date: 4-5 January 2003
Time: 3:00 - 4:00, 8:00 - 9:00 p.m. 
Admission $30
Enquiry: 2788 7580, 2788 8615



Venue: CityU Gallery
6/F Amenities Building, City University of Hong Kong
Exhibition Date: 17 November 2002 - 8 January 2003 (Daily)
Exhibition Time: 10:00 a.m. - 7:00 p.m. 
Enquiry: 2788 7580


Body-Brush was launched on December 6, 2001. Body-Brush has been visited by numerous audiences from local and overseas. They all found that the interaction with this interface is highly interactive, but at the same time almost intuitive.


Body-Brush was officiated by the Hon. Sin Chung-kai, Legislative Councillor and Professor H K Chang, President of CityU. 

Dr Christina Chu, Chief Curator of Hong Kong Museum of Art, Prof. Horace Ip, Department of Computer Science, and Mr. Young Hay, Concept Designer of "Body Brush", introduced the artistic and technological innovations of Body-Brush.


  AIMtech Centre
Horace Ip, Young Hay, Alex Tang
    Copyright 2002 AIMtech Centre, City University of Hong Kong. All rights reserved.