|
20 years ago there was Midi. It separated out gestures from sound. Now
there are body sensors controlling both visuals and sound. Neither sensor
nor output need be attached to each other. Instead, someone performs in
one space, and transfers the exact same experience to another place.
The main piece of information for reproducing an experience is the gesture.
A gesture is simply the movement of a body part. New sensors, such as MEMs
accelerometers, gyros, and CMOS cameras will enable new modes of expression
through the human body.
Layering gestures onto existing internet protocols of chat, newsgroups,
and web pages, will enable a new community of multimedia performances
that are both fresh and persistent.
To reduce
complexity, we treat human gestures as a directed graph that is mapped to
a switched tree.
To support
16 year old developers, we implemented a simple object framework that exploits
the synergy between stack, queue, hierarchy, and graph.
To support
12 year old orchestrators, we implemented a rendering framework that can
auto break feedback loops in a directed graph.
To support
8 year old jammers, we intend to support ad hoc trees to distribute
content between peer machines.
To support
4 year old performers is a user interface that is flat and persistent.
|