puzzle how
how

20 years ago there was Midi. It separated out gestures from sound. Now there are body sensors controlling both visuals and sound. Neither sensor nor output need be attached to each other. Instead, someone performs in one space, and transfers the exact same experience to another place.

The main piece of information for reproducing an experience is the gesture. A gesture is simply the movement of a body part. New sensors, such as  MEMs accelerometers, gyros, and CMOS cameras will enable new modes of expression through the human body.

Layering gestures onto existing internet protocols of chat, newsgroups, and web pages, will enable a new community  of multimedia performances that are both fresh and persistent.

A Programmer's View 

To reduce complexity, we treat human gestures as a directed graph that is mapped to a switched tree. 

To support 16 year old developers, we implemented a simple object framework that exploits the synergy between stack, queue, hierarchy, and graph. 

To support 12 year old orchestrators, we implemented a rendering framework that can auto break feedback loops in a directed graph. 

To support 8 year old  jammers, we intend to support ad hoc trees to distribute content between peer machines.

To support 4 year old performers is a user interface that is flat and persistent.


menu