Exploring Ways of Interacting with the Computer

HyperSense Complex–the collaborative trio of Alistair Riddell, Somaya Langley, and Simon Burton–have been working together since 2002. They’ve been exploring the notions of collaborative interactive performance in a networked computing space (essentially where members of the trio - dependant on configurations of specific performances - can influence each other’s sound, for example: by sampling each other’s output, adding effects etc). HyperSense has also been developing an alternative HCI’s using flex sensors worn on the hands (and strapped into a jacket arrangement). The project utilises data sent from the sensors through microcontrollers and passed via USB to some python scripting which handles what the sensor data should do. They then implemented OSC and are using this to send information to SuperCollider running on a separate laptop, which handles the samples and audiobased materials.

Mechanical Orchestra with you as Conductor

In Sale Away, passers-by can conduct an “orchestra” of household devices via their mobile phones on a display window. The mechanical orchestra consists of flute, organ and brass playing vacuum cleaners, rattling kitchen mixers, buzzing ventilators, radio playing toy trains, wobbling jigsaws, dancing tumble dryers, humming refrigerators and other misused household utilities.

The conductor is a big refrigerator. This fridge is also the explanatory interface. To start the orchestra and wake up the shopping windows you have to dial the number and follow the commands displayed on the window. This call opens the door of the fridge, giving free the image of its explanatory interface, the “mobile phone robot person”. The robot will explain and invite you to act. By pressing keys on the phone you can let all different instruments play along with the melody. You can set some single voices or the whole orchestra tutti.

Video. By Geert-Jan Hobijn (NL) and Carsten Stabenow (GER) Olaf Matthes (GER) from Staalplaat. Via the excellent Culture Base Open List. [blogged by Regine on near near future]