Art+Com and LAb[au]

Two companies / organisations / art groups that work with the technologies we keep talking about in Multimedia Authoring (year 2) at the moment i.e. touch screens, motion tracking etc. etc. are Art+Com and LAb[au] (who seem to be rebuilding their site so all their projects are offline).

Two posts have just been posted at Digital Experience (good weblog for research for current project):

Home and Exile
and
Touch

focusing on particular work by both groups. Might be an idea to trawl their respective sites to see other works they have done.

Prototype Idea

VST Instruments (virtual studio technology) has revolutionized the way music is composed and performed since their introduction in the late 1990s. Essentially they are software versions of hardware instruments. One of the first successful VSTIs was a software version of the classic Hammond organ. The advantages of VSTIs are obvious, they have put a vast array of previously super-expensive instruments into the hands of the masses and a whole virtual studio can fit on a laptop.

THE PROBLEM:

I’ve been to a few electronica gigs where musicians have been using VSTIs. To be honest, whatever the quality of the music, it’s dull watching one performer frantically mouse-clicking.

As demonstrated in the above video, using a mouse you can only control one parameter of the VSTI at any one time. This is not an expressive way to play a synthesizer.

ONE SOLUTION

Using MIDI (a system that allows hardware instruments/keyboards to communicate with computers) it is possible to assign knobs on a keyboard to control the different parameters on a VSTI, as demonstrated in the video below. Each member of the band has a laptop connected to a small controller keyboard, it’s rather a long video but you can see what I’m on about 2 minutes or so into it. You can hear them changing the pitch etc. of the sounds by turning the knobs assigned to the VSTI.

Being inanimate is part of their act but for other musicians, using a controller keyboard isn’t exactly riveting to watch. Another problem is that assigning them to the VSTI instrument is tedious to do and one configuration will not necessarily apply to another VSTI. Also MIDI only works on a set number of channels, limiting the number of synth/instrument parameters you can assign at any one time. A VSTI of a giant Moog modular synthesizer has over a hundred knobs and dials, you couldn’t control them all with this method, limiting the potential sounds.

MY SOLUTION

Simply, a large touch-screen panel, complete with a touch screen 4 octave keyboard that hosts VSTIs. Using this method the difference between a VSTI and it’s hardware counterpart becomes negligible as the user has full, real time control over the parameters. The screen will be fairly large (1 metre square?), enabling the user to run several VSTIs at one time as well as allowing the user improved freedom of movement. It will use a menu system that will enable the musician to choose from a variety of instruments in different categories i.e. drums, synths etc. The user will also be able to tweak other areas such as effects and volume output. The best illustration of this is a video that I noted others also posted, it shows someone changing the delay effect on a synth 2m18s in.

I also found an example of a touch screen MIDI interface at

MonoTouch

The prototype would be aimed at performance musicians wishing to travel light and bring some dynamism to their live shows.

The “Reactable” that Garrett posted is another example of the kind of thing I’m aiming for.

Liam Dermott