Corebounce, in collaboration with Heinrich Lüber and Art Clay, 2006

“Almost Lost” was a performative audio-visual installation of Corebounce in collaboration with artists Art Clay and Heinrich Lüber: Streams of spoken words are deformed by interactive technology.

In der Performance spreche ich über zwei Stunden endlose Wortketten und projiziere diese gewissermassen von Innen an eine meinen Kopf umgebende Sphère. Die sich selbst dekonstruierende Sprache wird durch eine interaktive Technologie umgeformt und in Lichtform auf die Sphère und den Umgebungsraum zurückgeworfen. Die Projektionen zeigt eine Virtualität im Sinne einer “plastischen” Verformung in Möglichkeitsräume hinein. Das die Figur umgebende Halbrund bildet eine Andeutung einer zweiten Schicht dieses dynamischen Raumsystems, die begehbar ist und worin der Zuschauer sich als formender/aktiver Mitspieler in diesem System erleben kann. (Heinrich Lüber)

During the two hours of performance, I speak ceaseless streams of words and virtually project them from the inside onto the sphere surrounding my head. The self-deconstructing language is deformed by interactive technology and reflected in terms of lights and shapes onto the sphere and the ambiance. The projections show a virtuality in terms of “malleable” deformations into alternative spaces. The semicircle surrounding the character constitutes an adumbration of a secondary layer of that dynamic space. It is accessible to the spectator, who can experience herself / himself as a forming and active participant in this space system. (Heinrich Lüber)

The project was officially supported by Kultur Basel-Stadt and Kulturelles Basel-Land. Heinrich Lüber’s Homepage: https://www.heinrichlueber.ch/

https://youtu.be/frTtp-L80p8

Event: Digital Art Weeks 2006
Location: ETH Zurich, Switzerland
Date: Jul 12 2006
Concept: Art Clay and Stefan Arisona
Programming: Stefan Arisona
Performance: Heinrich Lüber and Corebounce Art Collective

I recently (2012) stepped across this submission again, and was surprised and also feeling a bit depressed that we never fully realised this piece at that time - this was before facebook & co took off, see “the next hype” box in the picture below. Anyway, the concept is still here, and I believe the assertion is still valid.

We all pursue a multitude of lives in the electronic realm. A schizophrenia, that splinters out identity across communities, blogs, and portals. In every on-line community we cultivate our alter ego with a biography, network, reputation and fame. The writer Joseph Campbell once said we were all potential heroes. Now, with the help of a webcam or blog, we are all potential celebrities. When he got tired of his original quote, Andy Warhol gave with his adapted variant of the “15 minutes of fame” hope to the insignificant, but was at the same time laughing at the famous. But how does this relate to the on-line world? How do we compare to other on-liners? Is there a reward for all the time and enthusiasm we sacrifice to screen and keyboard? Is our on-line existence sufficiently important to be a celebrity? Will we be famous to only fifteen people, as Warhol’s original quote has been adapted once more in the context of emerging on-line phenomena?

Find it out with “In 15 minutes everybody will be famous.” Attracted by curiosity and self(over)estimation on-liners are drawn to our system. They are asked to present as many artefacts (mobile phone, credit cards, usernames, passwords, etc.) as possible to the system. The system will automatically discover their online trails with the information drawn from the artefacts. A variant of Google’s page rank algorithm (our people rank algorithm) calculates individual on-line celebrity values based on social networks and on-line behaviour. The result is a single value that sums up ones entire on-line existence. There are obvious ways to improve an on-line existence. Come back - with the right network everybody can be famous in 15 minutes.

Conceived: July 2006, submitted to Prix Ars in March 2007
Concept and implementation: Corebounce Art Collective

Project Details (Excerpt from the Submission)

Objectives

The forefront goal of this project is to sum up your online existence in one single numeric value and thus render your existence comparable to others. But how much information are you willing to hand out for this single number? Loosing privacy for fame is a creeping process in real life – here it is rendered explicit. What are you ready to reveal? Your e-mail address? Your MySpace credentials? Your contacts on your mobile phone? Your credit card? The more you offer the more likely the system gets the big picture across communities and metaverses. And what about elevating your celebrity value by faking an online presence? What about stealing credentials? Without being asked directly, the user is forced to think about these questions on his way to fame and reflect on his motivations. In the process one will not only learn how much or little one matters in the electronic universe but also possibly rediscover long forgotten traces left throughout electronic systems.

Language and context

The interaction is realized with simple, universally understood iconic dialogs and thus language independent. There are no inherent geographical or cultural restrictions whatsoever. However, due to the selection of supported online communities the implementation is currently biased towards the western hemisphere.

Project History

This project roots in various scientific, technical and artistic ancestors. It borrows the human cognition inspired approach to information discovery form the thesis “Automatic Software Configuration” (https://diuf.unifr.ch/pai/publications/2002/paper/Schubiger-PhD02.pdf). Ubiquitous access to mobile phone data is realized with a variant of SICAP’s POS module (https://www.sicap.com/). Close contacts to the masterminds of cocomment (https://www.cocomment.com/) help understanding the technical and social challenges in today’s on-line communities. Corebounce’s long track of public appearances and expertise in interactive installations heavily influenced the interaction design. Especially the experience gained through RipMyDisk motivated the implementation of this project.

People

The driving people behind this project are the founding members of Corebounce Association, which were also deeply involved in the forerunners: Pascal Müller, Stefan Arisona, Simon Schubiger-Banz, and Matthias Specht. The original concept, as well as the software development was carried out by them. The project is intended to be instantiated either as an installation or as an online platform. The forerunner RipMyDisk was open to the public during Interactive Futures 2006. The software is entirely based on Soundium / Decklight which is partially open source.

Lessons learned

From a technical perspective, RipMyDisk demonstrated the feasibility but also the limits of access to physical artefacts linked to the online world. While we continuously improve on artefact support, we also integrated additional input devices such as card readers and a keyboard. Whereas RipMyDisk was a specialized system tailored for a specific event, the new system is greatly modular to accommodate a wide range of community software and web interfaces to have a maximum reach into the online world. From a social viewpoint two remarkable observations were made: First, technical limitations were circumvented by ad-hoc social networks that emerged around “gateway” artefacts. We call a “gateway artefact” a device that can be used to feed information into the system without being itself a representation of real life identity. Second, privacy is at least in an installation setting of little or no concern. The urge to participate, here enforced by the urge to become famous temporally blinds the user in respect to privacy and security.

Technical Information

The Soundium research platform served as the technological basis for the realization of the project. As indicated earlier Soundium has roots in various computer science research domains ranging from software engineering, human-computer interaction techniques to real-time multimedia processing and computer graphics. The development of platform was initiated by Corebounce in 1999 and has since then been supported by various Swiss universities and companies. One of the principal design goals of Soundium was to provide a highly modular software architecture for the rapid realisation of scientific experiments as well as artistic ideas. Besides of this project and its basis, RipMyDisk, Soundium has been intensely been applied for live visuals and VJ performances, as well as interactive media art installations (for example the Digital Marionette, currently exhibited at the Ars Electronica Center). Soundium runs on Linux and is freely available.

Selected References (Related to the Soundium Platform)

P. Müller, S. Arisona, K. A. Huff and B. Lintermann. 2007. Digital Art Techniques. ACM SIGGRAPH 2007, San Diego, CA, USA. To appear in: Course Notes of the ACM SIGGRAPH 2007, ACM Press.

P. Müller, S. Arisona, S. Schubiger and M. Specht. 2007. Interactive Editing of Live Visuals. To appear in: J. Braz, A. Ranchordas, H. Araújo and J. Jorge (eds). Computer Graphics and Computer Vision: Theory and Applications I, Springer Verlag.

P. Müller, S. Arisona, S. Schubiger, and M. Specht (Corebounce Art Collective). 2006. Digital Marionette. In: Simplicity - The Art of Complexity. Ars Electronica 2006: 348 - 349.

S. Arisona, S. Schubiger, and M. Specht. 2006. A Real-Time Multimedia Composition Layer. Proceedings of AMCMM, Workshop on Audio and Music Computing for Multimedia. ACM Multimedia 2006, Santa Barbara, October 23-27.

S. Schubiger and S. Arisona. 2003. Soundium2: An Interactive Multimedia Playground. In: Proceedings of the 2003 International Computer Music Conference, ICMA, San Francisco.

Solutions

The system draws it vigour from three key elements:

• Ubiquitous access to personal artefacts. Through various interfaces to the physical world (card reader, infrared port, Bluetooth, keyboard) artefacts can be transferred to the system in an ubiquitous way.
• Modular integration of existing and emerging community services. A unique automatic site crawling technique enables the integration of arbitrary on-line communities, portals, blogs, newsgroups, etc. in a modular way. The crawler isolates individuals, relates them, and extracts their social networks.
• Social ranking is largely based on Google’s page rank algorithm that is adapted in our system to rank people. Page rank basically measures the importance of a page by the links pointing to that page and the rank of the origins of these links. “People rank” is measured by the number of people that refer to an individual in combination with the rank of the referrers. Additionally, on-line activity over time is integrated into the people rank to take into consideration the volatile character of fame.

Implementation

The research instance of the project is currently running at ETH Zurich’s Computer Systems Institute. This is where the software further evolves. Several partners are using parts of the code for rapid-prototyping of their own research projects. Corebounce will be showing artistic applications of the software at this year’s TweakFest (Zurich, https://www.tweakfest.ch) and Digital Art Weeks (Zurich, https://www.digitalartweeks.ethz.ch).

Users

The project addresses everyone with an Internet identity, and/or those that are actively involved in social or technological aspects of digital communities.

License

Some parts of the software are already open-source, or will be released as open-source within a short timeframe. Some parts are currently closed-source, but available for free. Current licensees are mainly research institutions involved in computer systems, network technology, as well as multimedia and digital art.

Statement of Reasons

The main contribution of our project is the novel way to look at communities and to explore the interconnections between our physical identity and our various net identities. The project reveals many important social and technical issues. In particular, it highlights the widening gap between the need for privacy versus the desire for publicity. With its scientific orientation, it serves as a solid foundation for future projects in the domain. It is our goal to contribute to social, sociological, and technical research related to digital communities, as well as to artistically oriented projects.

PhD Thesis - Stefan Arisona, 2004

The process of music performance has been the same for many centuries: a work was perceived by the listening audience at the same time it was performed by one or a group of performers. The performance was not only characterised by its audible result, but also by the environment and the physical presence of the performing artists and the audience. Further, a performance was always unique in the sense that it could not be repeated in exactly the same way. The evolution of music recording technology imposed a major change to this situation and to music listening practise in general: a recorded performance suddenly became available to a dramatically increased number of listeners, and one could listen to the same performance as many times as desired. However, in a recorded music performance, the environmental characteristics and the presence of the performing artists and the audience are lost. This particularly includes the loss of musical gestures, which are an integral part of a music performance. The availability of electronic music instruments even enforces this loss of musical gestures because the previously strict connection between performer, instrument, and listener is blurred.

This thesis deals with the problem of the construction of musical gestures from a given music performance. A mathematical model where musical gestures are represented as high-dimensional parametric gesture curves is introduced. By providing a number of mathematical operations, the model provides mechanisms for the manipulation of those curves, and for the construction of complex gesture curves out of simple ones. The model is embedded into the existing performance model of mathematical music theory where a musical performance is defined as a transformation from a symbolic score space to a physical performance space.

While gestures in the symbolic domain represent abstract movements, gesture curves in the physical domain reflect “real” movements of a virtual performer, which can be rendered to a computer screen. For the correctness of the movements one has to take into account a number of constraints imposed by the performer’s body, the instrument’s geometry, and the laws of physics. In order to satisfy these constraints a shaping mechanism based on Sturm’s theorem for cubic splines is presented.

A realised software module called the PerformanceRubette provides a framework for the construction and manipulation of gesture curves for piano performance. It takes a music performance and given constraints based on a virtual hand model as input. The resulting output consists of sampled physical gesture curves describing the movements of the virtual performer’s finger tips. The software module has been used to create animated sequences of a virtual hand performing on a keyboard, for the animation of abstract objects in audio-visual performance applications, and for gesture-based sound synthesis.

Keywords: Gestural Performance, Performance Interfaces, Performance Theory, Computer Animation.

PhD Thesis: Multimedia Laboratory, University of Zurich, 2001 - 2004
PhD Candidate: Stefan Arisona
PhD Advisors: Prof. Dr. Peter Stucki and Prof. Dr. Guerino Mazzola

Corebounce Art Collective, 2006

The project “Rip my Disk”, presented at Interactive Futures 2006, brought mobile art to the dancefloor. It compromised privacy by displaying personal content to the big screen.

In an augmented VJ performance, visitors entered into a dare by letting the Corebounce team “rip” multimedia contents off their personal mobile phones with the Soundium program to get exposed (“virtually naked”) on the dance floor. Others, not so akin to risk taking, simply enjoyed to employ their mobile phones for interactive painting as well as sending media sources such as live video and image material. The sent media were used as personal artifacts, and were continuously adapted and integrated into the live visuals performance. The result was the personal enhancement of the space around the media owner’s location. The project also demonstrated how mobile communication technologies can easily be made accessible to artists or performers.

https://www.youtube.com/watch?v=Ut3D5Z4PoWg

Performance & Installation: Interactive Futures 06
Location: Open Space, Victoria, BC, Canada
Date: Jan 27 2006

Installation: Digital Art Weeks 07
Location: ETH Zurich, Switzerland
Date: Jul 10 - 14 2007

Concept, programming and realisation: Corebounce Art Collective

Corebounce, in collaboration with Art Clay and Anne Faulborn, 2005

This radical, eye-and earblasting performance was realised in collaboration with Art Clay (Composition) and Anne Faulborn (Cembalo). Art Clay’s composition “A River and Five Bridges” is an electronic adaptation of André Bretons “Barrières” and asserts the affinity of rational and irrational.

The visual composition’s interpretation, realised by Corebounce, absorbs the assertion by implementing a modulated flickering screen. The modulation function is both defined by real-time music analysis and live visual performance. The flicker colors were obtained by two cutouts from Paul Klee’s “The Twittering Machine”, one in blue tones and one in red tones.

The piece premiered at ETH Zurich’s main building dome during Digital Art Weeks 2005.

https://youtu.be/Ij5gvJpYfVY

Event: Digital Art Weeks 2005
Location: ETH Zurich, Switzerland
Date: Aug 20 2005
Concept: Stefan Arisona and Art Clay
Composition: Art Clay
Programming: Stefan Arisona
Performance: Anne Faulborn, Stefan Arisona, Art Clay