Fusion is a collaboration with Tuomas Tuomiranta, who coded the animation with Processing. The data was used to create the sounds by me with Max. The data from Processing was transferred to Max in real time by OSC. I did several renditions of the data, and composed the final sound design from the renders, so that it would flow well with the dynamic of the animation.
The foundation of the sound track are the actual colors and their frequencies, which appear in the music as if the colors would have been directly translated into sound. The changing properties of the animation elements also were used to shape the sounds.
Not long after we started the collaboration, there became an opportunity to exhibit the piece. Fusion premiered at Flash Vallisaari on the 21st of September 2018.
The visuals were transformed into sounds, and these were then used as the basis for the final composition and the sound design. The main actor Pasquale se Fabbio dictated a poem, and his voice was turned into notation for the main melody line.
Seppo Renvall is a pioneer in Finnish experimental film. He works mainly with film and video, but hid artistic output also includes photography, installations and happenings. His films are characterised by an abstract imagery in black and white and a non-narrative structure that often focuses on the apparently commonplace and everyday.
I must consider myself lucky and grateful to have worked with him on NAPOLI film, which premiered on the 11th of May in 2017.
In the downtown of Helsinki there is a place called Lasipalatsin audio (Glass Palace Square). The place is going to be renovated, and the square too. In the middle of the square there is a tree, which will be cut. A group of artists decided to create a group of works for the tree. I was also asked to participate.
I decided to take photos of the tree, which I would then use as the source for a sound process. In the process the photo is scanned from left to right. The white portion provides date for a group of oscillators, waveforms and filters. The final piece is a result of one of the passes.
The piece called D-A-T/D-A was presented in a group exhibition “ NOT IMPRESSIVE NOT BELIEVABLE ”.
The artists collectively known as KNPSST are Mira Kautto, Alisa Närvänen, Elina Peltonen, Marko Suovula, Janne Särkelä and Pekka Tynkkynen whose backgrounds are in art, clothing design, technology, music, architecture and contemporary dance. The group came together in the summer 2015 at Kone Foundation’s Saari Residence, where their first collaborative project called d-a-t/d-a started.
d-a-t/d-a is a document of an interdisciplinary project rooted in wearable sensor technology. It is a kinetic data installation, which registers physical gestures and movements and translates them into sound and light.
The work gives aural and visual forms to the cycles related to being a human. The pain during the menstruation (dysmenorrhea or painful periods) is intimately highlighted with the help of sound. The interaction between the Earth, Moon and the Sun is experienced by a sonification of their orbital data and their effects on gravity – which pervades the experience of being a habitant of the Earth.
The work was presented as a part of a group exhibition with the theme Cycles, in the framework of AAVE festival of audiovisual arts, in Helsinki.
The work consists of four led strips and four channel audio system. The Sun and the Moon rotate around the visitor. Also, a possibility to participate in the installation is provided by means of a heart rate sensor.
In the installation the orbits of the Sun and the Moon around the Earth have been translated into sound. The cycle of sounds lasts about 50 minutes, which corresponds to about two years. The period was chosen, because the Sun and the Moon happen to be quite close to the same position in the beginning and in the end of the cycle.
Sounds of pain are played at random intervals between 1 – 2 minutes. The Led lights pulses and fades with the same interval.
The audible frequency of the Sun in the installation is a higher octave of its about 11 year long activity cycle. The frequency of the Moon comes from the so called Saros cycle, during which the Moon goes through various cycles related to its orbit. Saros cycle lasts about 18 years in real time. The sound of the Sun in the installation is low and continous, whereas the sound of the moon is higher and pulsating. The length of one pulse is a thousandth of a month. The relationship of the amplitudes of the sounds of the Moon and the Sun corresponds to their tidal force amplitude.
It is possible to participate in the installation. In the middle of the room there’s a pole, on which a green light can be seen. The light shows the place of a pulse sensor. Just beside the sensor there’s a red Led light, which shows the sensed pulses.
The sensor finds the pulse from a finger or a palm, when the body part rests on the sensor. The pressure on the sensor shouldn’t be too hard or too light for it to work consistently. The red led will start to pulse according to your heart rate, when the contact is right.
When six sequential pulses have been detected, a real heart beat sound is played.
The artists wanted there to be two paths, which in practice meant two sequences of dozens of images side by side on the screen. The images are animated gifs, and the player advances on the path by pressing keyboard buttons.
The images are accompanied by a sound track, realized by selected sound artists. The sounds loop independently from the images, and the player is able to stop or play a sound. The sound selection also advances sequentially, and maximum of two sounds can be heard at the same time.
The main challenge is to see all of the animations and reach the end. The player is also able to create a combination of images and sounds, and thus become a creator in the process.
The rings of Saturn look like a spectrogram, so it occurred to me try how it would sound like. In essence, this a sonification of space!
Sound was created by using an authentic image of rings of Saturn as a spectral source to a series of filters. A 1 pixel slice of the image of the rings was extracted
The ring spectrogram was divided into three color planes, and the color intensity values were transformed into resonant filter cutoff frequencies. In essence one filter unit (per color plane) has 256 sounds playing simultaneously. The individual filters are placed along the x-axis so, that the stereo image consists of 256 steps from left to right. The last two sounds were created with 1024 voices and 3×340 voices.
The spectrum was compressed to a couple of ranges. In some sounds a small variation in certain divider factor per color plane is introduced for a slight chorus like effect. The original lossless sound bits are available on Freesound.
The interactive sound waves builder was presented at the Helsinki Hacklab stand at WÄRK:fest, a DIY/Hacker/Culture -festival. The system consists of a small table, webcam and Max/MSP/Jitter process. Visitors were able to manipulate the sound waves by (re)arranging colorful objects on the table.
The table was simultaneously scanned in two dimensions, and the extracted data was used to create the sound waves, pitches and amplitudes for the oscillators. Besides the musical piece the rearrangement of the colorful objects created a transforming visual piece.
The three pieces of Sounds of Calligraphy playlist are the continuation from the Sarana performance at the opening of Viiva & Viiru calligraphy group exhibition in Helsinki, Finland. The pieces are based on a real time process that analyzes the images in three color channels, and some of the oscillator sound waves are derived from the image properties too. The process has 128 oscillators and filters per channel, and they are positioned to the stereo panorama to exactly follow the figures. The resulting music is thus a true voyage across the image.
The sonification process was realized with Max/MSP/Jitter. A very warm thanks to the Viiva & Viiru group for their openness to the abstract.
A mechatronic art decoration for Aortta Party by Hytky. Max/MSP listened for a beat and triggered Arduino, which in turn controlled an electric motor. The motor had a rod attached to it, and a cardboard heart was taped to the tip of the rod. The position of the rod was monitored with a hall sensor. Heart struck against a thin veil, which was illuminated with red light from behind.