Currently people are immersing themselves in the digital virtual world. We gradually forget what a bird’s twitter sounds like when we put in our earphones; we dismiss the seasonal changes of the nature when we are busy texting replies to others’ messages. The digital technology alienates humans and the real environment damaging the connection between them. Filter moment intends to overturn the role of the mobile phone, by creating a new aesthetically potent AR environment to expand people’s sensory experience and form a new relationship between people, virtual contents and environments.
Based on the research, most existed AR works focus on displaying and interacting with virtual things ignoring the relationship between virtual and real background, we haven’t see any examples of AR which actually augments and expands your sensory experience of a specific physical space.To achieve this goal, perception is the interface. Our first contact with the surrounding environment, which is built on the recognition, organisation and understanding of the sensations coming from the environmental stimuli.Â So we are trying to provide a multimodal AR experience (sound and visual)Â using the materials from the local site.Like the diagram shows, we strength people and virtual objects’ relationship with the environment which forms a complex system.
We start with a real physical site which is near here east.Then we record the sounds and take pictures of the textures ,since the physical space is made of these visual textures, where, you know, inserting these visual sounds, and to go with them could show how site specific and location is situated. After extracting specific textures from specific sites, we attempt to understand and explore the story behind each texture and combine it with sound. For example, the vision and sound of natural leaves have flake, overlapping and small features. In terms of the time dimension, it reflects what is happening now such as when there is a gust of breeze, they have different visual and auditory experiences.From augmenting to disappearing, our present feeling is augmented and altered.The sound is dealt with the similar way.
Besides, because when people stand in different positions in the site, the sound source come from different directions we deal with 3d spatial sound to add the sense of immersive. Therefore, we combine the characteristics of time and space to make audio-visual effects.In this spatiotemporal processing process, each kind of sensory is in repeatedly assist confirm each other achievement.
Filter Moment goes far beyond the traditional ar’s function: conveying the designer’s message and emotion to the audience strengthen the connection with reality. Our project allows the audience to manipulate the received information through controlling their mobile phones’ camera distance so that they could choose to enjoy their own experience. In further, we are planning to add more collaborative work between different users in this project.