Deciphering Space in Virtual Reality

Space, and its perception, is fundamental to navigation through the world. Whether through sight, sound or touch we build mental images of how we relate to the world around us. So, to better understand the possibilities and pitfalls of design for virtual reality interfaces a thorough understanding of spatial cognition is advised. The following article is a literature review, many sources have been copied as is so beware of plagiarism if you use these words. Plus why rephrase something that is already very clear?

William Gibson Visions of future worlds

In Neuromancer, Gibson envisioned highly complex structures like a digital hallucination, overwhelming and alienating. Gibson coined certain phrases that describe certain interactions with game systems, how a space is ‘consensually hallucinated’ in a ‘non-space of the mind’.  Given user centered developments in HCI and transparent natural user interfaces (NUI), graphic representations now would conceal this Gibson’s complexity and to visualise the underling systems no standard geometry and dimensional space could accurately grasp this vision. Why would we want to see everything? As  Aarseth (2007) describes in Allegories of Space, Gibson’s vision is highly perceptive, bleak and ironic but this irony is missed by many futurists that it inspired. Additionally in this essay, Aarseth laid out how structurally different, games are as a new medium. In this capacity they must engage a player through new structures of interaction, by breaking with familiar forms of representation. But to what end does this enhance experience, and on a subtler point what should be the goal of these new mediums? How can they address shortcomings in previous experiences, and the consequences of their success; such as addiction and excessive emphasis on violent interactions.  Aarseth goes on to define spatiality in games: 

"The defining element in computer games is spatiality. Computer games are essentially concerned with spatial representation and negotiation, and therefore the classification of a computer game can be based on how it represents or, perhaps, implements space. More than time (which in most games can be stopped), more than actions, events and goals (which are tediously similar from game to game) and unquestionably more than characterization (which is usually nonexistent), games celebrate and explore spatial representation as a central motif and raison d’être. In terms of playability, themes, tasks, subgenres and dramatic structure, nothing much has changed over the last two decades. The innovation takes place in spatial representation, and the genre’s more slowly evolving complexity in the other areas (such as physical simulation) can be seen as a result of the increasing complexity of the spatial representation." 

– Aarseth, E. (2007). Allegories of space.   Space Time Play , 44-47.

Together this proposes how games can be used as mediums of experience in themselves, what knowledge can they convey? This then poses the question of how we define space, beyond a physical abstraction of geometry. What makes a social space? How do we generate regions of space for different purposes. How do computer mediated spaces differ?

“Rilke wrote: ‘These trees are magnificent, but even more magnificent is the sublime and moving space between them, as though with their growth it too increased.”

– Bachelard,   Poetics of Space,   Beaccon, 1958, p. 201

In the Poetics of Space Bachelard is, in part, inviting designers to re-consider how users’ experience by encouraging reference to formative, intimate spaces rather than formal abstractions. The quotation of a quotation above is useful as it prompts us to consider game spaces on two fronts – poetically (‘the sublime’: what does this space invoke? ), and kinetically (‘moving space’: reminding us that, above all, we are concerned with dynamics and locomotion ). Both these aspects are useful, as they allow us to consider and assess qualities of virtual-spaces that side-step ‘newer must be better perspectives’.

Ecological Perspective

[space is] neither a mere ‘frame’, after the fashion of the frame of a painting, nor a form or container of a virtually neutral kind, designed simply to receive whatever is poured into it. Space is a social morphology: it is to lived experience what form itself is to the living organism, and just as intimately bound up with function and structure. 

– Lefebvre, The Production of Space

This poetic quote summarises the nature of human relationship to space, a view that was built upon by James J. Gibson. James Gibson’s theory of direct perception states that the environment contains all of the information needed to specify its properties. Hence,perceiving these properties is a matter of detecting the information available in the environment.  This concept is significant precisely because it allows James Gibson to locate the moving, perceiving body at the heart of meaningful perceptual experience; an experience which emerges in the dynamical structures that cross the body and the world.  His theory of environmental affordances shows that perception is more than a means of passively representing the intrinsic physical organization of objects. Perception is inherently active and exploratory, we seek out alterations in the vast flow of information enveloping it. These alterations are detected when the perceiver moves through the environment and probes it with a pair of glancing eyes.  Locomotion opens up new possibilities for the pick-up of information specific to the perceiver’s environment. This information can then be used to guide subsequent movements, as in a perception-action loop (the two being inseparable). As David Morris puts it, “we do not … perceive naked properties of the environment, rather we perceive what the environment affords to our bodies, what we can do with, or in the environment.” The theory of affordances demonstrates that the structures of information are intrinsically meaningful for perceptually-guided action.  Affordances are not subjective valuations superimposed on sensations (as theories of perception typically presuppose). Rather, the affordances of the environment are directly perceived as structural information in the environment. 

– Braun, The Structures of Perception: An ecological perspective, 2008

Of all the terms we use to describe the world we inhabit, [space] is the most abstract, the most empty, the most detached from the realities of life and experience. Biologists say that living organisms inhabit environments   not space, and whatever else they may be, human beings are certainly organisms.

– Tim Ingold, Against Space: Place, Knowledge, Movement

Acoustic Spaces

“perception must be understood as a relationship between environmentally available information and the capacities,sensitivities, and interests of a perceiver.” 

– Eric Clarke, Ways of Listening: An Ecological Approach to the Perception of Musical Meaning

To use ecological perception theory to determine musical meaning, Clarke identifies properties of musical sounds that “afford” certain meanings. Affordance is a term coined by Gibson to describe the purposes or uses of various objects as communicated by stimulus. As an example, a chair affords sitting,taming lions, and knocking down bad guys. Clarke uses this concept to show how listeners can glean meaning from a musical performance. Note that he either stipulates a specific listener and a specific performance, or gives ranges of possible meanings dependent upon the context of the performance and the listener.

Interesting Links not discussed in detail:

Leap Motion Blog post about VR OS

Harrison and Dourish’s Work on Collabritive spaces

One thought on “Deciphering Space in Virtual Reality

  1. Smartphones have changed the way we live our lives, and that includes
    traveling. Here’s why my phone is my travel companion. I’m also
    including with a few tips and tricks that might be useful on your next trip.

    Interactive multimedia


Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s