Jan 022012

Originally published (& cross translated?) Oct 2011 in Wired Magazine ‘Change Accelerators‘ by Gary Hayes 5 of 5

Image by Gary Hayes

“Anyone up to battle aliens at the local museum tonight?”

It might sound like a farfetched idea at the moment, but this question may soon be another option rather than the old invitation to go see the latest 3D blockbuster at the Cineplex. The previous four posts talked about major experiential paradigm shifts, where more and more people desire to be ‘inside their entertainment’ —literally. The need to watch a show or read a good book in isolation will never go away, but right now, a new form of immersive entertainment is taking hold that sees users hyper active online and more and more participatory outside of their homes in unique, social story locative experiences. These shifts leads us to confront some basic questions, like, “What is an experience?” and “Are some experiences more engaging than others?” as well as some not-so-basic ones, the all-important, “Who will create all these new experiences?”

Designing any new media format is challenging, especially when the goal is to create highly engaging pervasive entertainment, that is more compelling than what already exists. Since the grammar has not yet been invented, for many, it presents a quantum creative leap. Right now, there is still conflicting opinion about what to call these new types of distributed stories—and let’s not mention the transmedia wars!

One of the greatest challenges for professional storytellers, who are accustomed to traditional linear plots, is to transition into a new platform. Rather than writing straight lines to be delivered from a stationary stage or studio, they are now being pushed to create content for a shifting stage or multiple shifting stages at once— often in different cities or time zones. Given the growing appetite for this type of connected, collaborative, dynamic content, the well-established line between audience and producer is becoming increasingly blurred. Right now it remains to be seen if conventional storytellers will adapt to these new demands, or if they will be outpaced by users themselves. User who are as voracious (and in some cases as adept) in creating content as they are in their insatiable consumption of it.

I was trawling the web the other week looking for a good description of levels of experience and how to design for them. What I discovered, however, is that, much like the missing lexicon, there isn’t a lot of science to this yet either. To fill the gap for now, I created a diagram to explore increasing levels of experience or engagement: It begins at the first level of physicality as the least complex and builds its way up through mental engagement, then social inclusion, and finally the emotional and spiritual levels. These last two being the hardest ones to deliver. Narrative games, like L.A. Noire and the earlier Heavy Rain and Indigo Prophesy, are brave examples of games trying to develop emotional, interactive responses (albeit skipping most of the real social & physical elements).

For audiences in the developed world, 3D and 4/5D cinema is gradually moving into the home and has the potential to make box office visits unnecessary – not worth the added effort. Audiences are starting to expect more value and more payoff for their play time (and trouble): For many, a trip out of the house to be entertained is a transmedia experience in itself. This forces new entertainment providers to seriously take these “audience journeys” into consideration. Likewise, since marketers have begun to tell more interesting stories across places and platforms, traditional writers need to get up to speed on these changes as well. Take for example, a recent holographic product display for Lego. These types of interactive promotional events work to increase the expectations across the board for what is possible in terms of entertainment.

However, film is also slowly catching up. The internationally renowned artists’ group, Blast Theory created a locative cinema project called A Machine to See With, which is a good early evolutionary example. Less about sensory immersion and more about a healthy combination of imagination and locative storytelling, the project allowed viewers to “live” inside a cinematic story unfolding on the streets of Brighton, England. According to the San Jose Biennale last year, the experience mixed documentary material, stolen thriller clichés, and the films of Jean-Luc Godard to let participants walk through the city and receive phone calls, stepping into bit parts or leading roles.

These steps are evidence that now would be a good time for these types of indie projects to start receiving the big-budget attention that clunkers like Phone Booth did. Entertainment is truly moving toward a variation of the infamous Star Trek Holodeck, a complete surround experience that fools our brains into thinking “this is really happening” or “we are really there.” Experiences can either be delivered through layered digital storyworlds, or peppered your everyday life through fragments and bits so that your real world starts to become the storyworld.

Parallel to this transmedia trend, there are complete virtual screen environments of game driven and socially focused spaces known as MMOGs (massively multiplayer online games). These alternate “worlds” are host millions of peoples ‘minds’, melded into the characters they are playing. Many approach a game with the same gravity as a method actor taking on a new role, wholly losing themselves in an alternate reality. The way people interact with these virtual selves is also rapidly changing – making new interface technologies like the Xbox Kinect and iPad/tablets some of the fastest-selling items in history.

These new forms of entertainment will require creators to become writers of place and time, creating relevant and game-like personal experiences. Let’s imagine a simple future? You are at home watching a story experience teaser on your surround 3D head mounted display. You decide to rent it with some friends and project it on your wall-size, AR home cinema screen. It sets up the challenges; you all become the heroes. You all don in-earphones and sporty AR glasses, which have tiny cameras connected to a 6G network that point out and down, tracking the external world, as well as body movements and speech.

You undergo a physical and mental training exercise in your home to prepare for the outdoor challenges. You walk outside and start to explore your city. The open park becomes a fully rendered fantasy environment; urban streets and buildings are layered with story and critical game information. You have X-ray vision; you can see inside coffee shops and stores. Past and future scenes play out before your eyes. You talk to digitally rendered, artificially intelligent characters who respond to specific questions. You work as a team and add your own story challenges. An iBrain scan afterwards let you record your experience for others in 3D.

Welcome to your personal experiential entertainment Holodeck. Of course, you can turn it off at any time and read a good book or watch a film. But that’s so 2011.

Aug 282009

Was going to call this Augmented Reality Story Environments but…:)

It is fascinating to see how quickly Augmented Reality (AR) is permeating our lives and the blogosphere. But what will the mass adoption of mobile devices that allow you to layer ‘virtual story worlds’ over the real world mean for new forms of entertainment & marketing? Also what will it mean when celebrities and audience/users, begin to merge – avatars appearing in broadcast TV and film/gamestars composited into our homes?


I have posted about the cross-reality evolution over the last 3 years on this blog under a general mixed-reality umbrella. Now we have every blogger & journalist talking about their AR engaged iPhone, DSi, PSP or smart mobile as if they have discovered some advanced alien technology. But is it really is a game changer, a new playground for storytellers? A window to another world at one end through to a simple layered utility at the other. Actors and fantasy characters deliver lines, embedded in real world scenes, you find the hidden virtual treasure, the historical or future backstories and clues, video, sound, images – even fellow ‘players’ morph into strange aliens or dissapear, you leave red herrings or leave help for other players the possiblities, endless.

Continue reading »

Jul 302009

Running the Australian Laboratory for Advanced Media production I often have to provide a broad contextual background (as well as detailed insights!) to many of our seminars and labs. Over the past few months I have presented across a range of topics suggested in the blog title and lucky for some these have been captured in video form! So the player below contains (for now) seven separate presentations, a mix of free informal evening ones through to more formal full day workshop intros. The video production value is variable so I add the audio only versions at the bottom too and there are links to the other many great speakers at each session, detailed below the video box. These are unedited and contain the usual umms, arrs, errors, coughs & pregnant pauses, oh and I hope some great content. All are 16by9 apart from the serious games in 4by3, Enjoy

  1. SOCIALIZED TV 2.0 – 17m © Gary Hayes Director LAMP @ AFTRS and CCO of MUVEDesign (slideshares here)
  2. GAMES: SERIOUSLY – 35m © Gary Hayes (slideshares here)
  3. VIRTUAL STORY: THE ART AND CRAFT OF MACHINIMA – 42m © Gary Hayes (slideshares here)
  4. (Seminar Intro) THE RISE AND RISE OF SOCIAL MEDIA – 13m (slideshares here) © Gary Hayes
  5. FREE AND EASY (seminar intro) – 10m © Gary Hayes
  6. IPTV FUTURES – 20m © William Cooper Head of Informitv (live Skype video interview with Gary Hayes)
  7. MULTIPLATFORM INNOVATIONS – 22m © Giancarlo A. Mori Senior Vice President, ANIMALLOGIC Interactive. (live Skype video intro interview with Gary Hayes)

Continue reading »

Game Generator

 Posted by on July 22, 2009 at 12:57 pm  Add comments

Install Shockwave PlugIn First from here. Game Generator v 0.1a 07/09 – In progress

“For teachers and students to come up with the seeds of a new game”!


Click ( or press the corresponding letter) on each of the lines to generate a cool combination of your ‘new game’ attributes. ONLY click once and use your game design prowess to work within the first click contraints!

Suggest that Genre, Players and Type are the main three – the other two are there for ‘detailing’

  • GENRE – Is the game’s thematic world
  • STYLE – The major activity undertaken as a user
  • PLAYERS – How many, and with or against whom
  • OBJECTIVE – The purpose of the game
  • TYPE – The game format or platform
  • Devised by Gary Hayes
  • Programmed by Gary Hayes