Jan 022012

Originally published (& cross translated?) Oct 2011 in Wired Magazine ‘Change Accelerators‘ by Gary Hayes 5 of 5

Image by Gary Hayes

“Anyone up to battle aliens at the local museum tonight?”

It might sound like a farfetched idea at the moment, but this question may soon be another option rather than the old invitation to go see the latest 3D blockbuster at the Cineplex. The previous four posts talked about major experiential paradigm shifts, where more and more people desire to be ‘inside their entertainment’ —literally. The need to watch a show or read a good book in isolation will never go away, but right now, a new form of immersive entertainment is taking hold that sees users hyper active online and more and more participatory outside of their homes in unique, social story locative experiences. These shifts leads us to confront some basic questions, like, “What is an experience?” and “Are some experiences more engaging than others?” as well as some not-so-basic ones, the all-important, “Who will create all these new experiences?”

Designing any new media format is challenging, especially when the goal is to create highly engaging pervasive entertainment, that is more compelling than what already exists. Since the grammar has not yet been invented, for many, it presents a quantum creative leap. Right now, there is still conflicting opinion about what to call these new types of distributed stories—and let’s not mention the transmedia wars!

One of the greatest challenges for professional storytellers, who are accustomed to traditional linear plots, is to transition into a new platform. Rather than writing straight lines to be delivered from a stationary stage or studio, they are now being pushed to create content for a shifting stage or multiple shifting stages at once— often in different cities or time zones. Given the growing appetite for this type of connected, collaborative, dynamic content, the well-established line between audience and producer is becoming increasingly blurred. Right now it remains to be seen if conventional storytellers will adapt to these new demands, or if they will be outpaced by users themselves. User who are as voracious (and in some cases as adept) in creating content as they are in their insatiable consumption of it.

I was trawling the web the other week looking for a good description of levels of experience and how to design for them. What I discovered, however, is that, much like the missing lexicon, there isn’t a lot of science to this yet either. To fill the gap for now, I created a diagram to explore increasing levels of experience or engagement: It begins at the first level of physicality as the least complex and builds its way up through mental engagement, then social inclusion, and finally the emotional and spiritual levels. These last two being the hardest ones to deliver. Narrative games, like L.A. Noire and the earlier Heavy Rain and Indigo Prophesy, are brave examples of games trying to develop emotional, interactive responses (albeit skipping most of the real social & physical elements).

For audiences in the developed world, 3D and 4/5D cinema is gradually moving into the home and has the potential to make box office visits unnecessary – not worth the added effort. Audiences are starting to expect more value and more payoff for their play time (and trouble): For many, a trip out of the house to be entertained is a transmedia experience in itself. This forces new entertainment providers to seriously take these “audience journeys” into consideration. Likewise, since marketers have begun to tell more interesting stories across places and platforms, traditional writers need to get up to speed on these changes as well. Take for example, a recent holographic product display for Lego. These types of interactive promotional events work to increase the expectations across the board for what is possible in terms of entertainment.

However, film is also slowly catching up. The internationally renowned artists’ group, Blast Theory created a locative cinema project called A Machine to See With, which is a good early evolutionary example. Less about sensory immersion and more about a healthy combination of imagination and locative storytelling, the project allowed viewers to “live” inside a cinematic story unfolding on the streets of Brighton, England. According to the San Jose Biennale last year, the experience mixed documentary material, stolen thriller clichés, and the films of Jean-Luc Godard to let participants walk through the city and receive phone calls, stepping into bit parts or leading roles.

These steps are evidence that now would be a good time for these types of indie projects to start receiving the big-budget attention that clunkers like Phone Booth did. Entertainment is truly moving toward a variation of the infamous Star Trek Holodeck, a complete surround experience that fools our brains into thinking “this is really happening” or “we are really there.” Experiences can either be delivered through layered digital storyworlds, or peppered your everyday life through fragments and bits so that your real world starts to become the storyworld.

Parallel to this transmedia trend, there are complete virtual screen environments of game driven and socially focused spaces known as MMOGs (massively multiplayer online games). These alternate “worlds” are host millions of peoples ‘minds’, melded into the characters they are playing. Many approach a game with the same gravity as a method actor taking on a new role, wholly losing themselves in an alternate reality. The way people interact with these virtual selves is also rapidly changing – making new interface technologies like the Xbox Kinect and iPad/tablets some of the fastest-selling items in history.

These new forms of entertainment will require creators to become writers of place and time, creating relevant and game-like personal experiences. Let’s imagine a simple future? You are at home watching a story experience teaser on your surround 3D head mounted display. You decide to rent it with some friends and project it on your wall-size, AR home cinema screen. It sets up the challenges; you all become the heroes. You all don in-earphones and sporty AR glasses, which have tiny cameras connected to a 6G network that point out and down, tracking the external world, as well as body movements and speech.

You undergo a physical and mental training exercise in your home to prepare for the outdoor challenges. You walk outside and start to explore your city. The open park becomes a fully rendered fantasy environment; urban streets and buildings are layered with story and critical game information. You have X-ray vision; you can see inside coffee shops and stores. Past and future scenes play out before your eyes. You talk to digitally rendered, artificially intelligent characters who respond to specific questions. You work as a team and add your own story challenges. An iBrain scan afterwards let you record your experience for others in 3D.

Welcome to your personal experiential entertainment Holodeck. Of course, you can turn it off at any time and read a good book or watch a film. But that’s so 2011.

Dec 292011

Originally published Oct 2011 in Wired Magazine ‘Change Accelerators‘ by Gary Hayes 1 of 5

Image by: Gary Hayes

We all do it.  We sit in our local multiplex waiting for the latest blockbuster film to start. The room darkens and minutes later your world has disappeared. The seats and people around you evaporate and for the next hour or so, you are living vicariously “through” the heroes in front of you. You have an out-of-body experience of sorts.

And so it has been for the last century, cinema and other large group events have fulfilled a need to be somewhere or someone else. But pervasive “surround us” technology has been quietly maturing in the background and our entertainment needs and desires are shifting. Audiences have turned into users. They want, to be part of the show, have the game surround them, influence their media, have their voices heard, and share the experience with friends—they want to not just see, but be those heroes. Because now they can.

We are living in experiential times and mass entertainment is in rapid transition. We, as producers of this content, are clearly marching down a road toward a personal entertainment Holodeck. Once the sole domain of theme parks every part of the media landscape is becoming experiential and there is a good deal evidence over the past few years of this behavioral and content media shift.

  • Cinema and home entertainment is evolving, becoming hyper-sensory, extending our sense of disbelief. There is also mass audience 3D, now with added scratch-and-sniff, smell-o-vision 4D.
  • 3D virtual game worlds are being mapped over real space. Examples such as Parallel Kingdom on smartphones or Flying Fairy and others on Sony Vita are moving outdoors.
  • Transmedia, sophisticated multiplatform storytelling embeds us into imaginary fictional story worlds. By surrounding us with a sea of content it reaches out to us across (the trans bit) our plethora of personal digital devices and channels.
  • Personalized life-games where your world and everything we do in it becomes gamified. From loyalty points to leader boards we are drawn in to a parallel, participatory social game world.
  • Augmented reality storytelling—early stages of immersive digitally layered worlds. Layers of Augmented Reality viewable on our smart-connected-camera devices surround us in media, information and story—bringing contextual entertainment to anywhere and everywhere we go.
  • Social and Live events encourage us to share our views, to extend the experience outwards into our personal networks. From Social TV through to the “look where I am” check-in apps to sticky social games and even theatrical experiences such as LARPS (live action role playing), we become part of the participatory, viral web.

Advertising is known to bring experiential marketing to new levels—surrounding us in the real world with 3D projection mapping, locative advergames, and branded flash-mobs. This shift is being driven by business too. The experiential economy has taught us that people view digital media as free, but they are willing to pay top dollar for an exclusive, all-consuming experience at a live event.

These emergent forms of media are starting to touch on virtuality, singularity, and even transhumanism as we choose entertainment that fools our minds into out-of-body, matrix-like experiences.

All of this will raise other questions such as:

  • Will heritage mono media such as print media be around in five years time?
  • Why go to the cinema when you can be in the film at home or out and about living the story?
  • Will broadcast TV become just a window on live events or will social elements evolve it?
  • Will our real world be submerged beyond recognition in layers of digital overlays?
  • Who is going to make all this stuff?

In the following four articles this week, I will try to answer some of these questions and drill down deeper into how our media world is forever being altered. From social transmedia storytelling through to pervasive all-around us locative experiences to augmented reality entertainment, I look briefly at the paradigm shifts ahead and how we as experiencers will evolve as well.

Are you experiential, yet?

Jul 302009

Running the Australian Laboratory for Advanced Media production I often have to provide a broad contextual background (as well as detailed insights!) to many of our seminars and labs. Over the past few months I have presented across a range of topics suggested in the blog title and lucky for some these have been captured in video form! So the player below contains (for now) seven separate presentations, a mix of free informal evening ones through to more formal full day workshop intros. The video production value is variable so I add the audio only versions at the bottom too and there are links to the other many great speakers at each session, detailed below the video box. These are unedited and contain the usual umms, arrs, errors, coughs & pregnant pauses, oh and I hope some great content. All are 16by9 apart from the serious games in 4by3, Enjoy

  1. SOCIALIZED TV 2.0 – 17m © Gary Hayes Director LAMP @ AFTRS and CCO of MUVEDesign (slideshares here)
  2. GAMES: SERIOUSLY – 35m © Gary Hayes (slideshares here)
  3. VIRTUAL STORY: THE ART AND CRAFT OF MACHINIMA – 42m © Gary Hayes (slideshares here)
  4. (Seminar Intro) THE RISE AND RISE OF SOCIAL MEDIA – 13m (slideshares here) © Gary Hayes
  5. FREE AND EASY (seminar intro) – 10m © Gary Hayes
  6. IPTV FUTURES – 20m © William Cooper Head of Informitv (live Skype video interview with Gary Hayes)
  7. MULTIPLATFORM INNOVATIONS – 22m © Giancarlo A. Mori Senior Vice President, ANIMALLOGIC Interactive. (live Skype video intro interview with Gary Hayes)

Continue reading »

Apr 072009

With my Director of the Australian Laboratory for Advanced Media Production hat on I often front our workshops and seminars with a kind of ‘trawl’ across the area being presented by specialist speakers. This means a rather high level view of services, key examples and robust case studies that provide a foundation for the other speakers and also a taxonomy, a shared language, for any later workshop elements. There have been two in the last two weeks on TV 2.0 and Documentary 2.0: Serious Games and I have just put my slides up on slideshare – embedded below. The two below are an interesting pair.

tribalisationI believe that these two areas of transition clearly indicate the major shifts taking place at the moment, already predicated as you see in the Marshall McLuhan clip. The first in this post is the TV form which is now being developed and evolved by global online communities deciding on the more social, tribal (niche) and participatory video format over the regimented, formulaic, commercially focused TV we have seen unchanged on prime time in the past 30 years. The second presentation below is on Serious Games or Documentary 2.0, the nature of learning about real world issues, the evolution from passive through to play. Rather than being force fed a series of edited perspectives in traditional documentary TV style, now we immerse ourselves in the dilemma, the scenarios and understand them by (as I point out in the presentation reference to Edgar Dales Cone from 1946) Direct Purposeful Experience. First though…

Television 2.0 – The Latest Innovations in Online Video The first seminar was looking at the future of online video from a TV 2.0, participatory and socialized TV perspective. Again the issue here was a definition of TV followed by some kind of structure on which to talk about the many and various incarnations of ‘the form’ as it starts to spill out across online communities and portals.

What is TV?

  • The device or screen?
  • The distribution channel?
  • The form, types of programmes?
  • What is that form? “Popularist, often live, linear video or something far more social & interactive?”

Breaking the hundreds of examples of TV moving from broadcast to shared, socialized and participatory into meaningful categories was a problem so I stuck to three simple ones:

One-to-many broadcast

  • Reversioned TV
  • Socialised TV

Many-to-many & 2 way

  • Participatory TV shared video content. Democratized, disintermediated, de-attached

Measurability – New Monetization models – value add & innovative services around the video content e.g.: personalization

Before my embedded slideshow (which includes ‘comic-style bubble’ commentary done quickly after the event!) I embed a short clip (which I showed from around 3:38 onwards) featuring a real futurist Marshall McLuhan whose now ancient words provided some sobering perspective to my talk about the disintermediation of TV and other media forms. We all talk long and hard about the new social paradigms but 50 years ago this was already clearly in the zeitgeist – albeit referring to rather scarce distribution channels but highly portentious of where we are close to being now (thinks ‘twitter’ as the drumming 🙂

and for those who think the decline of print is a 2000’s thing here is some of the latter part of the interview (remember from 49 years ago!) that I didn’t have time to show –

Interviewer “Look lets back up a bit Marshall. If more books are being used, more being sold, the libraries are crowded they are busy, how can it be said, aside from what ever else is happening, we are moving out of a print culture?

McLuhan “As John said books are still very important but their role is changing. The nature of their importance is changing. Remember that books were our first teaching machine and during the Renaissance our only teaching machine. Books are what gave the renaissance its peculiar stance. We had to see the world and others through the printed line on the page but today there are many media of information, many teaching machines.”

Interviewer “By teaching machines I presume you are not only referring to those found in the classroom?”

McLuhan “No, we learn everywhere. The books role has diminished. Because of all the other actors it’s no longer King but subject…Notice the shift in the image. From the assembly line stretched out, events taking place one at a time to the modern automated complex where things happen all at once. Bang. Not a line but a field. This applies not only to products but to people. The line, the individual, the event was the book. The field, the all-at-once, the tribal drum – the new medium”

Documentary 2.0 – Serious Games Seminar Workshop

My introduction to the wonderful world of Serious Games wasn’t without its challenges. Firstly the deeper you look into the area the more you discover a veritable black hole of titles. Literally thousands of console, 2D web based, 3D MMOGs, CD ROMs, locative play, connected DVD’s, Social network widgets, educational virtual worlds – endless places that serious play or games exist or have existed. But as well as the quantity problem we have the issue of how to classify them, break them down into meaningful ‘chunks’ so we can understand them. Finally there is the problem of definition – what exactly is a serious game? So before the embedded slideshow – I pulled out a little definition I came up with and more importantly a taxonomy which we used in the workshop.

Generic definitions from others

  • Games that are NOT entertainment ?
  • Games that are simulations ?
  • Games that are: infotainment, edutainment, advergames, therapeutic, propaganda…?
  • Games that are used by education, training, health, public policy, defense, and strategic communication ?

My definition

  • Goal orientated ‘play’, often in real world scenarios, intended to ‘improve’ the player/s knowledge, awareness or skills

OK my definition could feasibly include ‘entertainment’ titles but it does raise the question, is a game such as GTA4 or Mirror’s Edge or Assassins Creed actually providing real world training? I would say to a large extent yes – so the field is even broader. So the taxonomy I developed is focused on the intention of the game. What did the creators ‘intend’ the game to achieve, what result would be achieved for the player/s. I developed this list and naturally found a few games overlapped across some of the areas but surprisingly a lot less than broad definitions such as ‘edutainment’! Here is the list (followed by the actual slideshow with examples of each area):

Gary’s Top Ten – Serious Game Taxonomy YOUR INTENTION WITH YOUR GAME IS TO:

  1. raise AWARENESS of issues
  2. train MOTOR functions
  3. develop SOCIAL skills
  4. develop sudden onset CRISES response skills
  5. develop HUMAN CAPITAL and workforce
  6. improve MIND & BODY
  7. develop BUSINESS prowess
  8. improve ORGANIZATIONAL management
  9. improve CREATIVITY
  10. impart KNOWLEDGE
View more presentations from Gary Hayes.

View more presentations from Gary Hayes.

2 pages