Jun 202013
 

Alongside my day job for the past couple of years and various labs and seminars I have been involved in, one thing that keeps coming up is ‘why is the process for making multiplatform so complicated / varied / mysterious / technical’. For many from traditional production processes such as film or TV it can seem like a black art. Not only are there the technical and story hurdles for each platform, whether smartphone, tablet, web or games devices but there are the complexities of delivering to all of them at the same time or in a staggered release schedule. Then comes the further black art area of the back-end server and content management issues.

So in the presentation embedded below the main image, I tried to at least raise some of the key issues about process and considerations. This was part of a public talk in a 3 day lab I ran last week with SAFC for its Digital 360 lab initiative, where I had 15 minutes to set the stage for other speakers talking about various production issues. I didn’t go into some of the key problems that I come across daily in a media organisation, where legacy commissioning structures, budget release and content silo’s cause even more process problems – the ever so present issue of ‘multiplatform’ as an after-thought or very worse case ‘a marketing campaign’ to draw users back to the tent pole tv or film property. That I will leave for another day/post.

One thing I and other enlightened multiplatform producers oft talk about is the parallel production process. By that I mean that for truly integrated cross-channel or merged media story driven products, the best process is where they all run in parallel. They still keep to their own rigid production sequence but wherever possible, they run together. So concepts and stories across Film, Multiplatform and Games are mapped out at the same time. The overall planning and pre-production are hand-in-hand and so on. I tried to find a map/chart of how this could work on the web but drew a blank, so I tried to fill that blank in for my talk. But even this only went so far. So the 1st diagram below is an initial stab at what an ideal production process might look like. Each of the components within the 6 stages across the 3 key media types, synchronised.

Parallel Production

Continue reading »

Jan 022012
 

Originally published (& cross translated?) Oct 2011 in Wired Magazine ‘Change Accelerators‘ by Gary Hayes 5 of 5

Image by Gary Hayes

“Anyone up to battle aliens at the local museum tonight?”

It might sound like a farfetched idea at the moment, but this question may soon be another option rather than the old invitation to go see the latest 3D blockbuster at the Cineplex. The previous four posts talked about major experiential paradigm shifts, where more and more people desire to be ‘inside their entertainment’ —literally. The need to watch a show or read a good book in isolation will never go away, but right now, a new form of immersive entertainment is taking hold that sees users hyper active online and more and more participatory outside of their homes in unique, social story locative experiences. These shifts leads us to confront some basic questions, like, “What is an experience?” and “Are some experiences more engaging than others?” as well as some not-so-basic ones, the all-important, “Who will create all these new experiences?”

Designing any new media format is challenging, especially when the goal is to create highly engaging pervasive entertainment, that is more compelling than what already exists. Since the grammar has not yet been invented, for many, it presents a quantum creative leap. Right now, there is still conflicting opinion about what to call these new types of distributed stories—and let’s not mention the transmedia wars!

One of the greatest challenges for professional storytellers, who are accustomed to traditional linear plots, is to transition into a new platform. Rather than writing straight lines to be delivered from a stationary stage or studio, they are now being pushed to create content for a shifting stage or multiple shifting stages at once— often in different cities or time zones. Given the growing appetite for this type of connected, collaborative, dynamic content, the well-established line between audience and producer is becoming increasingly blurred. Right now it remains to be seen if conventional storytellers will adapt to these new demands, or if they will be outpaced by users themselves. User who are as voracious (and in some cases as adept) in creating content as they are in their insatiable consumption of it.

I was trawling the web the other week looking for a good description of levels of experience and how to design for them. What I discovered, however, is that, much like the missing lexicon, there isn’t a lot of science to this yet either. To fill the gap for now, I created a diagram to explore increasing levels of experience or engagement: It begins at the first level of physicality as the least complex and builds its way up through mental engagement, then social inclusion, and finally the emotional and spiritual levels. These last two being the hardest ones to deliver. Narrative games, like L.A. Noire and the earlier Heavy Rain and Indigo Prophesy, are brave examples of games trying to develop emotional, interactive responses (albeit skipping most of the real social & physical elements).

For audiences in the developed world, 3D and 4/5D cinema is gradually moving into the home and has the potential to make box office visits unnecessary – not worth the added effort. Audiences are starting to expect more value and more payoff for their play time (and trouble): For many, a trip out of the house to be entertained is a transmedia experience in itself. This forces new entertainment providers to seriously take these “audience journeys” into consideration. Likewise, since marketers have begun to tell more interesting stories across places and platforms, traditional writers need to get up to speed on these changes as well. Take for example, a recent holographic product display for Lego. These types of interactive promotional events work to increase the expectations across the board for what is possible in terms of entertainment.

However, film is also slowly catching up. The internationally renowned artists’ group, Blast Theory created a locative cinema project called A Machine to See With, which is a good early evolutionary example. Less about sensory immersion and more about a healthy combination of imagination and locative storytelling, the project allowed viewers to “live” inside a cinematic story unfolding on the streets of Brighton, England. According to the San Jose Biennale last year, the experience mixed documentary material, stolen thriller clichés, and the films of Jean-Luc Godard to let participants walk through the city and receive phone calls, stepping into bit parts or leading roles.

These steps are evidence that now would be a good time for these types of indie projects to start receiving the big-budget attention that clunkers like Phone Booth did. Entertainment is truly moving toward a variation of the infamous Star Trek Holodeck, a complete surround experience that fools our brains into thinking “this is really happening” or “we are really there.” Experiences can either be delivered through layered digital storyworlds, or peppered your everyday life through fragments and bits so that your real world starts to become the storyworld.

Parallel to this transmedia trend, there are complete virtual screen environments of game driven and socially focused spaces known as MMOGs (massively multiplayer online games). These alternate “worlds” are host millions of peoples ‘minds’, melded into the characters they are playing. Many approach a game with the same gravity as a method actor taking on a new role, wholly losing themselves in an alternate reality. The way people interact with these virtual selves is also rapidly changing – making new interface technologies like the Xbox Kinect and iPad/tablets some of the fastest-selling items in history.

These new forms of entertainment will require creators to become writers of place and time, creating relevant and game-like personal experiences. Let’s imagine a simple future? You are at home watching a story experience teaser on your surround 3D head mounted display. You decide to rent it with some friends and project it on your wall-size, AR home cinema screen. It sets up the challenges; you all become the heroes. You all don in-earphones and sporty AR glasses, which have tiny cameras connected to a 6G network that point out and down, tracking the external world, as well as body movements and speech.

You undergo a physical and mental training exercise in your home to prepare for the outdoor challenges. You walk outside and start to explore your city. The open park becomes a fully rendered fantasy environment; urban streets and buildings are layered with story and critical game information. You have X-ray vision; you can see inside coffee shops and stores. Past and future scenes play out before your eyes. You talk to digitally rendered, artificially intelligent characters who respond to specific questions. You work as a team and add your own story challenges. An iBrain scan afterwards let you record your experience for others in 3D.

Welcome to your personal experiential entertainment Holodeck. Of course, you can turn it off at any time and read a good book or watch a film. But that’s so 2011.

Jan 012012
 

Originally published Oct 2011 in Wired Magazine ‘Change Accelerators‘ by Gary Hayes 4 of 5

Image by Gary Hayes

When planning your next holiday to London with the fam, don’t forget to sync up your iGlasses and load up the London experience packs. On arrival, slip on your augmented reality sunglasses and take a look around: Roman-era London appears before your eyes. Slaves and gladiators walk through the streets and chariots rush past. You can add your own comments leaving virtual “We Were Here” graffiti for all time. The experience is part documentary, part user-generated narrative, and entirely pervasive. In other words, augmented reality meets living history.

In our everyday lives, we engage with stories in many ways, whether it’s eye-to-eye contact with a stranger that sparks an instant connection or a well-crafted movie or TV show. But what if we started experiencing those stories in the outernet’s layers?

While online networks are evolving traditional entertainment, such as TV and web series, we are also witnessing the rise of a new form of media called “augmented reality storytelling.” I’ve dubbed this new form of diversion ’ntertainment, as a shorthand for immersive augmented reality entertainment.

At its broadest level, augmented reality is about enhancing the physical world through digital elements, such as images, sound, and information. Now technology is enabling us to further situate and layer our digital stories in places where other narratives can’t reach. Right now, we see this happening when someone holds up a camera on an iPhone or tablet and shares objects or stories from the real world.

The opening Roman London example is based on an existing service called Londinium, which is a collaboration between the History Channel and the Museum of London using augmented reality video layered over real-world streets to re-create an alternate history. Coincidentally, London is also used as a site in the globe-spanning Ghost Tours 2.0. Haunted London encourages visitors to explore the city’s eerie side using locative AR (augmented reality). Likewise, another situated project is Witness, which draws participants into the dramatic and seedy underbelly of criminal Berlin. In this case, players are the hero: They watch graphic video scenes at different city locations and are then sent detective challenges to uncover the truth. But here’s the twist: The story might just bite you back! Augmented reality games and stories can even get physical, like the recent example of Chelsea FC playing the world’s largest Space Invaders game in a stadium using projection AR.

Gaming is leading the way. New consoles, like Vita, allow users to literally take game characters orreality fighters into the streets. Other gaming advances like AR games on Nintendo’s 3DS start to recognize place markers placed around a player’s city, transforming screen-based MMORPG(massively multiplayer online role-playing games) into an LMMOG (location-based massively multiplayer online games).

Augmented reality storytelling is starting to appear across our smart GPS mobile devices. Several marketing campaigns are taking the initiative by spearheading real-time AR challenges, such as Vodafone’s Buffer Monsters, which challenged German smartphone users to download a mobile app to capture virtual creatures and win a lifetime plan. This is only one example, other AR advergames encourage users to competitively run around cities on scavenger hunts for real-world prizes, such as the Droid Bionic AR Game. Similarly, this October, Gundam, the Japanese anime giant, release an iPhone/iPad app called Gundam Area Wars. The game uses the devices’ camera and gyroscopic sensors to show life-size 3D models situated in the player’s real-world landscape.

Given these above examples, I return to my earlier travel scenario and I wonder how commonplace it will become for people arriving in a new location to start experiencing it through augmented reality storytelling and gameplay? The traditional guidebook has already morphed into digital form. The Lonely Planet is already a downloadable app. Is it a big jump to imagine AR and location-based storytelling won’t soon allow travelers to engage history on a whole new level? One might even argue a deeper and more meaningful one than just the 2D sightseeing experience of looking at crumbling ruins. So many guidebooks have been written on the principle of making history come to life—AR actually makes it possible.

One could even take this one step further and question, why do we need to travel at all when we have our own personal Holodecks at our fingertips? Fast Company recently reported on Tour Wrist, a virtual tour that lets iPad users move around a global location with unlimited zoom and freedom. “Travelers” are virtually transported to that place and able to immerse themselves in it becoming the hero in a remotely situated, digital storyworld.

Finally, in the near future, we might all have the capability to create duplicates of our surroundings in 3D for others. This Microsoft R&D initiative to map the world uses the fastest selling piece of tech on the planet, the Xbox Kinect. This would allow everyday people to create unlimited user-generated 3D AR—foreseeable as easily as snapping a digital picture. In addition to this, there is a saturation of location-stamped social stories inside services, such as Google Earth, TagWhat, HistoryPin, Facebook Places, CheckIn+, Foursquare, and Gowalla, among others. What will result from all these stories becoming interconnected and navigable using AR devices?

From that point on, we will be co-creating an augmented entertainment eternity. Together. Will you be a part of it?

20 pages