Jan 012012
 

Originally published Oct 2011 in Wired Magazine ‘Change Accelerators‘ by Gary Hayes 4 of 5

Image by Gary Hayes

When planning your next holiday to London with the fam, don’t forget to sync up your iGlasses and load up the London experience packs. On arrival, slip on your augmented reality sunglasses and take a look around: Roman-era London appears before your eyes. Slaves and gladiators walk through the streets and chariots rush past. You can add your own comments leaving virtual “We Were Here” graffiti for all time. The experience is part documentary, part user-generated narrative, and entirely pervasive. In other words, augmented reality meets living history.

In our everyday lives, we engage with stories in many ways, whether it’s eye-to-eye contact with a stranger that sparks an instant connection or a well-crafted movie or TV show. But what if we started experiencing those stories in the outernet’s layers?

While online networks are evolving traditional entertainment, such as TV and web series, we are also witnessing the rise of a new form of media called “augmented reality storytelling.” I’ve dubbed this new form of diversion ’ntertainment, as a shorthand for immersive augmented reality entertainment.

At its broadest level, augmented reality is about enhancing the physical world through digital elements, such as images, sound, and information. Now technology is enabling us to further situate and layer our digital stories in places where other narratives can’t reach. Right now, we see this happening when someone holds up a camera on an iPhone or tablet and shares objects or stories from the real world.

The opening Roman London example is based on an existing service called Londinium, which is a collaboration between the History Channel and the Museum of London using augmented reality video layered over real-world streets to re-create an alternate history. Coincidentally, London is also used as a site in the globe-spanning Ghost Tours 2.0. Haunted London encourages visitors to explore the city’s eerie side using locative AR (augmented reality). Likewise, another situated project is Witness, which draws participants into the dramatic and seedy underbelly of criminal Berlin. In this case, players are the hero: They watch graphic video scenes at different city locations and are then sent detective challenges to uncover the truth. But here’s the twist: The story might just bite you back! Augmented reality games and stories can even get physical, like the recent example of Chelsea FC playing the world’s largest Space Invaders game in a stadium using projection AR.

Gaming is leading the way. New consoles, like Vita, allow users to literally take game characters orreality fighters into the streets. Other gaming advances like AR games on Nintendo’s 3DS start to recognize place markers placed around a player’s city, transforming screen-based MMORPG(massively multiplayer online role-playing games) into an LMMOG (location-based massively multiplayer online games).

Augmented reality storytelling is starting to appear across our smart GPS mobile devices. Several marketing campaigns are taking the initiative by spearheading real-time AR challenges, such as Vodafone’s Buffer Monsters, which challenged German smartphone users to download a mobile app to capture virtual creatures and win a lifetime plan. This is only one example, other AR advergames encourage users to competitively run around cities on scavenger hunts for real-world prizes, such as the Droid Bionic AR Game. Similarly, this October, Gundam, the Japanese anime giant, release an iPhone/iPad app called Gundam Area Wars. The game uses the devices’ camera and gyroscopic sensors to show life-size 3D models situated in the player’s real-world landscape.

Given these above examples, I return to my earlier travel scenario and I wonder how commonplace it will become for people arriving in a new location to start experiencing it through augmented reality storytelling and gameplay? The traditional guidebook has already morphed into digital form. The Lonely Planet is already a downloadable app. Is it a big jump to imagine AR and location-based storytelling won’t soon allow travelers to engage history on a whole new level? One might even argue a deeper and more meaningful one than just the 2D sightseeing experience of looking at crumbling ruins. So many guidebooks have been written on the principle of making history come to life—AR actually makes it possible.

One could even take this one step further and question, why do we need to travel at all when we have our own personal Holodecks at our fingertips? Fast Company recently reported on Tour Wrist, a virtual tour that lets iPad users move around a global location with unlimited zoom and freedom. “Travelers” are virtually transported to that place and able to immerse themselves in it becoming the hero in a remotely situated, digital storyworld.

Finally, in the near future, we might all have the capability to create duplicates of our surroundings in 3D for others. This Microsoft R&D initiative to map the world uses the fastest selling piece of tech on the planet, the Xbox Kinect. This would allow everyday people to create unlimited user-generated 3D AR—foreseeable as easily as snapping a digital picture. In addition to this, there is a saturation of location-stamped social stories inside services, such as Google Earth, TagWhat, HistoryPin, Facebook Places, CheckIn+, Foursquare, and Gowalla, among others. What will result from all these stories becoming interconnected and navigable using AR devices?

From that point on, we will be co-creating an augmented entertainment eternity. Together. Will you be a part of it?

Mar 252011
 

I have been trying to find a really simple metaphor for clients, students and other industry professionals to help them better understand the complex world of multi-platform. Also completing the last few chapters of my Networked Media Storytelling book I needed a big but simple metaphor. One of the biggest issues I have faced over the years is rooted in the question “I tell stories on one or two platforms why do I need to reach out onto other platforms and how?”. I often reply with a long answer that falls into a few categories (1) Audience have fragmented 2) Business models have shifted (3) Engagement and social needs have altered (4) Have you noticed a general decline in traditional media? (5) Your stories can be improved exponentially if you ‘transmediarize’ them etc: I obviously leave the more fundamental ‘how to’s” to my consultations or workshops and a key element of that is what are the new platforms combined with how to design your story appropriately for them.

So for a few workshops & talks recently I developed a simple ‘graphic’ which demystifies some of the challenges storytellers face. This post describes the motivation and deeper thinking behind the World Map of Multi-Platform Cultures & Transmedia Rituals. How to understand this new world and how to navigate the relatively uncharted waters?

Ye Olde Days – The Disconnected World of Gated Platform

Around 40 years ago the opportunities for storytellers were both limited and segregated. By that I mean it was hard to truly make your media work across multiple distribution channels, sure you could do the whole film of the whole book or the whole radio play of the whole comic but the concept of placing ‘isolated’ narrative elements of your story appropriately designed for each and meant to ‘move’ users between them was a pretty alien concept. The more sophisticated story form within multi-platform (transmedia) was also hard to achieve due to the commercial gate holders on each platform wanting the ‘self-contained’ whole – not bits and pieces that also promoted competitors or drove traffic away.

World of Multi-Platform in 1970s

But as we all know between 1990 and the present broadband internet, social media and mobile technology changed the landscape in a not so subtle way and old school media creative thinking is not relevant anymore in this altered landscape.

The New World Dis-Order of Multi-Platform Experiences

Wow how things have changed. Like our physical planet mass media and its internal cultures has splintered, the land masses moved apart leaving a complex environment to navigate.

World Map of Multi-Platform Cultures & Transmedia Rituals

Firstly we have the large continents of

  • The Sea of 2D Media – Video, audio, images and includes the Bay of Social Media
  • The Ocean of 3D Games – Social Worlds, Console single players, MMOGs, Serious, Casual
  • The Lands of Physicality – Theme Parks, Outdoor Screens, Urban Spaces etc: and includes the Bay of Mobiles

Looking more closely at my map, consider the hybrid media ‘waters’ that separate the lands. Between Games and Physical Lands/Mobile we find the ‘Straits of Augmented Reality’ – meshing the digital and the real.

Continue reading »

Feb 282011
 

Mid 2010 draft catch-up post – What will it mean when we all use a handful or even just one device to consume ‘all’ our media? Will we also use it to share ‘all’ our content, pushing it to large, dumb screens around us? When we talk about transmedia we often mean, telling a complex story across many platforms used by many users, objects and screens, perhaps partly in a book, on a TV show, inside Facebook on the PC, in a console game or at the cinema  – but what will happen if all our personal media is consumed only on one screen? A world where TV is not about home screens, where Facebook is not about desk or laptop PCs and the most used games are not on chunky, dedicated consoles?

This is article is not a resurrection of the dreaded, old school (circa late 90s) convergence debate but something much more akin to the Trojan Horse saga. We are palpably moving into a space where a certain medium size screen, portable device, connected, personal & social is slowly permeating our world. As powerful and practical as all the other gadgets & screens we have gotten used to the 7-10″ tablet is has hit a sweet spot. Already the fastest selling device of all time, the iPad has caused a storm, the dam holding the waters back has leaks and other similar devices are starting to trickle out, but the dam is about to burst and we will be flooded in the next year as these tactile hybrids of smartphones and laptops seep into our daily lives – once again 🙂

Painting Original: The Marriage of the Virgin by Raphael. Public Domain

But will we converge towards this swiss army media device? Does it fulfil all our video, game, communication, work & social needs?  More specifically, just as we are starting to master the ‘Art of transmedia Storytelling’ are we now looking at a mono device future? Will the art of transmedia storytelling turn into telling our stories across services and channels on a ‘single’ device rather than across multiple devices and platforms?

Context

Almost half a decade ago I did a post called Media Journeys Part 2 that explored a simple evolution of media technology from cinema at the start of the last century through to the portable revolution of the mid noughties. That post implied a device that would be a screen, with a quality good enough to view films on, portable, tactile, connected, communicative and powerful enough to play networked & graphically rich games on. This post completes that train of thought and asks a key question – are online tablets the end point of a 100 years of platform evolution and more significantly can we actually expect to see a decline in the number of ‘discrete’ platforms available to transmedia producers?

The Evolution Timeframe

Firstly the timeframe. As explained in my earlier post the most useful timeframe for this ‘postulation’ is the last 110 years – from the dawn of mass media communication and non text based story-telling (film). There has been a compression of the evolution in the last twenty years, so the curved template below reflects that year-wise. The reason the chart is curved is to allow my five key trends to converge visually.


Convergence Media Tablets

Evolution of the Human Interface

Convergence Media Tablets

One thing I didn’t cover in the post from five years ago was the evolution of interface which reflects how the technology has become sufficiently powerful enough for us to need to do less ‘unnatural fiddling’ at the ‘control’ end and use our bodies more naturally – less of a slave to qwerty or cross, square, circle, triangle (PS reference!)…a continuum (each number corresponds with the icon sequence, left to right, on the chart)

  1. The remote or keyboard – Alongside the TV in the 1950s the button based infrared remote control was born and a decade plus later early QWERTY keyboards were used (using strange alien languages) to communicate with computers. The remote is still with us today but as we know a revolution is about to take place there.
  2. The mouse – The PC’s popularity spread quickly when the Mac was born in the early 1980s and the computer mouse became the norm for how we interact with complex lean forward screens vs rather clunky text entry using QWERTY keyboards.
  3. The controller – When game consoles entered the living room in the mid 80s more complex controllers were required
  4. Voice – although still not universal, voice controlled PCs became usable for dictation and basic control in the late 90s
  5. Touch – Touchscreens were suddenly on every device from 2005 onwards and today any portable device that is not touch feels very antiquated
  6. Body – at the end of 2010 XBox Kinect led the way for popular use of the whole body to interact with games, of course Sony and others had launched similar interfaces many years earlier, but the 3D sensing of kinect raised the bar significantly
  7. Mind – (future only) having played with controllers such as Emotiv we can certainly look to a time where using parts of our body will seem so old fashioned, but that is another evolution diagram

Items 4 to 7 are of course sensory, based on natural human movement & communication.

So we need a device that responds to my touch, I can wave it around so it gets a good sense of the GPS environment it is in, as well as controlling games or measuring my physicality and without a mouse or remote in sight.

Evolution of Film and TV Viewing Screens

Continue reading »

3 pages