Feb 282011

Mid 2010 draft catch-up post – What will it mean when we all use a handful or even just one device to consume ‘all’ our media? Will we also use it to share ‘all’ our content, pushing it to large, dumb screens around us? When we talk about transmedia we often mean, telling a complex story across many platforms used by many users, objects and screens, perhaps partly in a book, on a TV show, inside Facebook on the PC, in a console game or at the cinema  – but what will happen if all our personal media is consumed only on one screen? A world where TV is not about home screens, where Facebook is not about desk or laptop PCs and the most used games are not on chunky, dedicated consoles?

This is article is not a resurrection of the dreaded, old school (circa late 90s) convergence debate but something much more akin to the Trojan Horse saga. We are palpably moving into a space where a certain medium size screen, portable device, connected, personal & social is slowly permeating our world. As powerful and practical as all the other gadgets & screens we have gotten used to the 7-10″ tablet is has hit a sweet spot. Already the fastest selling device of all time, the iPad has caused a storm, the dam holding the waters back has leaks and other similar devices are starting to trickle out, but the dam is about to burst and we will be flooded in the next year as these tactile hybrids of smartphones and laptops seep into our daily lives – once again 🙂

Painting Original: The Marriage of the Virgin by Raphael. Public Domain

But will we converge towards this swiss army media device? Does it fulfil all our video, game, communication, work & social needs?  More specifically, just as we are starting to master the ‘Art of transmedia Storytelling’ are we now looking at a mono device future? Will the art of transmedia storytelling turn into telling our stories across services and channels on a ‘single’ device rather than across multiple devices and platforms?


Almost half a decade ago I did a post called Media Journeys Part 2 that explored a simple evolution of media technology from cinema at the start of the last century through to the portable revolution of the mid noughties. That post implied a device that would be a screen, with a quality good enough to view films on, portable, tactile, connected, communicative and powerful enough to play networked & graphically rich games on. This post completes that train of thought and asks a key question – are online tablets the end point of a 100 years of platform evolution and more significantly can we actually expect to see a decline in the number of ‘discrete’ platforms available to transmedia producers?

The Evolution Timeframe

Firstly the timeframe. As explained in my earlier post the most useful timeframe for this ‘postulation’ is the last 110 years – from the dawn of mass media communication and non text based story-telling (film). There has been a compression of the evolution in the last twenty years, so the curved template below reflects that year-wise. The reason the chart is curved is to allow my five key trends to converge visually.

Convergence Media Tablets

Evolution of the Human Interface

Convergence Media Tablets

One thing I didn’t cover in the post from five years ago was the evolution of interface which reflects how the technology has become sufficiently powerful enough for us to need to do less ‘unnatural fiddling’ at the ‘control’ end and use our bodies more naturally – less of a slave to qwerty or cross, square, circle, triangle (PS reference!)…a continuum (each number corresponds with the icon sequence, left to right, on the chart)

  1. The remote or keyboard – Alongside the TV in the 1950s the button based infrared remote control was born and a decade plus later early QWERTY keyboards were used (using strange alien languages) to communicate with computers. The remote is still with us today but as we know a revolution is about to take place there.
  2. The mouse – The PC’s popularity spread quickly when the Mac was born in the early 1980s and the computer mouse became the norm for how we interact with complex lean forward screens vs rather clunky text entry using QWERTY keyboards.
  3. The controller – When game consoles entered the living room in the mid 80s more complex controllers were required
  4. Voice – although still not universal, voice controlled PCs became usable for dictation and basic control in the late 90s
  5. Touch – Touchscreens were suddenly on every device from 2005 onwards and today any portable device that is not touch feels very antiquated
  6. Body – at the end of 2010 XBox Kinect led the way for popular use of the whole body to interact with games, of course Sony and others had launched similar interfaces many years earlier, but the 3D sensing of kinect raised the bar significantly
  7. Mind – (future only) having played with controllers such as Emotiv we can certainly look to a time where using parts of our body will seem so old fashioned, but that is another evolution diagram

Items 4 to 7 are of course sensory, based on natural human movement & communication.

So we need a device that responds to my touch, I can wave it around so it gets a good sense of the GPS environment it is in, as well as controlling games or measuring my physicality and without a mouse or remote in sight.

Evolution of Film and TV Viewing Screens

Continue reading »

May 252010

…and the truth about ARGs.

Now that transmedia is everywhere and the Producers Guild of America have turned the ‘transmedia producer’ into a bona fide (or at least recognised) professional role one thing that rears it’s cross-media head is, who and where are the best transmedia producers going to come from? I have spent a good part of the last 15 years mentoring & training traditional & non-traditional media types in multiple platform content and now question where the best producers of this multifaceted ‘new’ content will come from – academia, film, book authors, social media consultants, game designers, TV, web developers, radio, advertisers, young, old, not yet born? Read on, a ‘hypothetical’ interview follows 🙂 and this is an opinion piece I cannot put in my book or lecture about!


Firstly what is it and does it actually mean anything at all? It is fantastic that the term ‘transmedia’ is now so widespread across the industry and with the official credit (attached ironically to film primarily) but is it a bubble about to burst – is what we have come to know as ‘transmedia’ in danger of being blown out of all proportion.

Here are some of the problems:

  1. Everyone is a transmedia producer – yes you’ve made a website that is attached to a TV show, your a TP. Created a mobile game that has a line or two from the comic, you’re a TP. No one will police this – is it a truly integrated story environment, does it have clever plot links or consistent characters?. A TP is a decathlete (multi-skilled, hard to get a one word answer about what they do in a bar!), gone is nice and simple mono media, a TV producer makes TV shows, film director directs films. You can be a TP if you merge your story across two or more media areas? But more on this later in the post.
  2. Transmedia as a concept is not focused. OK I know Henry Jenkin’s original definition has been spread around the web but it is a definition that is too broad. Perhaps I should exercise my floccinaucinihilipilification and suggest that something that tries to describe everything is actually worthless? Transmedia like a black hole in the universe it tries to describe sucks in everything that has come before (cross media, 360, social media, augmented reality, pervasive gaming and so on). At the other end of this spectrum citing Matrix or Blair Witch or other brand to justify the ‘field’ as mainstream it becomes apparent that the quoted definition itself is rather vacuuous. To quote Jenkins again from an LA Times article, transmedia – “means telling a story across different platforms, each element of which may or may not stand on its own but contributes to an enriched, dynamic, more participatory and “lifelike” experience.”
  3. We are still in the hype phase. Basically anything cool and different those transmedia types (and I point the finger at myself too btw) will take ownership of. I even heard the other day someone say Transmedia is the new Social media and augmented reality even gets a look in. I am not surprised those still getting their head around the ‘story’ potential of social networks or a cute mobile game find it all rather, dis-jointed. Also the increase in experimental and experiential ‘event’ based marketing suddenly meant transmedia is now inextricably linked with brand extensions (TV, film, product) – anything that is not a linear, branded film or TV show. I think for those who live in the transmedia echo chamber this has been the case for many years.
  4. It feels rather academic. Trans-media used to be an alternative semi-academic term to ‘cross-media’ (trans, from the latin ‘crossing’) but is now used to describe everything, non-linear, interactive, extension, participatory, social, brand, play, multi-platform, pervasive and so on. The idea that stories would be told in different places goes back thousands of years but in a modern media context a rich target for study and theorizing. Along came Henry Jenkins who coined the term transmedia almost a decade after the first basic cross-media incarnation. Henry admirably self confesses as being ‘too busy lecturing and presenting about transmedia, to partake’ of the industrial flavour of transmedia “some of it is not well done yet”.
  5. It is still a teenager. It has grown up before it’s time and become a troublesome big headed teenager without any true home and turned into a dysfunctional orphan at once protectively nurtured by over possessive academics, hijacked by experimental ad agencies and hardly understood by flailing stuck-in-time broadcasters. Originally cross-media was an intellectually stimulating concept – memories of mid 90s, pioneering BBC days also my old friend Brian Seth-Hurst who is “Referred to as “the father of cross platform” Hurst coined the term in 1998 as MD of Convergent Media at Pittard Sullivan”. Earlier definitions just talked about story based ‘crossing platforms’ element but since the exponential increase in social media as a place for millions to dwell it has suddenly had the participatory/social part added and also a suggestion that it is now a more integrated form of storytelling, I suppose I should have added a level 5 to my 5 year old (but about to be removed!) wikipedia cross media definition!
  6. Danger of being hijacked – Alongside all of this we have a ‘clique’ of so-called experts who try to describe something which is so simple on one hand (stuff on multiple platforms) yet so ambiguous on the other (fragmented narrative effervescence)  – time will expose the Transmedia echo chamber I suppose.

Of course I have nothing against the term per-say in the absence of alternatives having created transmedia entities/sites like Transmediadesign.org or lamp.edu.au or muvedesign.com – all transmedia in focus – but lets start thinking about the emperors clothes. Indeed the Producers Guild definition of the TP, however bold in its intention, is still a little ambiguous about the precise elements of the role to say the least

A Transmedia Narrative project or franchise must consist of three (or more) narrative storylines existing within the same fictional universe on any of the following platforms:  Film, Television, Short Film, Broadband, Publishing, Comics, Animation, Mobile, Special Venues, DVD/Blu-ray/CD-ROM, Narrative Commercial and Marketing rollouts, and other technologies that may or may not currently exist. These narrative extensions are NOT the same as repurposing material from one platform to be cut or repurposed to different platforms.

A Transmedia Producer credit is given to the person(s) responsible for a significant portion of a project’s long-term planning, development, production, and/or maintenance of narrative continuity across multiple platforms, and creation of original storylines for new platforms. Transmedia producers also create and implement interactive endeavors to unite the audience of the property with the canonical narrative and this element should be considered as valid qualification for credit as long as they are related directly to the narrative presentation of a project.

Transmedia Producers may originate with a project or be brought in at any time during the long-term rollout of a project in order to analyze, create or facilitate the life of that project and may be responsible for all or only part of the content of the project. Transmedia Producers may also be hired by or partner with companies or entities, which develop software and other technologies and who wish to showcase these inventions with compelling, immersive, multi-platform content.


But this post is not just about the word – there are hundreds of blog posts even now still trying to really get under the surface of what transmedia means and it is too easy to fall down the semantic rabbit hole of terminology and the endless subjective splits between academics, industry and wannabes. Perhaps something more concrete can be found in the ‘transmedia stuff’ itself. What is this stuff and who is making it?

Continue reading »

Nov 122008

What is Mixed Reality, why is it relevant and has TV become it’s background medium of choice for larger numbers of media consumers who around the world are spending more time in online pursuits than glued to the content breaks in-between the advertising slots of commercial TV. How will TV survive in a world where social and gaming worlds are far more compelling?

Latest video above available as a download (with better audio & creative commons) 50MB MP4 click here

I am up at the SPAA conference in the Gold Coast producing at and speaking on one of only two panels, for TV and Filmmakers, that are really focused on the ‘creative’ vs biz only possibilities of games and virtual worlds and (that oft misused term in these circles) New Media (that internet thang). The topic of our panel is “Where Virtual Worlds Meet TV, Where Films Meet Games” and features SilkCharm aka Laurel Papworth, Keren Flavell aka SL’s Starr Sonic (SLCN.tv) and truna a great games evangelist and IGDA leader hailing from Brisbane.

This topic is driven partly by a mass fragmentation and a paradoxical reversal of fortunes at the moment – where TV itself is the actual snacking medium and where the longer form immersion is in online communities, virtual worlds and games. But can the mediums truly cross-over?

I have been talking for a couple of years now about the fantastic potential of the live and by implication shared TV experience to be enhanced by extending the world into online games. Where are we and where might we be in a few years once the ‘broadcasters’ realise that keeping an audience involved in the ‘IP’/programme in-between airings is a good thing. Good for the story creators, the latent creative audience and of course advertisers who need eyeballs/hands/ears/minds. Some older Personalize posts on this topic.

Anthony Zuiker creatorof the CSI franchise was at one point going to join my panel and his perspective is critical in this:

“The advertising model for TV is completely broken top to bottom. I’ve lost 20% of my viewership in a year and a half… where are they? They’re on the web and other platforms.” Despite a “revolution” in television that now delivers some of the highest quality programming in the history of the medium…Zuiker believes that the “technological boom” happening concurrently is negatively impacting the popularity of the medium.

MI6 Creative Keynote: CSI Creator Calls For Games, TV To Converge

A part of the SPAA panel here on the Gold Coast, is looking at the issue of where TV and Virtual Space ‘will’ cross-over, not some wacky installation in a dark art gallery but a new emerging element of the entertainment industry where film and games are joined at the hip and TV and social virtual worlds work in glorious real time – live broadcast driving and linking to highly social environments, what Interactive TV has always tried to be. FYI here is the synopsis of my panel “Where Virtual Worlds Meet TV, Where Films Meet Games”.

“Which side of the wall are you on? Are you ready for the Mixed Reality, Entertainment Perfect Storm? TV and Film OR Games and Virtual Worlds? That wall is about to crumble. This is a wake up call to all entertainment producers and consumers to prepare for an almighty collision. Audiences are already spending up to four times as much of their entertainment time in virtual spaces than they are watching TV. Gary Hayes says “I think we are really approaching a perfect storm, a mixed reality perfect storm, because we are seeing several things happening. The first one is a long history of games based on TV and films. Another ‘wind’ is virtual worlds, particularly the exponential growth of customisable social spaces and the important ability to integrate external media into them. The third force is audience behaviour, who involved in far more simultaneous activity particularly between broadband web and TV. The fourth element to this perfect storm is actually what is happening to TV and film, such as live reality TV becoming more game like and now over 100 feature films in production based on game worlds. All of these forces together are creating a really potent mix that all producers need to be aware of”

What is Mixed Reality?

Mixed Reality is a term that needs a more focused definition, as I believe it is also misused. So I see Mixed (or Cross) Reality as

“a creative or social activity that takes place simultaneously in real and virtual worlds and where the interaction in each are resonant and dependent on each other”

So typical practical examples – a conference that has active audiences in the virtual and real world and both communicate seamlessly with each other or where a kids TV show is broadcast while children collaborate in a virtual world and appear to help the progression of the story or a film on a DVD with clues that as you watch it allow you to progress with other players in an online game. But there is also another key aspect of cross or mixed-reality, that of virtual “˜things’ appearing around us in real physical environments. This is often called “˜augmented reality’ but I believe it sits under the broader “˜mixed reality’ umbrella.

Some folk also call this form ‘blended entertainment’ – but to me that doesn’t specifically suggest virtual space and is more related to the already out-dated ‘cross-media’ RIP (hello – Social Media Entertainment) or Extended Entertainment, which is more in my Level 1 or 2 cross-media definition on Wikipedia.

About the Mixed Reality Compilation Video Above

aug-01I think the potential of this two-way flow is significant for education and business but also for entertainment and advertising/marketing. So I put together the short film above that hopefully captures a sense of where we are with this circa 2008. I wrote a rather rushed voice over for the short film, a kind of pretrospective (writing back from the future) looking at a “Dawning of Mixed Reality“. As well as my music and voice over (apologies, it was done at 1am a few days ago)Â it contains many choice clips trawled off YouTube but also quite a few that I have worked on at LAMP, the Format Factory, BBC and various other hats.

Is this reality? Is this fantasy? In 2008 the great transition truly began. Whereas a decade earlier we used to “˜log in’ to cyberspace, now we began to semi-permanently inhabit virtual space and the digital world started to leak out into everyday life. It began to infiltrate our shopping malls and became integrated with our everyday lives. Humanity started the relentless journey towards the natural future where virtuality became a greater reality, and where digital fantasy and organic reality were inextricably intertwined.

Through the early 2000s pervasive wearable computing started to break down the walls that used to separate our virtual existence from our physical one. This same technology also allowed us to embed ourselves seamlessly into virtual worlds which is where we could truly experiment with future forms of entertainment, art, education and business.

In these new places we became the real time, living celebrity. Many of us became avatar stars, pixel gods – exalted as those linear film and TV icons. This became the only place for many. By 2007 hardcore gamers were already spending fifty five hours per week “˜inside’ these shared worlds and learned to forgot about the real world. This became the place where their most meaningful hours were spent. Everyone began to blend the two domains, combining them in new ways, driven by an invisible urge. Thus started the global meshing, of today’s mixed reality.

But in 2009 questions were asked. As in the many films that hinted at our transhumanist future, would the physical embodied self ever become redundant? Would we truly evolve as self contained, digital entities? May we as well be slumped in a chair with a cable plugged into our heads? Regardless, as the real world became inhospitable we all started to crave for the immersion and began moving our physical selves into these spaces. Even more than that we wanted our peers our un-virtual audiences to be able to share our experiences there. It became a contagious as the most poignant moments and memories were the ones in virtual space.

But we needed to look beyond these screens and into our own souls. Find the truth written along the “˜thin white line’ that separates analog from digital, person from avatar. This was the beginning. It always was. As far as the meshing or blending of reality and virtuality, in 2009 they were the equivalent of grainy black and white movies seventy years earlier. Our experiences were simultaneously part real, part virtual but it didn’t matter which was which anymore. Both were valid and they depended on each other. Those early parallel existences of twenty years ago started to move humanity forward, released our imaginations and we coexisted with our precious and ultimately fragile, physical selves. The great crossing had begun.

I was particularly interested in several new developments that are allowing “˜minority report’esque’ eye-catching. holographic human figures into real space. You will spot these in the film, the live Telstra conference or the models trying on clothes in store windows and closed displays. I tried to list most of the items below and have copy paste some of the text that describes the videos. If there are others you think are significant or that I have missed, please comment and as I do with other compilation films I will be updating regularly, particularly on the download versions.

The various clips in the film are detailed below:

  1. InLimbo Blended Reality – A.M. Architect sits In Limbo to converse and showcase their electronic music. Simultaneously to the broadcast, the show was recreated in the KRTU-Second Life complex, the audio streaming and photos of the studio dynamically updating
  2. Metaversatility brings Frogg Marlowe (Jeremy Works) to TX for a couple blended reality music performances. Footage from Limelight in San Antonio & Mozart’s in Austin, for the Second Life TX Meetup, hosted by Metaversatility. metaversatility.com
  3. A short 3 hour Mixed Reality Game I devised for a LAMP residential – called the Old Forest more details on UTube
  4. Red Dog Clawtooth (Red Dog’s) Avatar makes his debut on Channel 9 news sharing the concept of Blended Realities!
  5. A Segment on CNBC asia about Adrian David Cheok work on ‘mixed’ or ‘augmented’ reality.
  6. Gizmondo Augmented Reality Game – Catapult. Please not this was never released it was in development when Gizmondo went under. There is no sound on this clip.
  7. Motion Capture & Augmented Reality. Virtual Dancers Part 1- A good sign the tracking is okay is that all this has been obtained on the first test and with no feedback for me when I held the camera. In brief, as long as it is a bit smooth, the real-time tracking is okay.
  8. Project exploring technique of green screening Second Life avatars and real life actors.
  9. A promotional video from The Format Factory
  10. This 3-D Mixed Reality 3-D Book teaches children about the layers of the earth, how are they discovered, how do they related and function, siesmic waves, comparative sizes, and many more.
  11. Larngear Technology’s Mixed Reality Learning Media being used in real classroom environment, during a high school chemistry lesson in Mater Dei School. This is featured in the TV progam Mega Clever
  12. Tim Johnson’s presentation was held at the Centre for Digital Media at Great Northern Way Campus – home of the Masters of Digital Media program. The event was simultaneously broadcast in Second Life at the school’s virtual world campus located at University Project.
  13. The worlds first holographic illision, designed for retail. Created in 2002. You can find the team behind this solution at RealFiction.com
  14. Dreamoc, a holographic video display designed to create mixed reality. The world where real objects meets virtual fiction. The Dreamoc system is designed by RealFiction.com realfiction
  15. Future Fun – Mixed Reality Lab, Singapore, Adrian David Cheok : A documentary about future fun
  16. DNP and metaio implement the first augmented reality museum application with a handheld system in LOUVRE-DNP Museum Lab, Tokyo.
  17. A re-invisioning of a 1916 Italian Futurist film using Second Life Augmented Reality Technologies, being developed at Georgia Tech. The short film is a hybrid live action and machinima captured in real time. There are no use of Green Screens. Pos-production is not used to composite the Second Life image and live image.
  18. Augmented reality driving from Total Immersion.
  19. Large scale implementations of augmented reality solutions from Total immersion.
  20. Aussie talkshow host Rove McManus made history yesterday at Auckland’s Vector Arena as the first person to have his hologram beamed across the Tasman. Multiple cameras beamed his three-dimensional image from a studio in Melbourne to the paper-thin Auckland screen, accompanied by sound effects from Star Trek’s transporter beam, enabling McManus to have a live discussion with Telstra-Clear chief executive Allan Freeth.
  21. Roy Block is an experiment, sort of game, with a tangible interface that touches the field of mixed reality. It is a project by Sebastian Schmieg, student at Merz Akademie, Stuttgart.
  22. 2004 Video, computer, pneumatics. A stack of books sits in a chair and, on them, a monitor abuts a small table. The surface of the table holds water, forming a small rectangular pool in front of the monitor. The monitor depicts a woman’s face, her chin resting on her folded hands.
  23. http://www.reactrix.comDog going crazy for the interactive soccer ball on the Reactrix interactive floor display
  24. Another sample of interactive floor projections: the Water Effect. Scenes creates custom interactive effects for any kind of event, on the floor as on the wall or screens. www.scenes.it
  25. Technological platform for interactive floor ocean. Collaboration with Studio Azzurro. Museo del Mare, Genoa. http://naturalinteraction.org
  26. Worlds first multi touch interactive musical wall. This interactive wall allows multiple users to conduct virtual symphonies.
  27. Multi-touch table. This table is a departure from earlier examples because it is relatively easy to use by non-technical content creators. It works in most lighting because it doesn’t use a camera
  28. http://au.youtube.com/watch?v=Jd3-eiid-Uw – Using the infrared camera in the Wii remote and a head mounted sensor bar (two IR LEDs), you can accurately track the location of your head and render view dependent images on the screen. By Johnny Chung Lee, Carnegie Mellon University. For more information and software visit http://johnnylee.net
  29. News broadcast on CNBC – Mixed Reality Lab, Singapore, Adrian David Cheok : 22nd February 2002
  30. Larngear Technology’s story in the research and development, designing, and marketing of Mixed Reality technology is well describe and illustrated in the TV program Clickzone, supported by SIPA. The show is hosted by Tai, Chutima, from the movie Season Change.
  31. More to come…

There are several companies around the world developing Cross-Reality forms. One that I am heavily involved with, The Format Factory, are pioneering formats that bridge the space between compelling participatory TV and online game worlds. This is a kind of teaser video I created that metaphorically demonstrates some of the ’embedded’ world-within-worlds. Their sister company The Project Factory have been doing some basic but interesting cross-overs in Second Life too.

I also talk in more detail about Mixed Reality potential in this early 2006 seminar, here are the slides from that one containing many cross-branded vs cross-reality examples.

I will leave the final word again to Mr ‘CSI’ Zuiker who instinctively points out that particpant audiences expect to be involved in the story, to be the hero, the villain and to feel they are partly in control of their own personalised route through it. Customisable and game worlds with existing culture are the best tool at film and TV makers disposal.

“In the gaming area, you want to give people tasks, to shoot things and upload pictures… You’re doing this because you want these people to be creating their own story and it will be part of the crime on the broadcast… Even if it’s not the actual thing I shot, I was part of that experience, that community, that narrative.”

PS: BTW I think the term ‘participatory audience’ used in the title of this post/article, is a bit of an oxymoron. Audience as a term suggests passivity not participation…but I am sure you will let me off for that one?! Please.

Sep 282008

Have we reached a tipping point – with many more user hours spent with games than films are they now more culturally relevant (as in our cultures are saturated with them)? With most films having ‘game-like’ story arcs and, at the last count, nearly 80 films with stories based on game titles in production I am starting to think so.

Game culture and their inherent stories are now absolutely mass media. In a low risk, and dwindling film business, creating stories around experiences that people have already spent 20-40 hours immersed in the story world, is a no brainer, so what we are seeing is a threshold now of game-like films but more importantly films based on games. Anyway more after the ten minute video – stick with it.

“Playing With Stories” THE CINEMATIC GAME. A Film by GARY HAYES

I am designing curriculum for cinematic games and virtual worlds at AFTRS but also doing another report on the market potential of this cross-media, gilm (game/film) landscape. In the process again I threw together a compilation video of notable examples (I know there are at least ten times this btw!) interspersed with tasty quotations. “The Cinematic Game” was initially designed to be a look at the cross-promotion and story development potential of this most powerful mixed-media marketing machine. But, during the process though I was staggered to see the number of major feature films in production based on new and existing game universes (listed in this post below and scrolling at the end of the video) – suggesting to me a tipping point.

Game story starts to lead film development?

TV and Cinema has already become much more of a background or escapist medium for larger numbers of media consumers. In homes around the world we are spending more time in online pursuits than glued to the content breaks, in-between the advertising slots of traditional TV. We are also immersing ourselves in the social and story ‘exploration’ of the current generation of PC and console games. So how will TV and Film survive in a world where social gaming and associated peer appraisal online is far more compelling? Also given the choice will we continue to passively watch the protagonist or ‘be/live’ the hero? It is interesting to see 8000 employee EA Games now developing major strategies whereby games are made to be easily adapted to comics, books, TV and Film. In the business week article “Morphing Video Games into Movies” they note how EA are trying to emulate small non-game companies have built mini empires on their ‘story IP”

The idea is to repeat the success of companies such as Marvel Entertainment (MVL) and Hasbro (HAS), which used their base of fans to transform from marginal companies into Hollywood players. After licensing Spider-Man to Sony Pictures for a string of hit movies, Marvel has created its own studio, with Iron Man and other films set for release this summer. The Hasbro-backed Transformers movie grossed more than $400 million in 2007 global box-office sales, which in turn boosted company sales of movie-related toys and games.

It is interesting to note that the music industry is also starting to ride the coat tails of the games world. Kotaku reported on a ‘run-in’ between Warner Bros. and Activision about Guitar Hero. Suggesting the music publishers should get more royalties from games that use music, Activision’s boss Bobby Kotick hit back at Warner’s and said the following (which implied as the Kotaku item said ‘Perhaps the record companies should pay us‘)

We’re going to favour those publishers that recognise and appreciate how much we can add value to their artists… in the case of those kinds of products, you should be paying any money at all and whether it should be the reverse.

Back to the main thread of the post, it does make you wonder how many screenplay writers are sitting in front of their XBoxPS3Wii’s looking for inspiration nowadays? Variety suggests that in fact ‘all’ games could be made into movies but I will be really interested in what kind of film comes from The Sims and already know the likely story arc of MassEffect having run through it a couple of times but many others on the list below will be of interest, especially World of Warcraft which has around 4000 story threads/quests – so which story will we be ‘offered’?Films of games have had a shaky past with only a few critical successes such as Tomb Raider, Silent Hill, Resident Evil (there are several on slide 75 of my game/story presentation below, that I did several months ago) but given the serious money and credible directors such as Landau, Lucas, Speilberg, Cameron, Jackson etc: plus a deep desire to properly reflect the integrity of the ‘interactive’ experience, the tide is turning. Being an avid machinima maker I know at first hand what it means to capture the ‘essence’ of game playing, adapt it, reflect it and, if you understand the culture of the game, interpret it – the good thing is A list filmmakers (as you can hear Peter Jackson say at the end of my video) understand it too.

I must again finish with a plug for a couple of unique courses at AFTRS and related to this post an article in one of its blogs RedSet called “What’a film, TV & Radio school doing offering courses in game design and virtual worlds?” makes the relevant point:

“AFTRS new game design and virtual world graduate diplomas will push students to go beyond the generation of clichéd actions and stereotypical characters, students of these new courses will be encouraged to step up and learn how to create meaningful interactive experiences for a variety of platforms informed by the expertise offered in all of the other creative disciplines taught at AFTRS such as directing, screen composition, screenwriting, sound design, production design and more. The field of game design and interactive experiences is equally as collaborative as the world of filmmaking, drawing together diverse specialists who together create the whole – writers, screen composers, programmers, animators, art directors – at AFTRS all of these disciplines are already housed under one roof – with a track record of cross disciplinary interaction and a staggering successful graduates.”

More about my video

A non-exhaustive compilation of story rich games or gamic films including in order of appearance: Contact, Indiana Jones, Heavy Rain, The Game, Burning Crusade, Max Payne, The Matrix, Heavenly Sword, Final Fantasy, Lord of the Rings, Ironman, Call of Duty 4, Simone, Rage, Tron, Bicentennial Man, SpiderMan 3, War of the Worlds, Tomb Raider, I am Alive, WoW Lich King, Indigo Prophesy, Jumanji, Desperate Housewives, Da Vinci Code, The Beach, Assassins Creed, Thomas Crown Affair, CSI, Halo, Resident Evil, James Bond, Sleuth, Afrika, The Godfather, The Cube, Narnia, Time Bandits, The Golden Compass, Half Life, Never Winter Nights, Silent Hill, Hellgate, Beowulf and interviews with George Lucas and Peter Jackson plus quotes from many film directors and games designers

My film contains some of the better hybrids, either films inspired by games, games inspired by films or just very rich cinematic, story or character rich games. I make no excuses that I have used a mixture of cut scenes as well as ‘real’ game play in the video – that is really to show where we are heading as game graphics continues to hurtle towards the real time equivalent of the likes of Beowulf and other ‘trickle’ rendered CG features. After the quotes and textual references from the compilation below, are more elements on this very exiting hybrid cross-story, cross-IP, cross-reality world.

I want gamers to be surprised by their own creativity. I want players to feel not like Luke Skywalker, but George Lucas Will Wright (Sims, Spore)

We’re way beyond the notion of game-as-brand-extending afterthought. Let the virtual world–the vibrant, living world that people inhabit–let that influence the movie. Let it feed back into the process and provide unparalleled riches and depth to what we’re doing
John Landau (Titanic)

Games are already good at creating fear, suspense, excitement, shocked surprise, and laughter. Much rarer are games that create genuine sadness … I have never cried during a videogame
Marc Laidlaw (Half-Life)

I think the real indicator will be when somebody confesses that they cried at level 17
Steven Spielberg

When I found out one of my guildmates had died, someone with whom I had fought monsters, explored exotic lands, shared moments of jubilation and defeat, I wept. In spite of having never met him, the knowledge that we would not continue the story together, brought me great grief.
Laurel Papworth

We had a notion to take the stars of the movies and have them play supportive roles in the video game and tell a story that is a companion story to the movies
Joel Silver (Matrix)

If done well, I don’t believe a videogame itself can detract from a film experience. Ideally, it would be a complement to the film and a way for fans to further involve themselves in a world once they leave the cinema
Peter Jackson, (King Kong, Lord of the Rings)

There are scenes that start in the video game and will complete the movie – ¦and fell like it’s a part and experience of the movie
Joel Silver (Matrix)

Games and MMOs in particular are providing such a sustaining experience that challenges us to make the theatrical experience better
John Landau (Titanic)

The next big emotional breakthrough in gaming is being able to tell a story that is consistent throughout the narrative. If the game is 15 levels, it’s just like 15 chapters in a story
Steven Spielberg

We’re trying to understand the language of the film, but diverge in ways that are right for the game medium.
Neil Young’ EA VP (Lord of the Rings)

Games sometimes can reveal things. To watch someone in movement, unconscious movement, can be very stimulating and revealing, whether they win or not.
John Turturro (actor)

People wonder why games don’t have the same emotional palette as movies. But that’s the wrong way to look at it. It’s like saying, ‘Why isn’t radio like reading a book?’ Games, inherently, have a different emotional palette, which is their strength
Will Wright (Sims, Spore)

Scroll at the end of the compilation:

FILMS BASED ON GAMES IN Development or Production 2008/9 (Wikipedia and IGN source)

Alone in the Dark 2
American McGee’s Alice
Area 51
Battle Royale
Biohazard: Degeneration
BloodRayne III: Warhammer
Broken Sword: Shadow of the Templars
Citizen Siege
City of Heroes
Clock Tower
Cold Fear
Crazy Taxi
Deus Ex
Devil May Cry
Doom 2
Dragon’s Lair
Duke Nukem
Earthworm Jim
Eternal Darkness
Eternity’s Child
Far Cry
Fatal Frame
Fear Effect
Gears of War
God of War
Hunter: The Reckoning
Jagged Alliance
Kane & Lynch
Legend: Hand of God
Lost Planet
Mass Effect
Metal Gear Solid
Mortal Kombat: Devastation
The Neverhood
Nightmare Creatures
Ninja Gold
Paul Blart: Mall Cop
Rainbow Six
Resident Evil IV
Return to Castle Wolfenstein
Sabotage 1943
Silent Hill 2
The Sims
Soul Calibur
Sonic the Hedgehog
Spy Hunter
Street Fighter:
The Legend of Spyro
The Sims
The Suffering
The Unforgettable
Tom Clancy’s Splinter Cell
Tomb Raider III
Warcraft (based on World of Warcraft)
Zombie Massacre

Mixed Reality Futures

As a lead into a post about to be published I have been talking for a couple of years now (The Mixed Reality Perfect Storm ) about the fantastic potential of the live and by implication shared TV experience to be enhanced by extending the world into online games. It is exciting to think where we will be in a few years once the ‘broadcasters & studios’ realise that keeping an audience involved in the ‘IP’/programme in-between airings or sequels is a good thing. Good for the story creators, the latent creative audience and of course advertisers who need eyeballs/hands/ears/minds and hearts.

A further afterthought there are several companies around the world developing Cross-Reality forms, one that I am heavily involved with‚ The Format Factory, are pioneering formats that bridge the space between compelling participatory TV/Film and online game worlds. They have a promotional video that metaphorically demonstrates some of the ’embedded’ world-within-worlds. A trailer video teaser for the mixed reality, inhabited TV formats being pioneered and piloted by The Format Factory.

Other posts on this topic:

2 pages