While lecturing to AFTRS students last week about multi platform, social media & new forms I got on to games and social virtual worlds. When I asked who knew about Second Life one student chirped up “oh isn’t that the place where ABC TV got bombed”. Now a few things immediately sprung to mind when hearing this comment
Having built the ABC TV Island in 5 days or so and part running it at the time I knew the background to this intimately, so how much detail to go into?
I was also bizarrely running a LAMP residential lab in Tasmania when this event occurred and Lisa Romano then an ABC producer was one of our mentors, she also was in charge of the ABC Island at the time – so very much involved in the response
These events are very rare and my experience was either mostly technical server errors or simple admin error, so the problem was fixed in an hour or so as we immediately liaised with Linden Lab who run Second Life and fixed the problem
But the thing that really sprung to mind was, wow this event was back in May 2007. A two year old story. How and why would it persist so long and into the heads of ‘one so young’ – well mid 20s gen, young in my book :). Then I started to think about the story I used to tell not so long ago to folk who were fascinated by the story of the intriguing ‘ripple’ effect. How a technical error ended up with the CEO of ABC TV being interrogated in government about the act being about anti- Public Service commercialisation combined with terrorism training. This also reminded me forcibly of Laurel Papworth’s Ripple effect and more importantly the Long Tail of an influenced ripple effect – whereby a story is spread like chinese whispers and in some cases enters into folklore and myth – even with endless online interrogation. I also liken this to the Butterfly effect or chain reaction, where a small event can end up causing something far more significant. In this case study below of ABC Island, as you see below, it was more to do with a kind of mass hysteria about the medium of branded virtual worlds & the reflection of that out into real ‘prejudiced’ society. An example of online mass hysteria or clever marketing? You decide.
So here is a glimpse into the Butterfly Effect chronology on 2nd year anniversary of the momentus event 🙂
As is my curse I gave another overview introduction presentation last week on films made with games engines aka machinima. I then ran a workshop on the production process and techniques particularly looking at dedicated machinima tools through to games engines – now my YouTube machinimas have gone past 300 000 must be doing something right for some! But one of my key points in my intro talk was the exponential evolution of the form. It has moved away from dodgy, quick gag, non-lip synch first person shooter ‘head-shots’ through to quality tales – emotional drama, visually entrancing alongside real character led comedy. Add to this the fact that many machys are at a quality now to rival tradtional animation (see examples below).
So all speakers referred to story, quality writing but also the importance of being true to the culture of the existing game world (more at the bottom). Here are my opening slides showing key examples, classified into my categories as to what machinima is created for:
It’s that time of year where things really start to kick-in. So on top of all my AFTRS lecturing, MA Supervision and LAMP R&D work plus commercial work via MUVEDesign and many consultancy sessions here are some nice breaks – seminars and conferences I am speaking at or running.
(BTW most of the LAMP ones can be booked at AFTRS short course pages in the MultiPlatform section – page being updated at the moment)
Virtual worlds are maturing at a rapid rate and brands are realising there are valuable business opportunities within them. Whether the objective is engagement, research or brand presence, virtual worlds are proving to be a legitimate marketing channel. In this session our panel will look to provide insights into the business benefits of working within a virtual world. Our panellists will provide:
– An overview of virtual worlds and why they’re suitable for business
– Insight for brand involvement including what’s in it for both the brand and the consumer
– Considerations before entering a virtual world and how to be successful
– Identifying the KPIs and how to measure the success of a campaign
– Engagement and brand presence
– With case study examples, this session will bring to life the importance of engagement and brand presence in a virtual world and how organisations are testing, developing, connecting, and marketing within these communities.
Gary Hayes, Director, Laboratory for Advanced Media Production, AFTRS & CEO MUVEDesign
Jeff Brookes, Regional Director – Asia Pacific, Sulake Corporation (habbo.com.au)
Wed 25 March 6-7pm – LAMP ‘State of Play’ Television 2.0: latest innovations in online video
Convergence and multi-platform production is front and centre at MIP TV this year. This seminar will provide background to the terminology, techniques and recent innovations in distributed online video, preparing you for all the key developments. Gary Introducing and speaking.
Fri 3 April – LAMP ‘Interactive Workshop’Â Documentary 2.0: Serious Games
Seminar and Workshop Fri April 3. The intersection between documentary filmmaking and games will be explored in this seminar and workshop, providing deep insight into the potential of Serious Games. Both games and stories have long been recognised as powerful learning tools. Their combination in the 21st century has the potential to provide learning experiences that are collaborative and globally connected. What are the best examples of Serious Games and where are they heading? How can Serious Games best be employed by educators, corporations or non-profit organisations? Gary facilitating and speaking.
20-30 April – “Innovation & Form Workshop” for AFTRS Students featuring:
Wed 22 April 10am-12pm Open morning seminar “Innovations in Multi-Platform Content”
A selection of leading innovators in multi-platform content present recent projects in the areas of social media, cross platform storytelling, extended entertainment, games and online entertainment. Presenters will include social media strategist Laurel Papworth, 2008 BAFTA winners Hoodlum Entertainment and representatives from Google and other cutting edge innovators and thinkers in global screen media. Gary speaking.
Wed April 29 — LAMPÂ ‘State of Play’ Seminar “Free & Collaborative: Latest Open Source Creative Tools”
Want to run your own Facebook or YouTube? Want to set-up a cool online video festival or manage a complex project online? What are the best, free tools for collaboration, video distribution and marketing? An insightful survey of tools such as Drupal, Ning, Celtx, WordPress, Mogulus, Joomla and many more. Gary speaking.
Thurs/Fri 14-15 May – LAMP ‘Interactive Workshop’ Machinima Virtual Story: The Art & Craft of Machinima
Games and virtual worlds are now being used as creative tools to make a wide range of films from horror genre, comedy to corporate training and education. YouTube, Machinima.com and scores of other video portals are filled with examples of these new forms of virtual storytelling and some are now being commissioned by mainstream TV. NBC aired a CSI episode in 2008 featuring machinima made in Second Life and HBO recently acquired the machinima series ‘Molotov Alva’.Â The seminar will explore the vast range of machinima made with console, PC and online games. It will also look at simple forms of film pre-visualisation now possible using games technologies. The intensive workshop will provide a hands-on introduction to the tools of machinima and the opportunity to work on a short project. Participants are encouraged to bring along a pre-recorded soundtrack (including voice and/or music) to use as the basis for their project. Gary facilitating and speaking.
Wed May 27 — LAMP ‘State of Play’ Seminar “Massively Multi-Storyteller Online Worlds”
Virtual worlds and online games are primarily used for role-playing but they can become host to your own narrative worlds. This session looks at how to locate, take-part in or build rich story environments inside shared online spaces. Gary facilitating and speaking.
8-10 June Banff TV Fest Canada – Still discussing speaking and mentor role!
17-23 JuneÂ Games and Entertainment Technologies Conference in Algarve Portugal
Keynoting at theÂ Game, WAC and Informatics conferences (www.gaming-conf.org, www.wac-conf.org and www.informatics-conf.org). The Keynote will look at major trends and futures ofÂ eLearning, Intelligent Systems, Wireless Applications, Games, Creative Industries, ICT and Society, Computer Graphics and IHCI.
24 June – LAMP ‘State of Play’ Cinema 2.0
Stereoscopic 3D, interactive cinema, games in cinema. Where does the future lie for cinemas and other public screen spaces? Gary facilitating and speaking.
Thurs/Fri July 2/3 – LAMP ‘Interactive Workshop & Seminar’ “The Social Media Campaign: Connecting with your audience”
Aimed at anyone who wants to promote themselves, their product or creation into communities. A workshop looking at how to understand the new audiences, build traffic and loyalty that goes way beyond uploading a 9 minute short onto YouTube but looks at techniques of engaging with online events, social networks and DIY social media. The workshop will examine case studies of successful campaigns from producers and creators doing it for themselves.
Led by Laurel Papworth who is a Power150 media blogger (global – AdNews) and in the top 5 media bloggers for Australia (B&T). She has been teaching for 20 years, mostly in the area of online communities and virtual communications. Laurel is the senior social media strategist in Australia, consulting to companies, not for profits and government departments in Australia, Asia and Middle East including: Middle East Broadcasting (Dubai/Saudi Arabia) – Channel MBC4, Telecom New Zealand, , Fairfax: RSVP Dating Community, Sony Corporation, Universal McCann Erickson WorldWide, CHANNEL TEN: including Australian Idol community, Sulake: Makers of Habbo, Macquarie Leisure, Macquarie Media, New Holland Publishing, Australasian, Performing Right Association (APRA), Peoplebrowsr, MySongcast.com unsigned bands community, Australian Businesswomens’ Network, Pink Sofa online community, ABC Australia, National Archives of Australia (gov), Department of State and Regional Development (gov), Department of Primary Industry (gov), Australian Film Television and Radio School (edu), University of Sydney (edu, public), University of Western Sydney (edu, Masters program).
What is Mixed Reality, why is it relevant and has TV become it’s background medium of choice for larger numbers of media consumers who around the world are spending more time in online pursuits than glued to the content breaks in-between the advertising slots of commercial TV. How will TV survive in a world where social and gaming worlds are far more compelling?
Latest video above available as a download (with better audio & creative commons) 50MB MP4 click here
I am up at the SPAA conference in the Gold Coast producing at and speaking on one of only two panels, for TV and Filmmakers, that are really focused on the ‘creative’ vs biz only possibilities of games and virtual worlds and (that oft misused term in these circles) New Media (that internet thang). The topic of our panel is “Where Virtual Worlds Meet TV, Where Films Meet Games” and features SilkCharm aka Laurel Papworth, Keren Flavell aka SL’s Starr Sonic (SLCN.tv)Â and truna a great games evangelist and IGDA leader hailing from Brisbane.
This topic is driven partly by a mass fragmentation and a paradoxical reversal of fortunes at the moment – where TV itself is the actual snacking medium and where the longer form immersion is in online communities, virtual worlds and games. But can the mediums truly cross-over?
I have been talking for a couple of years now about the fantastic potential of the live and by implication shared TV experience to be enhanced by extending the world into online games. Where are we and where might we be in a few years once the ‘broadcasters’ realise that keeping an audience involved in the ‘IP’/programme in-between airings is a good thing. Good for the story creators, the latent creative audience and of course advertisers who need eyeballs/hands/ears/minds. Some older Personalize posts on this topic.
Anthony Zuiker creatorof the CSI franchise was at one point going to join my panel and his perspective is critical in this:
“The advertising model for TV is completely broken top to bottom. I’ve lost 20% of my viewership in a year and a half… where are they? They’re on the web and other platforms.” Despite a “revolution” in television that now delivers some of the highest quality programming in the history of the medium…Zuiker believes that the “technological boom” happening concurrently is negatively impacting the popularity of the medium.
A part of the SPAA panel here on the Gold Coast, is looking at the issue of where TV and Virtual Space ‘will’ cross-over, not some wacky installation in a dark art gallery but a new emerging element of the entertainment industry where film and games are joined at the hip and TV and social virtual worlds work in glorious real time – live broadcast driving and linking to highly social environments, what Interactive TV has always tried to be. FYI here is the synopsis of my panel “Where Virtual Worlds Meet TV, Where Films Meet Games”.
“Which side of the wall are you on? Are you ready for the Mixed Reality, Entertainment Perfect Storm? TV and Film OR Games and Virtual Worlds? That wall is about to crumble. This is a wake up call to all entertainment producers and consumers to prepare for an almighty collision. Audiences are already spending up to four times as much of their entertainment time in virtual spaces than they are watching TV. Gary Hayes says “I think we are really approaching a perfect storm, a mixed reality perfect storm, because we are seeing several things happening. The first one is a long history of games based on TV and films. Another ‘wind’ is virtual worlds, particularly the exponential growth of customisable social spaces and the important ability to integrate external media into them. The third force is audience behaviour, who involved in far more simultaneous activity particularly between broadband web and TV. The fourth element to this perfect storm is actually what is happening to TV and film, such as live reality TV becoming more game like and now over 100 feature films in production based on game worlds. All of these forces together are creating a really potent mix that all producers need to be aware of”
What is Mixed Reality?
Mixed Reality is a term that needs a more focused definition, as I believe it is also misused. So I see Mixed (or Cross) Reality as
“a creative or social activity that takes place simultaneously in real and virtual worlds and where the interaction in each are resonant and dependent on each other”
So typical practical examples – a conference that has active audiences in the virtual and real world and both communicate seamlessly with each other or where a kids TV show is broadcast while children collaborate in a virtual world and appear to help the progression of the story or a film on a DVD with clues that as you watch it allow you to progress with other players in an online game. But there is also another key aspect of cross or mixed-reality, that of virtual “˜things’ appearing around us in real physical environments. This is often called “˜augmented reality’ but I believe it sits under the broader “˜mixed reality’ umbrella.
Some folk also call this form ‘blended entertainment’ – but to me that doesn’t specifically suggest virtual space and is more related to the already out-dated ‘cross-media’ RIP (hello – Social Media Entertainment) or Extended Entertainment, which is more in my Level 1 or 2 cross-media definition on Wikipedia.
About the Mixed Reality Compilation Video Above
I think the potential of this two-way flow is significant for education and business but also for entertainment and advertising/marketing. So I put together the short film above that hopefully captures a sense of where we are with this circa 2008. I wrote a rather rushed voice over for the short film, a kind of pretrospective (writing back from the future) looking at a “Dawning of Mixed Reality“. As well as my music and voice over (apologies, it was done at 1am a few days ago)Â it contains many choice clips trawled off YouTube but also quite a few that I have worked on at LAMP, the Format Factory, BBC and various other hats.
Is this reality? Is this fantasy? In 2008 the great transition truly began. Whereas a decade earlier we used to “˜log in’ to cyberspace, now we began to semi-permanently inhabit virtual space and the digital world started to leak out into everyday life. It began to infiltrate our shopping malls and became integrated with our everyday lives. Humanity started the relentless journey towards the natural future where virtuality became a greater reality,Â and where digital fantasy and organic reality were inextricably intertwined.
Through the early 2000s pervasive wearable computing started to break down the walls that used to separate our virtual existence from our physical one. This same technology also allowed us to embed ourselves seamlessly into virtual worlds which is where we could truly experiment with future forms of entertainment, art, education and business.
In these new places we became the real time, living celebrity. Many of us became avatar stars, pixel gods – exalted as those linear film and TV icons. This became the only place for many. By 2007 hardcore gamers were already spending fifty five hours per week “˜inside’ these shared worlds and learned to forgot about the real world. This became the place where their most meaningful hours were spent. Everyone began to blend the two domains, combining them in new ways, driven by an invisible urge. Thus started the global meshing, of today’s mixed reality.
But in 2009 questions were asked. As in the many films that hinted at our transhumanist future, would the physical embodied self ever become redundant? Would we truly evolve as self contained, digital entities? May we as well be slumped in a chair with a cable plugged into our heads? Regardless, as the real world became inhospitable we all started to crave for the immersion and began moving our physical selves into these spaces. Even more than that we wanted our peers our un-virtual audiences to be able to share our experiences there. It became a contagious as the most poignant moments and memories were the ones in virtual space.
But we needed to look beyond these screens and into our own souls. Find the truth written along the “˜thin white line’ that separates analog from digital, person from avatar. This was the beginning. It always was. As far as the meshing or blending of reality and virtuality, in 2009 they were the equivalent of grainy black and white movies seventy years earlier. Our experiences were simultaneously part real, part virtual but it didn’t matter which was which anymore. Both were valid and they depended on each other. Those early parallel existences of twenty years ago started to move humanity forward, released our imaginations and we coexisted with our precious and ultimately fragile, physical selves. The great crossing had begun.
I was particularly interested in several new developments that are allowing “˜minority report’esque’ eye-catching. holographic human figures into real space. You will spot these in the film, the live Telstra conference or the models trying on clothes in store windows and closed displays. I tried to list most of the items below and have copy paste some of the text that describes the videos. If there are others you think are significant or that I have missed, please comment and as I do with other compilation films I will be updating regularly, particularly on the download versions.
The various clips in the film are detailed below:
InLimbo Blended Reality – A.M. Architect sits In Limbo to converse and showcase their electronic music. Simultaneously to the broadcast, the show was recreated in the KRTU-Second Life complex, the audio streaming and photos of the studio dynamically updating
Gizmondo Augmented Reality Game – Catapult. Please not this was never released it was in development when Gizmondo went under. There is no sound on this clip.
Motion Capture & Augmented Reality. Virtual Dancers Part 1- A good sign the tracking is okay is that all this has been obtained on the first test and with no feedback for me when I held the camera. In brief, as long as it is a bit smooth, the real-time tracking is okay.
Tim Johnson’s presentation was held at the Centre for Digital Media at Great Northern Way Campus – home of the Masters of Digital Media program. The event was simultaneously broadcast in Second Life at the school’s virtual world campus located at University Project.
A re-invisioning of a 1916 Italian Futurist film using Second Life Augmented Reality Technologies, being developed at Georgia Tech. The short film is a hybrid live action and machinima captured in real time. There are no use of Green Screens. Pos-production is not used to composite the Second Life image and live image.
Aussie talkshow host Rove McManus made history yesterday at Auckland’s Vector Arena as the first person to have his hologram beamed across the Tasman. Multiple cameras beamed his three-dimensional image from a studio in Melbourne to the paper-thin Auckland screen, accompanied by sound effects from Star Trek’s transporter beam, enabling McManus to have a live discussion with Telstra-Clear chief executive Allan Freeth.
2004 Video, computer, pneumatics. A stack of books sits in a chair and, on them, a monitor abuts a small table. The surface of the table holds water, forming a small rectangular pool in front of the monitor. The monitor depicts a woman’s face, her chin resting on her folded hands.
au.youtube.com/watch?v=Jd3-eiid-Uw – Using the infrared camera in the Wii remote and a head mounted sensor bar (two IR LEDs), you can accurately track the location of your head and render view dependent images on the screen. By Johnny Chung Lee, Carnegie Mellon University. For more information and software visit johnnylee.net
Larngear Technology’s story in the research and development, designing, and marketing of Mixed Reality technology is well describe and illustrated in the TV program Clickzone, supported by SIPA. The show is hosted by Tai, Chutima, from the movie Season Change.
More to come…
There are several companies around the world developing Cross-Reality forms. One that I am heavily involved with, The Format Factory, are pioneering formats that bridge the space between compelling participatory TV and online game worlds. This is a kind of teaser video I created that metaphorically demonstrates some of the ’embedded’ world-within-worlds. Their sister company The Project Factory have been doing some basic but interesting cross-overs in Second Life too.
I also talk in more detail about Mixed Reality potential in this early 2006 seminar, here are the slides from that one containing many cross-branded vs cross-reality examples.
I will leave the final word again to Mr ‘CSI’ Zuiker who instinctively points out that particpant audiences expect to be involved in the story, to be the hero, the villain and to feel they are partly in control of their own personalised route through it. Customisable and game worlds with existing culture are the best tool at film and TV makers disposal.
“In the gaming area, you want to give people tasks, to shoot things and upload pictures… You’re doing this because you want these people to be creating their own story and it will be part of the crime on the broadcast… Even if it’s not the actual thing I shot, I was part of that experience, that community, that narrative.”
PS: BTW I think the term ‘participatory audience’ used in the title of this post/article, is a bit of an oxymoron. Audience as a term suggests passivity not participation…but I am sure you will let me off for that one?! Please.