As promised a more specific ‘commercial’ follow up to my previous post on this topic which was more ‘story’ centric. I am developing and producing a range of Augmented Reality (or if you prefer AR, ‘blended or layered media’) applications at the moment. I have also been asked to present at a few conferences and create a detailed white paper on the implications of AR for government & business looking at privacy, legal, copyright & crime issues. As readers of this blog will know I also lecture, run workshops and work with creative teams to come up with future ‘social entertainment’ based around virtual worlds and augmented reality.
But the purpose of this pretty detailed post is to simply list and try to categorise the many types of business Augmented Reality apps appearing in the market and to try to identify opportunities.
Augmented Reality Business by Gary Hayes
According to wikipedia, the first manifestations of AR appeared in the late 60s, became real in the 70s and by the 90s were already being used by major companies. Now portable computing is finally powerful enough to deliver AR to anyone who has a smart phone or latest generation PC or console. For those unfamiliar here is my simple definition of Augmented Reality.
Information, 3D models or live action blended with or overlaid onto the physical world around us, in real time. A camera & attached screen is used to view the combination of real world and metadata or rich media. Devices or systems commonly used for AR include:
- Mobile devices with inbuilt cameras such as iPhone, DS Lite, PSP or Android
- A head mounted display HMDs (eg: glasses or futuristic contact lenses) attached to a wearable networked computer
- A PC or Mac with webcam
- A games console with camera accessory
- A large TV screen with advanced Set Top box and Web cam
- Others in development
There will be hundreds of business, marketing and educational applications alongside the many 1st generation entertainment examples currently emerging. As usual the video game and porn industries are pioneering the research and development of the technology but we are about to see a plethora of more mundane utility & life enhancing applications about to swamp the market. Combine this with hundreds of space cadet ‘toys’ and viral fluff and we start to see the beginnings of a large industry. Of course the usual caveats apply but unlike say virtual worlds which suffered from too much early hype, these apps are much more accessible to anyone with a decent smart phone, up to date games console or computer with webcam – there is a big difference. All open content currently across the internet has the potential to be used in AR applications and fundamentally in the near future non-geo sensitive content will be perceived as incomplete.
But before going onto my list (which is of course non-exhaustive) here are my basic types of Augmented Reality from a slightly technical perspective but which we can apply to commercial and marketing applications. My presentations and paper have much more detail with specific case studies of each.
GARY’S FIVE TECHNICAL TYPES OF AUGMENTED REALITY
- Surface – The most understandable form of ‘reality that is augmented’ would be screens, floors, walls etc that respond to the touch of people in them providing them with virtual real time information or collaboration
- Pattern – The AR system performs simple pattern recognition on a shape, marker (usually on a framed card in the real world scene) or face and replaces it with a static or moving element e.g: a 3D model, info, audio, video stream or loop etc: You view the ‘items’ in the scene with you
- Outline – This is where your hand, eye or body outline is picked up and seamlessly ‘merged’ with the virtual elements. Simple example where you can pick up a 3D object that doesn’t exist because the system is tracking your hand outline.
- Location – Based on detailed GPS or triangulation location & position/view of the camera/device the AR system can overlay information precisely over buildings or people as you move through real space.
- Hologram – Using ‘smoke & spinning mirrors’ literally in some cases, virtual or real items are ‘projected’ into the physical space you are in and can be interactive with based on cameras tracking real world impulses e.g: hand gestures or audio signals
Before the more detailed list I embed my summary flickr chart whose purpose is to try to categorise types of business orientated augmented reality apps so to identify opportunities. The graph places 16 on axes of commercial value (likely revenue or marketing potential) vs adoption (scale of popularity vs a niche, client user base). It is a starting document to aid classification of this emerging commercial sector that I hope you find useful. The AR types, color key linked to each model is suggestive only. (Click on image for enlargement over at my flickr pages)
Below are longer descriptions of my top 16 Business Applications/Models for Augmented Reality and I suspect I will develop twenty more before the day is out! I have tried to break up some of the big AR areas such as ‘locative AR’ and separated them into several opportunities. This is an exercise looking at the marketing or commercial ‘intention’ vs a traditional pure business model, broad approach. It is a starting document to aid classification of an emerging commercial sector that I hope you find useful.
- IN SITU: Aiding sale by seeing projects & products placed in the environment before completion. The benefit of a customer or client seeing a finished project, before it is complete. For example 1) real estate agents can scan and show an empty house full of stylish furniture or 2) an architect who can show the billion dollar client the skyscraper as a model perfectly aligned with the other buildings on the empty site and 3) Customers who want to see what the clothes look like on ‘them’ (as in the Zugara video above and Cisco below). The list of applications goes on.
- UTILITY: Selling life enhancing AR applications perceived as useful. Development and commercial sale of applications such as underground train orientation, bus stops & times, traffic alerts, airport gates & plane arrivals etc: all overlaid in real space. Sometimes called AR browsers as they cross reference what or who you are looking at with anything or everything off the web or like this UPS example allows you to see if your ‘stuff’ will fit the ‘virtual’ postal boxes.
- TRAINING: Hands-on with complex equipment and work scenarios. Using ‘outline’ recognition this allows us to be virtually ‘hands-on’ with complex equipment in difficult-to-practise work scenarios. Bomb disposal, surgery, flight simulation. . Indeed according to wikipedia the actual phrase Augmented Reality was coined by Tom Caudell in 1992 while at Boeing where workers trained to wire aircraft on AR systems. A massive industry for the developer community charging b2b rates.
- SOCIAL GAMING: Both connotations of the word, pay-per-play mixed reality games in physical space. The potential to run pay per play (e.g: virtual paintball style) games in physical location and also live connected betting on sports or other competitive play – e.g: You point your iPhone at the horse and wirelessly place a bet – mid race! (odds adjusted of course) or using basic surface AR you play with others in a new kind of ‘games’ room!
- LOCATION LAYERS: Blended guides to new places, tourism, enhanced travelling or themed space. For travellers just arrived at your city, theme park or other experience you can provide them with pay for tools that will help them take the most ‘mutually beneficial’ route after they arrive. Free data from wikipedia, local bloggers or more commercial entities add depth.
- VIRTUAL DEMO: Display to promote sale, of product in pre-release or remotely via catalogue etc: To promote advance sales before the consumer gismo hits the stores, an AR display or the device/s so potential customers can manipulate it, see it from all sides, even customise the order. We may see future stores displaying the majority of items on the shop floor as AR while the item is shipped to your house before you get home! The reverse of this, an AR catalogue (as in the Ikea video below) that pops up models to help you build or see the product in 3D.
- EXPERIENTIAL EDUCATION: Pay-per-visit educational services to museums, ancient sites etc: Pay-per-visit (ppv) to visit highly experiential museums, theme parks, zoos, ancient sites or exhibitions but with a higher purpose of providing deeper levels of information & visual sense than a simple plague or hard to follow guide book ever will. The sleepy animals in the zoo come to life, the ancient fossil is animated into an overlaid Google Earth, the Battle is enacted ‘on the original battlefield.
- ENHANCED CLASSIFIEDS: An AR directory that promotes local 3rd parties product & services overlaid at the location. One of the obvious apps where someone in a city or town looking for a specific item could be ‘guided’ to it. A very affiliate model where the company that owns the Augmented Reality listing mechanism will take a slice of any fulfilled sales. A lot more to this of course.
- 3D VIRALS: Branded company or personal promotion & ads using ‘cool’ 3D toys. Pattern based 3D model that entertains and is spread virally. The YouTube moment as a million links to cool ‘3D stuff’ that takes place next to you. Already we see some AR apps that allow you to record scenes of you interacting with said ‘3D viral’ and pass those around too, titillation, quirky giveaways– JibJab-type, put ‘you’ in the cartoon but revered, they are with you in 3D space.
- PERSONALIZED SHOPPING: Walking around stores made relevant, opt in personalization and targeting. The oft mentioned Minority Report example. But in the pulled model, here you can deliver information to potential customers scanning stores, streets or shelves for discounted or personally relevant products.
- COOPERATION: Service industry for augmented virtual meetings. We are all familiar with video conferencing, a few have dabbled in 3D virtual world get togethers but AR meetings are a game changer. The potential here using ‘discrete’ personal screens is to have the inevitable remote meeting with live feeds of your colleagues, blended into your room – pay-per-ARmeet
- BLENDED BRANDING: The equivalent of hoardings, virtual poster ads. Once given a reason to be scanning outdoor areas with their AR devices the potential to deliver topical, timely and relevant ads or branding into the scene. Again care must be taken as AR spam (like social network spam) will quickly irritate, but like free to air TV, using various sponsored or freemium biz models will mean a certain amount of branding will be acceptable.
- AUGMENTED EVENTS: Pay-per-use of enhanced sport or pop concerts. At live events spectators can pay and then scan their view of the ‘match’ for the latest information on sporting achievement or pop star gossip and of course tracking trails or watching replays in situ, merged over say a static real sporting scene.
- INTERTAINMENT: New form experiential TV and films. Following on from my ‘AR story’ post, we know people will pay a premium for a new kind of ‘film’ experience where you ‘live the experience’. How about one that plays out at ‘your’ place. Semi customised marker or location AR apps will layer Brad or Angie into your lounge, onto the coffee table or your ‘composited’ in real time into the latest Mixed Reality TV show. Combined with 3D viewing technology will make Blu-Ray seem so 18th century.
- UNDERSTANDING SYSTEMS: Creating AR for internal or exploded views of complex objects. Primarily useful in training or helping sell something where physically taking it apart is not possible a view of a car or other complex object can be enhanced. Labels or even an exploded view in real time can help get the message across.
- RECOGNITION & TARGETING: Pushing ‘relevance’ to outdoor consumers – facial recognition linked to online data. To be used with care! It will be interesting to see how privacy laws affect this but in a pushed model you could ‘scan’ visitors to your store, identify their faces, do background links to their ‘social networks’ followed by personal targeting while they are shopping. We all know this is going to happen!
Some examples:
CISCO’s future of shopping
BMW Future of Car repairs
Augmented Reality in Marketing and Sales
James Cameron’s Avatar – Augmented Reality Entertainment
IKEA’s Future Augmented Reality Catalogues
To finish a few lines that describe one of my presentations coming up that acts as a nice conclusion…
It has been called the future of social mobile networking, experiential marketing and entertainment, Augmented Reality is about to snowball. With hundreds of apps launching onto iPhones, Games Consoles, Advanced TV and your PC this new technology allows us to view our world in exciting new ways. Once the domain of science fiction or super computers this new technology, blending the real with virtual, is now literally in the hands of everyday consumers and business. Augmented Reality is simply using a camera with screen to layer rich media and information over ‘our’ real world, in real time so we can now scan and layer web info over products and people in the store or street and provide virtual, ‘in situ’ hands-on demonstrations and deliver the ultimate ‘guide’ to our complex physical world. Is AR the new 3D viral experiential marketing or another temporary fad?
Finally, finally for those interested here is my Augmented and Mixed Reality YouTube playlist if you have an hour or so to spare to view the current collection of 60 +
































































{ 79 trackbacks }
{ 39 comments… read them below or add one }
Group: Building Mixed Reality Educational Apps for Second Life
http://second-life-tool-ranking.ning.com/group/buildingmixedrealityeducationalappsforsecondlife
[Reply]
I’m looking forward to examples of AR usage and AR ethnographic studies. Not quite sure if AR is so compelling within date rich real life situations but that’s just a hypothesis.
[Reply]
The example focuses on making synergy between the code and communication, playing with the concept of the name of the site, the incentive to enter the application and discover the offer.
http://www.youtube.com/watch?v=L_SABE2fBFo
[Reply]
Hi,
I am doing a design thesis on Augmented Reality 3.0 and looking for opportunities to push an open sourced educational portal on the web
information regarding the topic can be viewed here
http://augmentedr3pt0.wordpress.com/augmented-reality-branding/
i’d greatly appreciate any support and honest feedbacks
thanks
Sean
Sean Lee´s last blog ..the social media revolution
[Reply]
Wow. Fascinating. I like the personalized shopping, but of course I would, and In Situ is amazing idea too.
[Reply]
Another good example of pay-per-view AR educuation/entertainment: http://www.DigitalBinocularStation.com – a 3D stereoscopic, coin-operated Digital Binocular Station for use in cultural and tourism locations. It is essentially an Augmented Reality device, but because it is fixed to a single location, we have been able to use photorealistic, cinema-quality visuals, and compensate for the lack of parallax by presenting everything in stereoscopic 3D. While we have done traditional end-user and installation-based Augmented Reality in the past (www.GetImaginality.com) this use-case demanded a different approach that could be highly robust and secure, very easy to use, no staff ovearheads, small space requirements and complex visuals.
[Reply]
Hi,
This is really a great stuff for sharing. Keep it up .Thanks for sharing.
Assignment Writing
This comment was originally posted on Techno Constructivist
[Reply]
I truely enjoyed your Videos. I am waiting for your next post, for more videos. Thanks
GCSE coursework
This comment was originally posted on Techno Constructivist
[Reply]
Hi,
Nice info at this post thanks!!! I really like it.
Dissertation Service
This comment was originally posted on Techno Constructivist
[Reply]
I am working on a project presentation for Augmented Reality in an Enterprise environment. Do you know of any applications which are already in use in an enterprise. And what would be the value-add for adopting this technology.
[Reply]
Gary Hayes Reply:
December 2nd, 2009 at 9:46 am
Hi Tyler – I would say AR has been used behind closed doors in a variety of industries for the past decade – from car manufacturer to health. I am aware of some financial services and other white collar businesses starting to use it for ‘information modelling/sharing’. This really comes down to the type of enterprise though. Any location business (tourism, real estate, shopping) really benefits from providing or receiving layered information over the scene through to companies with complex systems providing overlaid step through guides for trainees (machinery, IT systems etc). As is usually the case there is a difference between Enterprise AR and consumer AR and the consumer side is catching up fast. Annoyingly I have done two white papers on the policy AND enterprise side of AR but currently they are exclusive access from the sponsors of them?! That will change and I will post them here
[Reply]
Hi,
This is inspiring; I am very pleased by this post. Nice info at this post thanks!!! I really like it
This comment was originally posted on Techno Constructivist
[Reply]
It won’t change the world: it will augment it!Sorry – couldn’t resist it
This comment was originally posted on Social Media Today
[Reply]
Already I count on the first down line on the screen for football games. Without it, the game is much more difficult to follow onscreen. I’m not certain that I see an application that everyone is going to use for their web site.
For example, I do not have a cam on my phone or computer, and would someone seeing my site have to have this feature to use it fully.
Or are we talking about taking a product and showing it in 3D on the site without any augmented equipment on the part of the user.
In other words, it may be that the upper 5% of users would be able to understand how to use AR, but what about the bottom 95%?
If like the football game a person can just passively enjoy the commercial, like with the GE demo, that would be good.
On the other hand, I didn’t really understand the benefit of the 3D wind power generators. Why wouldn’t a nice film of the same scene be just as good?
OK, I’ll be quiet until I know more.
This comment was originally posted on Social Media Today
[Reply]
Hi again.I have contacted the folks who sponsor the social media site attached to this blog. It appears to me that by signing up, I have lost the capability of being credited with a backlink for my blog.I am not sure that that is the case. However, when I was logged in, the social media site didn’t allow the passthrough to my blog.I am confused easily by these kinds of things, and there was no explanation regarding the "consequences" of a membership. But the first thing I noticed, I didn’t like.Therefore, I sent an e-mail.
This comment was originally posted on Social Media Today
[Reply]
I have done some additional research and the AR seems like a neat feature for the future.As an older person without the funds to purchase either an iphone or web cam though, I don’t see it impacting my ability to communicate much with the outer world.My phone has text messaging, and that’s it other than a ring and buzz when a call comes through. It came free with the service and that’s the level I can afford.With regard to this comment, I would very much prefer the first comment to be done anonymously rather than the way it ended up.I see no advantage to becoming part of the social community that signing up allows, and I am sorry I went through that process. Just deprives my favorite hobby shop of a backlink and transfers it to the community without explanation.Thank you for the AR comment. It is very smart and very well written.
This comment was originally posted on Social Media Today
[Reply]
Hi Beth, Thanks for your comment! Well, the practicalapplication of augmented will be more popular in e-commerce sites, where youcan change colors or shape of product or try it on yourself. Nevertheless itcan be used for branding (Esquire example) to create richer buying experience.Of course, the technology will have to there in order to experience all thepossibilities of augmented reality. I don’t see such a big issue with nothaving a camera as most of new phones, laptops, pcs come with integrated one,but compatible software will have to be developed in order to make sure that wedon’t need to download hundreds of different apps to use the technology andthat bottom 95% become 5 %. There is still a lot to be done before we start trulyenjoying this new trend, but it may come sooner than latter, so we ascommunication specialist have to be ready for that change.
This comment was originally posted on Social Media Today
[Reply]
Hi Beth, Thanks for your comment! Well, the practicalapplication of augmented reality will be more popular in e-commerce sites, where youcan change colors or shape of product or try it on yourself. Nevertheless itcan be used for branding (Esquire example) to create richer buying experience.Of course, the technology will have to be there in order to experience all thepossibilities of augmented reality. I don’t see such a big issue of nothaving a camera as most of new phones, laptops, pcs come with integrated one,but compatible software will have to be developed in order to make sure that wedon’t need to download hundreds of different apps to use the technology andthat bottom 95% become 5 %. There is still a lot to be done before we start trulyenjoying this new trend, but it may come sooner than latter, so we ascommunication specialist have to be ready for that change.
This comment was originally posted on Social Media Today
[Reply]
Beth—We haven’t seen an email from you, and not sure exactly what issue you’re referencing, but we encourage all our contributing bloggers to add a link back to their original post if they are cross posting from a blog. You can always get us at smt_support [AT] socialmediatoday.com. Thx!
This comment was originally posted on Social Media Today
[Reply]
Interesting post. I really believe that AR has huge potential for marketing other than just being a fad or novelty. I only posted about AR last Monday after spending a few days researching it. The potential to offer greater information in real time to customers will carry the technology through to the mainstream. I think 2010 will be the year it really breaksthrough as a bunch of brands from Addidas to Hallmark have already stated their intentions to release AR apps.Theres a bunch of examples of what AR can do at this link;http://www.mrlukeabbott.com/marketing/augmented-reality-what-it-means-for-marketing/Regards,Luke
This comment was originally posted on Social Media Today
[Reply]
Great post Luke!
This comment was originally posted on Social Media Today
[Reply]
Hello,
Excellent post, I really enjoy reading this article, thank you so much for sharing it.
Thesis Papers
This comment was originally posted on Techno Constructivist
[Reply]
good stuff.
This comment was originally posted on FriendFeed
[Reply]
1 idea: group buying concept coupled with AR augmented reality. Visitors visiting stores and window shopping, will be able to find items they ‘like’ but are not purchasing right now, can leave their comments and likes as comments visible to an AR-enhanced phone. Then other people liking to buy the same thing team up with the original poster and when the time comes to buy they can negotiate a better price with the physical seller. They will do this by taking their phone and seeing the physical object via their phone camera, and the software coupled with details of their geo-location (GPS) and the place they have checked in (like Foursquare, brightkite, etc) attempts to show other people who also ‘favorited’ the same item but would like to negotiate a better price for ‘group buying’.
Mohan Arun L ´s last blog ..29-Jan-2010
[Reply]
Great share! I have knowledge about craigslist mashups atop google streetview or as seen with iphone camera, this sounds like a comprehensive treatise! Going to read it straight away!
This comment was originally posted on FriendFeed
[Reply]
Hi Mohan – great idea. Sort of crowd source bargaining for the best price for an item. This would work well in stores running down stock or sale days etc: But could even work for a new economic model in some stores. The thing I like most here could be commenting on items. So lets say you bought an item you can then leave what you thought of it ‘AR attached’ in the store for others to see your comment…the store would need to consider tagging items with markers vs gps though as items get moved regularly
!!
[Reply]
FYI – Your “UPS” example is actually USPS. Great example, nonetheless.
[Reply]
Good idea, But could even work for a new economic model in some stores.
[Reply]
this kind of blog always useful for blog readers, it helps people during research. your post is one of the same for blog readers.
Thesis Papers Writing
This comment was originally posted on Techno Constructivist
[Reply]
saya baru belajar AR
mohon informasi alamat dimana saya bisa mendapatkan tutorial AR secara lengkap
Trima kasih atas bantuanya.
[Reply]
16 Top Augmented Reality Business Models: http://bit.ly/Er5C
This comment was originally posted on Twitter
[Reply]
16 Top Augmented Reality Business Models: http://su.pr/7Znk4H Kudos @GaryPHayes !!!
This comment was originally posted on Twitter
[Reply]
Nice article,Thanks for your sharing!
[Reply]
Augmented Reality business models…
http://bit.ly/rFTiD
This comment was originally posted on Twitter
[Reply]
16 Top Augmented Reality Business Models http://bit.ly/aLXozK
This comment was originally posted on Twitter
[Reply]
Augmented Reality business models: http://is.gd/b48Nz
This comment was originally posted on Twitter
[Reply]
ciao, volevo segnalarti l’applicazione di realtà aumentata di idealista.it per gli immobili
siamo nel quadrante "enhance classified"
http://www.idealista.it/pagina/nota-prensa?idNotaPrensa=52
un saluto,
vincenzo de tommaso
This comment was originally posted on Valori Primi Lab
[Reply]
Great post, I referenced it in a post I just completed HERE. One of the most interesting things is the relationship between the Internet of Things and Augmented Reality, they seem to be bound by the same fundamental requirements in both technology and adoption. Thanks for the post.
dave tribbett´s last blog ..Internet of Things: Augmented Reality
[Reply]
http://www.FixMyBusinessProcess.com
[Reply]
Good idea, But could even work for a new economic model in some stores.
and i have one Free B2B Website,How we make this Web site to see better development, thank you.
[Reply]