Woof: The Future of Social AR is More Than Face Filters

The following was published in SHOTS in May 2021…. sign up for Greg’s weekly email for stuff like this every week HERE.

We’re at a fascinating crossroads of digital and social marketing, creative technology, and changing consumer habits.

TVs are getting smarter. Mobile ad tracking is being disrupted. Social platforms are all adding audio stories. TikTok is transforming how news spreads. Creators are monetizing like never before. Email is actually popular again.  

And meanwhile, there is a digital and social layer on the physical world all around us, just waiting to be unlocked by our phones—and soon eyeglasses, mirrors, windshields, and more.

source: Hyper-Reality by Keiichi Matsuda

The term “augmented reality” is a boring and unimaginative term for a transformative technology that can detect your face and turn you into a frog. Or learn your room’s layout and transform it into a palace. Or unlock hidden brand content behind a product logo, from a billboard, in a grocery store aisle, or on a pedestrian mall.

Originally popularized by Snapchat filters and Pokemon Go, augmented reality (AR) reached the mainstream without consumers realizing the tremendous nerdy science of machine learning, visual recognition, and 3D modeling required to bring these experiences to life. They just work. By 2025, nearly 75% of the global population, and almost all smartphone users, will be frequent AR users. (Snap, 2021) In other words, everyday consumers have elevated expectations for branded AR, which means marketers need to learn the technology, best practices, and begin to prepare for AR’s future today.

AR experiences create an emotional connection and reason to engage with a brand that is more playful and memorable than traditional ads. Interacting with products that have AR experiences leads to a 94% higher conversion rate. (Snap) It doesn’t matter whether the story is entertaining, social, educational, gamified, or utilitarian because AR experiences are immersive and highly personal, they have a greater likelihood of increasing brand relevance and recall.

AR In Your Pocket, In Your Feeds, In Your Browsers

Microsoft’s $3500 Hololens is a powerful AR visor for jaw-dropping mixed-reality experiences, but most smartphones support AR via the operating system, app, and mobile browser. Nowadays, everybody has a device in their pocket they can use to overlay the digital layer on top of the physical world! 

And since the hardware is so ubiquitous, almost every major platform has introduced these magical AR features—including branded filters and environmental effects on Facebook Camera, Instagram, TikTok, and Snapchat. Amazon’s AR feature lets you view thousands of products in your home before you buy them. Pinterest and YouTube have “try on” features.

source: eMarketer

Facebook Newsfeed now has AR ads where you can demo a product in your home or automobile in your driveway. Apple’s Measure app turns your phone’s LiDAR camera into a stunning accurate tape measure. Google Maps now offers a heads-up AR street view, and Google’s mobile browser results will literally project a 3D object in your space, no app required (e.g., try Googling “horse” on mobile and select “View in 3D”).  

Moving Beyond Face Filters in Social AR

Social AR is going to become even more collaborative and well, social, in the coming year. Apple Clips make scanning your face and space and sharing with friends as easy as pressing a button. Spark AR Studio makes building AR experiences as easy as drop-and-drop on Facebook and Instagram. Facebook’s Oculus is incorporating AR into their social VR products. The creators of Pokemon Go are preparing a new walking-style AR game with Nintendo’s Pikmin, and they just released an augmented reality developer kit that has extraordinary multiplayer abilities – intersecting and your real-world friends with digital and AR world content. 

Gamified brand experiences have always been popular with consumers, but social AR will create an opportunity for interplay between a brand and its consumer that will make a social comment or retweet seem trite. 

Apple’s new AirTag smart trackers will be used for more than just finding your lost keys. They feature an ultra-wideband chip that uses AR tech for precise location finding, which means developers will be able to use this chip to identify and map physical objects in independent AR experiences. Imagine embedding that chip in your product so consumers can interact with it both in the real world and in the augmented world. Launched just this month, Snapchat’s new Spectacles feature AR, and are currently only available to developers and creators interested in experimenting on the platform.

Although Snapchat was the first to leverage the iPhone 12 Pro’s upgraded LiDAR Scanner for AR, the iPhone 13 is rumored to feature LiDAR scanners for all models. LiDAR is the same technology self-driving cars use to “see” the road and identify objects. That technology coming to mainstream phones will create even more opportunities for marketers to build magical experiences in the years to come. 

The future of AR is Smart Glasses

Almost every major tech company is working on smart eyeglasses – Apple, Snap, Google, Facebook, Microsoft –  and all of them include some form of AR. And while you may immediately roll your eyes about the second coming of Google Glass, the patent leaks and use cases are increasing by the month. 

Imagine consumers walking down a busy pedestrian mall and “seeing” customized ads and messages projected on blank walls that they can only see with their AR glasses. Or shopping in a grocery store, where the products on shelves advertise their own coupons. Or a branded pop-up experience that features an AR game played with a brand mascot, or a live band concert “hologram” on an otherwise empty stage.

Of course, there will also be pushback against this type of AR adoption. Concerns about privacy, utility, and not necessarily wanting ads wherever you look with your smart glasses are valid. Some off-the-shelf algorithms have difficulty sensing BIPOC faces or are prone to misgendering, so it’s critical branded experiences are inoculated from discrimination. And you can bet AR graffiti will be a thing. But that’s probably a few years out. 

Although it may be a couple years before we’re living the world of Keiichi Matsuda’s, “Hyper-Reality,” there is a high likelihood that every brand will need to have an AR playbook sooner than later. Now is the time to plan ahead. “See” what I mean?

6 Steps to Prepare Your Brand for AR’s Immersive Future:

  1. What products or services do you need 3D mapped today (and tomorrow)? Establish a process for capturing, labeling, and ensuring proper usage of 3D assets the same way you capture 2D and video assets in your content library. You’re going to need them.
  2. Have you ensured your AR experiences are inclusive? Some off-the-shelf algorithms have difficulty sensing BIPOC faces or are prone to mis-gendering. Ensure your branded experience is inoculated from discrimination.
  3. How can you move beyond branded face filters and raffles? Branded face filters and “What _____ Are You?” raffle experiences have become so commonplace on Instagram and Snapchat that they are ignorable. Level it up for 2021!
  4. What AR ad units should you be testing? Explore Facebook and Google’s AR advertising offers and see how they could fit within your marketing mix. Consider a pilot to weigh performance and ROI.
  5. How can you use social media to highlight AR experiences from your website and app? Brands may find that GIFs and short video demos of AR tools perform better than even static images on social.
  6. When does it make sense to bring AR into your experiential footprint? Point of sale displays, at-shelf, and pop-up branded experiences can all benefit from the immersive nature of AR to give a consumer extra information or a reason to stop and engage.


Social Pulse, Week of 6-8

Every week I keep tabs on what’s trending, new technology and consumer habits that impact the social web. These are summed up in a round-up called Social Pulse.

Sign up for these weekly emails here.

#BlackLivesMatter Brand Examples: See 100+ examples of brands responding to the Black Lives Matter movement, grouped by category.

Google Docs as Social Media: Earlier this year it became apparent Google Docs were emerging as a niche social media destination and tool. Today, Google Docs has emerged as a way to share everything from lists of books on racism to templates for letters to family members and representatives to lists of funds and resources that are accepting donations. And the #BlackLivesMatter examples link above!

SocNet Updates: Facebook News is now live for everyone in the U.S. Twitter has added a feature that suggests you to read an article before retweeting it. Facebook is making it easier to toggle between business and personal accounts in Messenger and is testing adding more insights around comments. LinkedIn is testing a new “Status” option, that appears as a temporary headline. Pinterest is testing Story Pins. Snapchat announced Minis, a navigation bar, plant and dog identification, Bitmoji games, new Lenses and more.

LinkedIn’s Content Marketing in Times of Uncertainty: LinkedIn released a downloadable guide to navigating this period of chaos, including building trust and adapting your content marketing to put your audiences needs first, harmonizing long-term brand strategy with shorter activation tactics, integrating organic and paid content marketing strategy, and ROI. Download here.

TikTok Catching Up with YouTube: TikTok is emerging as a significant threat to YouTube among children who spend more time with online media. Kids ages 4 to 15 spend an average of 80 minutes a day on TikTok, compared with 85 minutes a day watching videos on YouTube, based on a new study.

COVID-Friendly Shopping with AR: With all the shelter-in-place and social distancing happening, consumers are using digital tools to shop unlike ever before. This includes digital couture, virtual try-ons of clothes, and using augmented reality (AR) to create a real-scale 3-D model of a car in your driveway, open the doors and even interact with that vehicles’ voice assistant system.

Ethics of Facial Recognition: Given the increase in surveillance and sousveillance in recent weeks, and Amazon’s new moratorium on use of its Rekognition tool, there is a renewed interest in the ethics of facial recognition. This piece in Psychology Today covers the science behind why our own faces can be an unusually potent advertising tool.

SpaceX Dragon Simulator: Last week NASA Astronauts manually piloted the SpaceX Dragon 2 vehicle to the International Space Station before switching it back to auto-pilot. This simulator lets you try your hand at maneuvering and docking it! Pro tip: movement in space is slow and requires patience and precision. And if you mess up, you die.

Global Tunes: Based in Amsterdam, the Netherlands, Radio Garden is an interactive website and mobile app experience that allows you to tune into thousands of live radio stations across the globe. Key quote: “By bringing distant voices close, radio connects people and places. From its very beginning, radio signals have crossed borders. Radio makers and listeners have imagined both connecting with distant cultures, as well as re-connecting with people from ‘home’ from thousands of miles away.” Listen and download here.

TikTok of the Week: @DiveBomberDave is an entire channel dedicated to a red wing blackbird who dive bombs passersby.

App of the Week: Photoshop Camera is a super powerful app from Adobe that features real-time camera lenses (illustrated, light and AR-based), existing photo editing and more. And it’s free. Download on iOS and Android here.

Viral Video of the Week: Toto’s “Africa” played entire on tesla coils.


Success! You're on the list.