Keeping a close eyes on patents, art and culture helps us know where the trends are headed. In this case, Apple has filed for a patent that appears to enable a host of really amazing features in their video calling app, FaceTime…
The patent in point is a new method of creating augmented reality within a live video chat. Augmented reality is basically the ability to overlay graphics onto a screen, and ranges from the simple scores pasted in the corner of your NFL broadcast, up to the cartoon augmented reality of Pokemon Go.
…
Apple could push things further by displaying alternate–but equally live–backgrounds behind a video caller. It only has to combine the face-on stream of a traditional camera with the stream from a secondary camera that takes in more of participant’s environment to add extra context. You’d be able to see a closeup of your friend’s face within a wider view of the room, café, or park where they were sitting. Conversely, the light field cameras could cut out a video caller’s image and project it onto a different background in true augmented reality style.
So rather than have the scores plastered over your NFL broadcast, your video calling friend’s image could sit there, instead, and you could watch the game on a stream from your computer and overlay your conversation on top of the action. Or, as with Pokemon Go, you could potentially project that cutout over the live viewpoint of an iPhone so it appears that your friend is sitting on the chair opposite you in a café. It’s a much more personal experience than having your friend encased within the confines of a chat window.
Source: Apple’s Augmented Reality Is Coming to FaceTime, Using Light Field Camera Tech – VC Daily
GREG SWAN 