New tech lets you pull reality onto your computer

by John BiggsMay 4, 2020May 4, 20200

A wild bit of tech now lets you pull real objects out of reality using AR and instantly paste them into Adobe files.

4/10 – Cut & paste your surroundings to Photoshop

Code: https://t.co/cVddH3u3ik

Book: @HOLOmagazine
Garment: SS17 by @thekarentopacio
Type: Sainte Colombe by @MinetYoann @ProductionType
Technical Insights: ↓#ML #AR #AI #AIUX #Adobe #Photoshop pic.twitter.com/LkTBe0t0rF
— Cyril Diagne (@cyrildiagne) May 3, 2020

The whole thing actually works but it’s difficult to enable right now so you’re going to have to wait a few years to pull reality into your computer instantly like some kind of weird Harry Potter wizard.

And again, the OpenCV SIFT trick to find where the phone is pointing at the screen.

I also packaged it as a small python library: https://t.co/en0EyGSklp

Send a camera image + a screenshot and you get accurate x, y screen coordinates! pic.twitter.com/OOCFrrZseZ
— Cyril Diagne (@cyrildiagne) May 3, 2020

Related

John Biggs

John Biggs is an entrepreneur, consultant, writer, and maker. He spent fifteen years as an editor for Gizmodo, CrunchGear, and TechCrunch and has a deep background in hardware startups, 3D printing, and blockchain. His work has appeared in Men’s Health, Wired, and the New York Times.

View all posts by John Biggs →

Leave a Reply Cancel reply