Oregon Patent of the Month – April 2022

Augmented Reality (AR) is increasingly popular, with systems like Metaverse already growing in popularity. With the growing interest, so grows the technology. Streem, Inc. has been working to develop cutting edge technology to support the AR revolution. 

Recently, they developed the software needed to capture raw AR data and the meshing tools needed to integrate it with what we see in reality. In a simplified explanation, a typical AR system uses APIs to stream frames captured by the device camera in addition to data from the device’s gyroscopes and accelerometers. This data is rolled together into a point cloud which indicates X,Y,Z positioning and tied to a reference point. This makes it possible to place AR objects within a scene and have them appear to belong. There is much more behind the scenes though, as the software needs to create 3D mesh and maps to properly represent the world as it is captured in images.

Streem’s method generates 3D meshes from raw AR data captured contemporaneously with video data. They first create a depth map of the AR data and then fuse this with the real life images on a frame by frame basis to create a full 3D mesh. The depth map creates a volumetric representation of the space in the video, with an individual depth map created for each frame. It’s this volumetric representation that allows for the 3D mesh generation. The 3D mesh is a collection of vertices and connecting triangles. These provide specific locationing capabilities for placing objects or identifying objects. Depending on the AR content, identifying an object can then trigger an AR object to appear. 

The more Streem advances their technology, the more efficient, reliable, and fast the resultant AR imagery.

Are you developing new technology for an existing application? Did you know your development work could be eligible for the R&D Tax Credit and you can receive up to 14% back on your expenses? Even if your development isn’t successful your work may still qualify for R&D credits (i.e. you don’t need to have a patent to qualify). To find out more, please contact a Swanson Reed R&D Specialist today or check out our free online eligibility test.

Who We Are:

Swanson Reed is one of the U.S.’ largest Specialist R&D tax advisory firms. We manage all facets of the R&D tax credit program, from claim preparation and audit compliance to claim disputes.

Swanson Reed regularly hosts free webinars and provides free IRS CE and CPE credits for CPAs. For more information please visit us at www.swansonreed.com/webinars or contact your usual Swanson Reed representative.

Recent Posts