Matterport Brings 3D Capture to Mobile

  • We’re excited by Google’s Project Tango, Intel’s RealSense, and other initiatives to get 3D sensors built into the next generation of phones and tablets. These sensors enable Matterport to bring its high-quality 3D capture and reconstruction to mobile devices.

    The future of 3D media is mobile. As 3D sensors start showing up in phones and tablets, Matterport’s software will be an app enabling millions of people to capture, share, and interact with the world around them in visually rich 3D. We’ve been adapting our technology to these emerging platforms over the last few months, and we have some exciting results to show.

    We felt it was important to make this app extremely responsive and real-time so that users can see a 3D model coming together continuously as they move freely around the space they’re capturing. The capture process is easy, fun, and natural.

  • Early preview of our mobile 3D Capture app

Of course we will continue to offer the Matterport Pro 3D Camera in addition to developing this mobile offering. Think of our professional camera as the 3D equivalent of the sort of high-quality DSLR that any pro photographer would use to make top-quality 3D media like our 3D Showcase™, while the mobile version will be what everyone will have in their pockets for capturing their everyday world in 3D.

Here’s some recent press coverage on our initial mobile demo with an early Tango prototype — Engadget, TechCrunchSlashGear and many others are talking too!

And here is a video showing the first space captured from using a Matterport prototype app running on a Tango device. Or you can explore the 3D model here.

Matterport and Google Project Tango in the News

  • – Engadget: Here’s an early look at Google Project Tango’s indoor mapping abilities Read More
  • – TechCrunch: Here’s An Actual 3D Indoor Map Of A Room Captured With Google’s Project Tango Phone Read More
  • – SlashGear: Google Project Tango demo shows just what 3D mapping can do Read More
  • – Phandroid: This is what a Project Tango 3D map looks like Read More
  • – TechRadar: First look at a 3D map created with Google’s Project Tango Read More
  • – BGR: Video: Here’s how Google’s Project Tango maps indoor spaces Read More
  • – Afterdawn: Here is the first 3D indoor map using Google’s Project Tango prototype device Read More
  • – Engadget:  Google Project Tango 室內建模能力搶先看(影片) Read More
  • – TechCrunch Japan: ビデオ: GoogleのProject Tangoで室内を3D撮影するとこうなる Read More
  • – Computer Hoy:  Aquí tienes el primer render del Proyecto Tango de Google Read More

Don't own a Matterport Pro Camera yet? Buy one today to start creating VR content.

Join the Matterport VR Beta

Matterport is currently beta testing a new service that lets you view your Matterport Showcases on virtual reality headsets. The goal is to turn the interior view of Showcase into an immersive virtual reality experience.

The video below shows the images seen by each eye during interactive exploration, but you need a Gear VR to truly experience the feeling of immersion.

You can already experience publicly available Matterport models on Gear VR by downloading the Matterport VR Showcase app, available now in the Samsung Gear VR app store. This app features a carousel of Matterport spaces, including an art gallery, a national park, and a World Heritage Site.

We strongly believe that mobile virtual reality headsets, in which a smartphone is placed inside a set of VR goggles, are one of the best ways of experiencing VR. Their mobility allows you to carry them around in a small bag, set them up in seconds, and give demonstrations on the go.

As such, we’re currently focused on optimizing our content on the Samsung Gear VR ($199.99, works with Samsung Note 4, Samsung Galaxy S6, and Samsung Galaxy S6 Edge).

An experimental version of our app may also be available on Google Cardboard in the future, but since Cardboard is an open platform, performance on any particular device is harder to guarantee. In general, newer phones should be used for the best experience. Older phones (launched more than a year ago) may not be supported, or may suffer low frame rate, latency, or other issues.

Your Content in VR

We’re inviting Matterport camera owners to get in early on the experience of viewing their Matterport spaces in VR with our VR Beta program, in advance of our mainstream VR app. Participants will also have a chance to give us feedback as we build out the main VR app experience.

At this time, we have limited capacity, so there is a moderate per-model conversion fee for the program. This also covers the cost of manual post-processing to ensure models look their best in VR. Conversion time can be up to two calendar weeks, though we expect turnaround times to drop as we move to a more automated system.

Results will vary based on model quality. Depending on the model data quality, we may choose to turn off stereo in the VR version. This means that distances will “pop” less, but provides a cleaner visual experience and is less likely to cause motion sickness. Models submitted to the VR Beta program should generally have 75 active scan positions (sweeps) or fewer. You can, and often should, thin out scan positions to reduce clutter by selectively removing them from high-density areas in Workshop. A 100-sweep model may look stellar as a 70-sweep model in VR.

If you’re interested in converting a Matterport space into VR, we’re happy to provide feedback on how well it will work. Please contact us by filling out the form below for more details.

Preparing your models for VR:

VR is different from the standard 3D Showcase experience, so you’ll want to capture and edit your scans a little differently. Follow the guidelines below to optimize the experience of your Matterport model in VR.

Scanning for VR:
  • Ensure that the tripod is kept at a consistent height near eye level, and choose scan positions carefully based on where it would feel natural to stand.
  • It still pays to scan densely to improve the quality of your mesh, but keep in mind that final scan positions should be consistently spaced to produce a natural feeling of movement. You can always deactivate extra positions in Workshop.
  • Avoid putting the camera too close to walls where possible. These placements may make users feel claustrophobic in VR.

  • Cover large spaces in a grid pattern with consistent distances between scan positions.

  • Ensure windows and mirrors are properly marked. Models with improperly or unmarked windows and mirrors will not look as good, especially in Stereo mode.

  • Try to capture complete rooms. If capturing open areas or parts of rooms, scan farther than you want users to walk, and then deactivate sweeps beyond your desired boundary so that the mesh extends well beyond the outermost active sweep.

Editing for VR:
  • Duplicate your model when editing for VR. You’ll likely make different choices for viewing on the web versus viewing in VR. If you want to convert an existing model to VR and it’s no longer on your iPad, a Matterport representative can duplicate it for you.

  • When you view your model in VR, each scan position will be represented by a sphere. These spheres will be at eye level. Use Workshop to reduce the density of sweeps, generally only having one every ~10 feet, for a less cluttered experience.

  • In densely captured areas, deactivate some scan positions to thin out the view and allow the user to move at a natural pace. 

  • Ensure that there is a scan position visible in front of each doorway so that it’s easy to move through the doorway.

  • If you did any additional sweeps at very high or low positions, you’ll want to remove these to create a path composed of consistent capture heights. In Workshop you can switch modes to view sweep heights.  This will let you more easily choose which sweeps to deactivate and get a sense of overall sweep density.

In order to view your converted model in VR, you will need to download and install the “Matterport VR Showcase” app from the Oculus VR app store. It can be found under the “Apps” tab in the store. This is a large app, and we recommend downloading over Wifi when possible.

-----

For additional information and pricing, please fill out the form below:

What are you interested in?

Name (required)

Email Address (required)

Company

My.Matterport.com URL of model to be converted (if applicable)

Additional Information