Research and Development at Jaunt: Imaging Technology

Solmaz Hajmohammadi, Senior Software Engineer, PhD, Michigan Technological University — background in Image Processing, GPU Computing and Computer Vision.

Jaunt’s story began with building 360° cameras, from only a single GoPro and a few Legos. From this, the award-winning Jaunt ONE was created. Since then, we have shifted our focus to software based solutions and new products, including exciting augmented reality applications that leverage our extensive sensor and camera development experience.

Recent developments in artificial intelligence (AI) have increased the demand for depth sensing with practical applications in every industry sector. This last decade brought on greater advances in range sensing, with the improvements of the characteristics to make full-range 3D data available at high-resolution. Depth sensing is the way to unlock the next level of augmented reality (AR) applications. Think about it in this way; our environment is multi-dimensional, and the first step to actually augment this reality is to capture it in its entirety.

Among the vast options for depth sensors, trade-offs exist between resolution, range, cost, and accuracy. There are traditional approaches for depth sensing, such as stereo vision and structured light, on one hand, and more novel range imaging techniques, such as Time-of-Flight (ToF), on the other. A structured light camera will project an active pattern onto a scene, then, by interpreting the geometrically distorted pattern from different perspectives, that information can be used for depth reconstruction of the surface shape. Whereas, a ToF camera measures the time that light has been in “flight” to estimate the depth.

We have partnered with several companies that develop some of the best depth-sensing technology in the world to bring everyone’s reality to AR. Real-world issues, such as different or extreme lighting conditions, camera pose estimation, geometric distortion correction, temporal and spatial noise, etc, present other challenges besides depth accuracy. Here at Jaunt, we have been developing hardware and software solutions with the goal to explore beyond the limitations of sensors, in order to achieve improved data quality. Utilizing each sensor’s strengths, and fusing the received information, allows us to greatly advance the quality of our AR applications. With these advances and the exciting new technologies we’re able to leverage, the horizon for Jaunt’s imaging technologies is now even brighter and clearer than ever.

This is the sixth post in a series of blogs from the Jaunt R&D team that will share more about the problems we are solving and how we’re working to help build the future of media. Stay tuned for our next update on the Jaunt Blog.

Interested in joining us? Explore job opportunities with our R&D team here: https://www.jauntvr.com/careers/