The Real Time Stitching Engine

Carl Zeiss VR One The Real Time Stitching Engine (RTSE) is a software-based solution for the real-time processing of ultra-HD panoramic recordings. The software provides all necessary steps to process a certain number of omnidirectional camera images into an ultra-HD panorama. These steps include for instance color matching, warping, stitching, and blending. The software can simultaneously process multiple HD streams and runs on a single multi-core PC, equipped with commercially available graphic cards.

Moreover, the Real Time Stitching Engine supports various output formats:

  • A low-resolution panorama that can be embedded in a regular HD image; these images allow for panorama previews directly on set, the raw recordings can be reviewed and the proxies can be processed during post-production editing.
  • HD images that can be panned and zoomed within the HD panorama; this technique may, for example, be used in live productions to control critical recording features such as image transitions, to transmit HD component images from the panoramic content to regular transmission environments or to enable the user to navigate in the various interactive applications.
  • Various panoramic HD outputs that can be decomposed into several overlapping HD tiles; this allows for encoding the HD tiles in parallel, in order to transmit the entire ultra-HD panorama content live.
  • The latest development makes it possible to transmit the UHD panoramic content to Virtual Reality (VR) glasses; the spectator is able to enjoy a truly immersive experience.