Can we make driving using teleoperation safe enough? 

The shift towards autonomous driving and teleoperation will raise a lot of questions around safety. One way to argument for safe teleoperation is to bring into evidence that the visual experience for the driver is as good as in real life, but that a digital screen can provide the driver with safety features not available in real life.

How do we create a visual experience equal to real life?

Voysys solution

Need


  • 180°+ spherical or cylindrical dome projection

  • Pixel-perfect edge blending of projectors

  • Natural FOV

  • Field Of View should be the same as in real life


  • Camera calibrations

  • Lifelike dome projections

  • Correct perspectives

  • Objects should appear with same size as in real life


  • Camera calibrations

  • Lifelike dome projections

  • Correct perspectives

  • Objects should move with same speed as in real life


  • Passive Stereoscopic 3D

Active stereoscopic 3D is available for VR headsets and computer screens.

  • Depth assessment should be the same as in real life


  • Support for most of the fast cameras on the market (Voysys is camera agnostic)

  • Fast encryption

  • Latency-optimized adaptive streaming

  • Fast decryption

  • Fast 3D rendering and projector blending

  • Fast projectors (low input lag)

  • Glass-to-glass latency well below 100 ms over 4G/LTE

  • Latency should be minimal


  • Video area optimization

  • Automatic bandwidth seizure over 4G/LTE and 5G

  • Encryption

  • Perceived picture quality must be good enough


NOTE! We believe that 5G coverage is a prerequisite for mass-deployment of safe teleoperation (due to it’s Network slicing capabilities and higher uplink bandwidth). Low-volume teleoperation can be done over 4G/LTE in areas where bandwidth can be secured.

 

Are there safety risks in real life that could be removed by technology when using teleoperation?

 

Voysys solution

Problem


  • 360° video coverage

  • Real-time video stitching

  • Hidden angles


  • Camera positions outside obstacles

  • Real-time video stitching

  • On-vehicle obstacles


  • Night-vision cameras

  • Rendering of sensor data on top of video

  • Darkness


  • Ultimate camera position per driving situation
    Example: Camera position backwards while driving backwards

  • Fast switching between driving positions

  • Video area optimization per driving position

  • Bad driving positions


 

Can a large digital screen help increase safety?

 

Voysys solution

Idea


  • HDMI inputs for overlay rendering

  • Chroma key to key out backgrounds from HDMI inputs

  • Editor for overlays’ scaling and positioning in 3D space.

  • Hide/unhide function per overlay

  • Scene concept for creating “presets” for digital driving environments

  • Plugin-architecture for dynamic insertion directly into the Voysys 3D render engine

  • The driver should never have to look at a second screen that could steal his attention from the driving direction

  • Additional information such as speedometer, clock, navigation, media, settings should be rendered as overlays close to the forward direction

  • Overlays should only be visible when needed


  • Plugin-architecture for dynamic insertion directly into the Voysys 3D render engine

  • The driver should be warned about safety risks

  • The direction of the safety risk should be communicated to the driver (for example by rendering graphics in the correct direction directly on the screen)


  • Plugin-architecture for dynamic insertion directly into the Voysys 3D render engine

  • The driver should be given better assistance in driving and applying to laws

  • Augmented Reality features should be available on the screen