The system will allow you to maintain eye contact with others and make VR-helmets more comfortable for them.
Facebook Reality Labs specialists have proposed to improve Oculus Quest virtual reality helmets with a “reverse pass” system — it should make it clear to others that the VR helmet user is looking at them, and not at the virtual world. The researchers presented the invention for the SIGGRAPH 2021 conference.
Oculus Quest virtual reality helmets have an end-to-end viewing function — it transmits a picture of the real environment to the user instead of a virtual image. But the people next to the user can’t know when he turns on end-to-end browsing. And when the user starts talking to others in this mode, they do not immediately understand what is happening, and they cannot establish eye contact during a conversation — this causes discomfort.
According to researchers from Facebook Reality Labs, these problems can be solved by external screens that display the user’s eyes over the helmet. The screens do not transmit a real image of the user’s face, they show a pre-created three-dimensional model. Moreover, the “reverse pass” system creates the effect of image depth so that the user’s eyes look natural from any angle.
The quality of the system depends on the accuracy of the created three-dimensional model of the user’s face. Another weak point of the invention is the low resolution of external screens, but the researchers hope that it will be overcome over time.