Draft: VR Mode

Stanislav Aleksandrovrequested to merge
lightofmysoul/kwin:vr into master

(I do not work for Valve, this is done in my free time)

Main issue: #301

Related MRs: !8500

Related Issues: #305

25f4d1aa576e72721e0c2e530ca8189b.png

This plugin turns KWin (and KDE) into a 3D VR Desktop. Features:

  • Floating windows
  • Physical and Virtual screens
  • Everything is 3D, even wayland surfaces, window decorations and shadows
  • Made for work: Full keyboard control
  • Headgaze: no mouse, touchpad or vr controller is required
  • Native Qt rendering: direct dmabuf imports.
  • Follow Mode

The plugin uses Qt Quick 3D Xr, so a proper OpenXR runtime is needed. I use Monado (Rokid Max, Rayneo Air 4 Pro, HP G2) and WiVRn (Quest 3)

Patched Qt and XWayland are needed for the plugin to work correctly: https://invent.kde.org/lightofmysoul/vr-patches.

To build:

  1. Install Qt Quick 3D Xr, Qt 6.10.2 is a minimum. Qt 6.11 is ideal.
  2. Build KWin with the VR plugin from this MR or for KWin 6.5.5

To run:

  • Install OpenXR runtime (Monado, WiVRn, etc...) and test that it works.
  • Select your runtime: Go to systemsettings -> VR mode -> OpenXR Runtime
  • Run by pressing Activate VR Mode or hit Ctrl + Meta + J

NOTE: for AR glasses to work with Monado they should be put into non-desktop mode by kernel patch or this issue should be solved: #305

Patch for Rokid Max

NOTE: For better support of X11 apps patches for XWayland are needed: https://invent.kde.org/lightofmysoul/vr-patches/-/tree/master/xwayland

NOTE: If you are using Qt 6.10.2+, patches for full support are here: https://invent.kde.org/lightofmysoul/vr-patches/-/tree/master/qt-6.10.2/qtquick3d

There is still some stuff that is needed to be done. The code needs to be polished overall.

However, it works and I use it everyday, so I think it is ready for initial review.

Edited by Stanislav Aleksandrov

Merge request reports