Add explicit option for controlling X11 support

Currently it determines whether the X11 stuff should be built by checking the availability of some X11 libs. However that is quite brittle and can lead to surprises

An explit option to opt out of trying to build the X11 bits makes it more clear and consitent with how we deal with Wayland