Revert "xf86drmMode: set FB_MODIFIERS flag when modifiers are supplied"

This reverts commit b3628506.

This breaks when the kernel driver does not support modifiers and the
application properly zeroes the modifiers.

Acked-by: Simon Ser <contact@emersion.fr>