OverlayDrawer: Make sure the handle is gone when it's hidden

Aleix Pol Gonzalezrequested to merge
work/hidden-anchor-invisible into master

Otherwise it can be interacted with unexpectedly.

BUG: 450902

Merge request reports