Right-clicking on multiple things is a real use case which got broken
in !591
while fixing the bug of un-clicked-on items remaining selected after
clicking one of them.

This commit fixes that.

BUG: 443743
FIXED-IN: 5.23.1


(cherry picked from commit 2b828c60)