panels: Tapping on it takes focus away from the app (sometimes)

Tapping on the navigation panel seems to take focus away from the running app, causing #266 (closed)

If we wipe the shell config, the first time we start the shell, the top panel has the same issue too, but it goes away after restart...