[autotest] Try making IdleTest more robust
It started to fail on build.kde.org with a segfault. While I cannot reproduce this locally it looks like client objects survive to the next test and thus cause issues. This change attempts to reduce the risk by making sure that everything is cleaned up correctly. If that fixes the issue we can look into a proper fix.