This will ensure that should test executables not be found, we will flag them as failures for further investigation rather than silently ignoring them.

Differential Revision: https://phabricator.kde.org/D20874