What can possibly make `test_quickopen testProjectFileFilter` flaky?
TestQuickOpen::testProjectFileFilter()
fails on the CI occasionally: suse_tumbleweed_qt515, freebsd_qt515. I recall it has failed on my system in the past. I run test_quickopen tens of times and the single testProjectFileFilter test case hundreds of times in a row, and couldn't reproduce the test failure.
The failing test's output:
QDEBUG : TestQuickOpen::testProjectFileFilter() ("foo/asdf", "asdf/bar", "foo/bar", "foo/space bar")
FAIL! : TestQuickOpen::testProjectFileFilter() Compared lists have different sizes.
Actual (items(provider)) size: 4
Expected (QStringList() << QStringLiteral("foo/asdf") << QStringLiteral("asdf/bar")) size: 2
Loc: [/builds/kdevelop/kdevelop/plugins/quickopen/tests/test_quickopen.cpp(386)]
I examined BaseFileDataProvider::setFilterText()
and PathFilter::setFilter()
: both definitions are synchronous and deterministic. So how can the test possibly fail occasionally? Does some Quick Open filtering UI become interactable for a short while, which interferes with the filtering?