For each subfolder we see if there's a thread free, if not we scan immediately in the same thread (as before), otherwise we run it in a new thread and wait for it.
It's stupid simple, but it seemingly works. At least on my laptops with NVMe disks the speed is stupid fast now.