Make sure that we don't switch to same folder

1 job for release/21.12 in 17 minutes and 16 seconds (queued for 387 minutes and 27 seconds)