Previously this could potentially call fdatasync once per puzzle, which
was pretty bad for loading times. That was exacerbated by the previous
date comparison bug that caused the config to be regenerated at every
start.