Ensure created resources reconfigure with up-to-date stored config

Untested, as I had no time yet to find a way to trigger this code snippet.

But inspired by similar code in kmail-account-wizard!4 (merged)

@vkrause @mlaurent