We exec() the dialog, which then deletes the dialog, and then access the dialog, which goes boom

Partially revert a5c43dd9 and delete the dialog manually again