Fix removing a parent space when we're not joined
@nvrwhere were we trying to get the parent object here so that we can also remove the child in the parent's state? if so, we should fix that instead while making sure that we're still removing the child if we don't have access to the parent