With the switch to a gridlayout removing takes a bit more effort
as we manually have to update the positions of the items below
the removed line.
This also fixes a problem that removed items were not deleted.