This turns off ColumnView's multiple page support, so we don't end up with situations like this:
While we won't be able to have multiple pages visible now, I think the UI is much easier to navigate without it.
This also pops pages if they are after the current page in the page stack