We don't need to use the internal AbstractBackend pointers for filtering anymore after the recent changes.