Rather than once per plugin instance. It's less of an issue now that we are
no longer parsing all the declarative extraction rules but just the minimal
extractor meta data, but it's still two file system searches we can avoid.