Make the two classes a bit more generic (e.g. remove too much usage of
hardcoded key references) as the corresponding PIV-specific classes.

GnuPG-bug-id: 5183