Add missing optional deps to CI metadata

To make sure the relevant codepaths have CI coverage
2 jobs for master in 3 minutes and 18 seconds (queued for 6 seconds)