lib/digsig: additional sanity checks against badly formated key payload