mctp: prevent double key removal and unref