Don't protect xkb_*_unref from NULL