Revert "Set PKG_CONFIG_CFLAGS properly"