pinctrl: amd: Fix mistake in handling clearing pins at startup