Use bfd_generic_verify_endian_match() and fix it to only check when endianness