Change compiler flag definition place to fix ASAN build break on ARM