Fix Build: Donot use -ffast-math for x86_64

No match.