ARM: Don't unconditionally bloat thread_info