fileinfo: Remove optimization for GFileAttributeMatcher