xfs: stop the sync worker before xfs_unmountfs