ptp clock: Increase tolerance for late follow-up and delay-resp