serial: timbuart: drop low-latency workaround