Make the serial driver framework work with CONFIG_SERIAL_MULTI enabled