Apply tbm_drm_helper_set / unset_fd both of server(master) and client.