soundwire: stream: only prepare stream when it is configured.