soundwire: fix initializing sysfs for same devices on different buses