net: gem: Pass phy address to init