Turn device ports into reference counted objects