client: Keep track of proxy validity and number of reference holders