{local|remote}.ip for PROXY support, we do not want to waste 16 bytes
extra on pointers, so put all the {client|server|local|remote}.ip into
a single array -- which is unfortunately complicated by the opaqueness
of struct vsa.