It's a loose comparison of socket addresses, not including the port
number. But not loose enough to compare IPv4 addresses to v4-mapped
IPv6 addresses.

Fixes #2142