Also remove the libvarnishapi "workaround" we put in place
earlier.

Found by: Ingvar Hagelund

Fixes: #1484