On 32 bit systems, it may be necessary to tweak this down to get high
numbers of worker threads squeezed into the address-space.

I have no idea how much stack-space a worker thread normally uses, so
no guidance is given, and we default to the system default.

Fixes #572


git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4352 d4fa192b-c00b-0410-8231-f00ffab90ce4

Previously we stored the esi-metadata in the object workspace, but since we
are trying to make that a snug fit and we cannot preestimate how much space
ESI parsing will need, this no longer works.

Instead parse the ESI metadata into the workers workspace and when
done, allocate a storage object and move it all into that.

Beware that this may increase the memory cost for ESI objects by the stevedores
granularity.

Fixes #578



git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4351 d4fa192b-c00b-0410-8231-f00ffab90ce4

git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4350 d4fa192b-c00b-0410-8231-f00ffab90ce4

We do not want to be dependent on GCC.

Fixes #577



git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4349 d4fa192b-c00b-0410-8231-f00ffab90ce4

git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4348 d4fa192b-c00b-0410-8231-f00ffab90ce4

git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4346 d4fa192b-c00b-0410-8231-f00ffab90ce4

Now that we need PCRE to build, we also do need pkg-config at
autoreconf time, so make autoconf complain as early as possible to not
confuse people.

git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4339 d4fa192b-c00b-0410-8231-f00ffab90ce4

Previously, running varnishd -V would sometimes say:

nm: 'varnishd': No such file

which is wrong.  Silence this message

git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4338 d4fa192b-c00b-0410-8231-f00ffab90ce4

git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4337 d4fa192b-c00b-0410-8231-f00ffab90ce4

git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4336 d4fa192b-c00b-0410-8231-f00ffab90ce4

git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4335 d4fa192b-c00b-0410-8231-f00ffab90ce4

We no longer use POSIX style regexes, but rather PCRE regexes.  This
introduces a hard dependency on libpcre.

Test suite passes, but only lightly tested.

The regex functions are in its own source file to make it easy to
change the decision if somebody wants to use non-PCRE for some reason.

git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4334 d4fa192b-c00b-0410-8231-f00ffab90ce4

Fixes #420


git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4331 d4fa192b-c00b-0410-8231-f00ffab90ce4

Previously, trying to build from SVN without xsltproc installed would
get you errors like:

  --xinclude -o changes-2.0.1.html changes-2.0.1.xml
  --xinclude:No such file or directory

which is quite confusing.

We now rather just skip the docs completely if we can't find any
xsltproc.  If we actually do need to rebuild the docs (which should
only happen when running make dist), we error out with a useful error
message.



git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4330 d4fa192b-c00b-0410-8231-f00ffab90ce4

Fixes #557


git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4329 d4fa192b-c00b-0410-8231-f00ffab90ce4

When saintmode_threshold items have been added to the trouble-list, the
backend will be considerd sick until one has timed out. Setting the
threshold to 0 disables saintmode and any lock contention associated with
it.

git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4328 d4fa192b-c00b-0410-8231-f00ffab90ce4

git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4321 d4fa192b-c00b-0410-8231-f00ffab90ce4

Move the objindex pointer and length to the segment table, having it
in the segment signatures is just a waste of disk-access on startup.

Put empty signatures at segment head, objidx and segment tail.

Align allocations to 16 bytes boundaries, for cache and hexdump
convenience.

Discard unsused segments on close.



git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4279 d4fa192b-c00b-0410-8231-f00ffab90ce4

Only delete empty segments from front of list.

Preallocate the temporary object-index buffer at open time.



git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4278 d4fa192b-c00b-0410-8231-f00ffab90ce4

using malloc space.

Otherwise -spersistent would resurrect objects without their Vary
specifications.


git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4277 d4fa192b-c00b-0410-8231-f00ffab90ce4

git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4276 d4fa192b-c00b-0410-8231-f00ffab90ce4

git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4275 d4fa192b-c00b-0410-8231-f00ffab90ce4

Use consistent boundary check for end of segment.



git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4274 d4fa192b-c00b-0410-8231-f00ffab90ce4

git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4273 d4fa192b-c00b-0410-8231-f00ffab90ce4

Use an index into the segments object index instead of a pointer, to
avoid dealing with the temporary buffer used in the active segment.

Correctly count the various kinds of states objects can be in.

Only check the signature id inside the signature id field.

Don't load segments if the object index was not committed.

Reuse the temporary object index buffer.

Lock updates to ttl and ban, if in the active segment, to close
race against segment closing.



git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4272 d4fa192b-c00b-0410-8231-f00ffab90ce4

git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4271 d4fa192b-c00b-0410-8231-f00ffab90ce4

Reserve space for the objects entry in the index, when the object
is allocated.

Allow smaller than requested allocations for non-object allocations.

Attempt allocation from three segments, then give up.



git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4270 d4fa192b-c00b-0410-8231-f00ffab90ce4

git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4269 d4fa192b-c00b-0410-8231-f00ffab90ce4

Take due care to not confuse unloaded segments with empty segments
in this respect.



git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4268 d4fa192b-c00b-0410-8231-f00ffab90ce4

git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4267 d4fa192b-c00b-0410-8231-f00ffab90ce4

an object structure.



git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4266 d4fa192b-c00b-0410-8231-f00ffab90ce4

git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4265 d4fa192b-c00b-0410-8231-f00ffab90ce4

Increase the ID field in the shmlog records from 16 to 32 bits to cater
for 64k+ connections.

Both varnishd and libvarnishapi needs to be recompiled, but apps should
not need to.



git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4264 d4fa192b-c00b-0410-8231-f00ffab90ce4

attempting a reply.

Fixes #561



git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4263 d4fa192b-c00b-0410-8231-f00ffab90ce4

We still do not have the cleaner, so when we run out of space we simply
exit the worker process with a message, the restart will blow away some
segments and thus make some space for us.



git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4262 d4fa192b-c00b-0410-8231-f00ffab90ce4

git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4261 d4fa192b-c00b-0410-8231-f00ffab90ce4

Submitted by:	"Jos I. Boumans" <jos@dwim.org>


git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4242 d4fa192b-c00b-0410-8231-f00ffab90ce4

git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4241 d4fa192b-c00b-0410-8231-f00ffab90ce4

because vcl_recv does "return(error);", force the status to 501.

Fixes: #558


git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4240 d4fa192b-c00b-0410-8231-f00ffab90ce4

git-svn-id: http://www.varnish-cache.org/svn/trunk/varnish-cache@4239 d4fa192b-c00b-0410-8231-f00ffab90ce4