In the 304 case we were already skipping it for non-zero C-L.
For 204 responses this was introduced as a side effect of 271e1c52.