Don't assert that we can remove VCL directories, compilers may have
left crumbs there, for instance gcov profiling info.