The main discussion of this topic is going to happen in #3600, but
whatever the outcome, the fini method does not happen within the task,
so we must not dereference any cached pointers (unless we own them).

Closes #3606