Thank you, @Dridi

- yes, allocations outside the lock were motivated by minimizing the
  critical section, but n_backend could actually change, so this was
  wrong. As we use an RW lock, doing more work under it should only have
  marginal impact.

- n_backend == 0 is probably best handled as a special case