It is only used by the decoders' lowres code, so only initialize
it for decoders.
Signed-off-by: Andreas Rheinhardt <andreas.rheinhardt@outlook.com>