Clear anything that av_hwframe_map() might have done to the destination
frame, but leave caller-provided fields unchanged.