Opened 3 years ago

Closed 3 years ago

#1408 closed defect (fixed)

LFNST zero out incorrect when JVET_R0351_HIGH_BIT_DEPTH_ENABLED is 1

Reported by: adybrowne Owned by:
Priority: minor Milestone: VTM-11.0
Component: VTM Version: VTM-10.2
Keywords: Cc: ksuehring, XiangLi, fbossen, jvet@…

Description

TrQuant::fwdLfnstNxN explicitly uses sizeof(int) when computing number of bytes to zero out in an array of TCoeff. This should be sizeof(TCoeff) to make it correct for both settings of JVET_R0351_HIGH_BIT_DEPTH_ENABLED.

Change history (2)

comment:1 Changed 3 years ago by m.sarwer

@Adrian: Does it impact BD-rate?

comment:2 Changed 3 years ago by fbossen

  • Milestone set to VTM-11.0
  • Resolution set to fixed
  • Status changed from new to closed
Note: See TracTickets for help on using tickets.