Opened 8 years ago

Closed 8 years ago

#29 closed defect (fixed)

Mismatch between estLastSignificantPositionBit and codeLastSignificantXY

Reported by: tpoirier Owned by:
Priority: minor Milestone: HM-16.6-JEM-3.2
Component: JEM Version: HM-16.6-JEM-3.1
Keywords: Cc: ksuehring, XiangLi, jvet@…

Description

In TEncSbac::estLastSignificantPositionBit, width and height are not swapped if coefficient scanning is vertical as in TEncSbac::codeLastSignificantXY.
It leads to a wrong rate estimation in xRateDistOptQuant due to the uninitialization of m_pcEstBitsSbac->lastXBits (lastYBits).
The following patch should solve the problem.

Tangi

Attachments (1)

RDO_bit_estimate.patch​ (9.5 KB) - added by tpoirier 8 years ago.

Download all attachments as: .zip

Change history (2)

Changed 8 years ago by tpoirier

comment:1 Changed 8 years ago by XiangLi

  • Milestone set to HM-16.6-JEM-3.2
  • Resolution set to fixed
  • Status changed from new to closed

Fixed in r294.

Note: See TracTickets for help on using tickets.