Opened 4 years ago
Closed 4 years ago
#697 closed defect (fixed)
Mismatch of equation (8-1261) between VTM and spec
| Reported by: | nanhu | Owned by: | |
|---|---|---|---|
| Priority: | minor | Milestone: | |
| Component: | spec | Version: | VVC D7 vC |
| Keywords: | Cc: | ksuehring, bbross, XiangLi, fbossen, jvet@… |
Description
In spec, equation (8-1261) is
avgVar[ x ][ y ] = varTab[ Clip3( 0, 15,
( sumOfHV[ x >> 2 ][ y >> 2 ] * ac[ x >> 2 ][ y >> 2 ] ) >> ( 3 + BitDepth ) ) ].
However, in VTM, when calling the method m_deriveClassificationBlk, the input shift is set as m_inputBitDepth[CHANNEL_TYPE_LUMA] + 4, which means
the value is right shifted by ( BitDepth + 4 ).
Suggest to align spec with VTM ( using BitDepth + 4 in (8-1261) ).
Change history (1)
comment:1 Changed 4 years ago by bbross
- Resolution set to fixed
- Status changed from new to closed
Note: See TracTickets for help on using tickets.
Thanks for reporting.
This will be fixed JVET-P2001-vD.