Opened 3 years ago
Closed 3 years ago
#1502 closed defect (fixed)
Low bit-depth encoding fails due to the check in riceStatReset
Reported by: | tsukuba.takeshi | Owned by: | |
---|---|---|---|
Priority: | minor | Milestone: | VTM-14.0 |
Component: | VTM | Version: | |
Keywords: | Cc: | ksuehring, XiangLi, fbossen, jvet@… |
Description
As in the adopted text in JVET-W0178, the StatCoeff[idx] is initialized as below:
- If sps_persistent_rice_adaptation_enabled_flag is equal to 0, the values of StatCoeff[ idx ] for idx ranging from 0 to 2, inclusive, are initialized to be equal to 0.
- Otherwise the following applies: StatCoeff[ idx ] = ( 2 * Floor( Log2( bitDepth − 10 ) ) (X)
But in the the riceStatReset function, the initialization takes care of only the latter case (sps_persistent_rice_adaptation_enabled_flag==1). As a result, the following check in the riceStatReset prevents anyone from using 8/10 bit coding regardless of using high bit-depth or not.
CHECK(bitDepth <= 10,"BitDepth shall be larger than 10.");
A fix is to align SW with Spec. i.e.
- Add an initialization process for the case of sps_persistent_rice_adaptation_enabled_flag == 0 in riceStatReset.
Discussion is found in:
https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM/-/merge_requests/2098#note_15804
Change history (2)
comment:1 Changed 3 years ago by tsukuba.takeshi
comment:2 Changed 3 years ago by ksuehring
- Resolution set to fixed
- Status changed from new to closed
Fixed as suggested
Note: See TracTickets for help on using tickets.
MR is https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM/-/merge_requests/2108