Opened 4 years ago
Closed 4 years ago
#1409 closed defect (fixed)
Overflow processing 16 bit sequences if JVET_R0351_HIGH_BIT_DEPTH_ENABLED is not set
| Reported by: | adybrowne | Owned by: | |
|---|---|---|---|
| Priority: | minor | Milestone: | |
| Component: | VTM | Version: | |
| Keywords: | Cc: | ksuehring, XiangLi, fbossen, jvet@… |
Description
At present VTM can process 16 bit input sources using 10 (or other) bits. The input reader automatically shifts right input data by the correct number of bits. However if JVET_R0351_HIGH_BIT_DEPTH_ENABLED is not set, the 16 bit unsigned data is read into a 16 bit signed array and the conversion to 10 bits is therefore incorrect.
The simplest solution is to prevent the use of 16 bit sources when JVET_R0351_HIGH_BIT_DEPTH_ENABLED is not set. This must be extended to preclude 15 bit sources due to the rounding present in the conversion.
Change history (1)
comment:1 Changed 4 years ago by fbossen
- Resolution set to fixed
- Status changed from new to closed
Note: See TracTickets for help on using tickets.
Fixed in https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM/-/merge_requests/1916