Opened 6 years ago
Closed 5 years ago
#210 closed defect (fixed)
M0147 DMVR interpolation filter incorrect for bit depth != 10
| Reported by: | bheng | Owned by: | |
|---|---|---|---|
| Priority: | minor | Milestone: | |
| Component: | VTM | Version: | VTM-4.0 |
| Keywords: | Cc: | ksuehring, XiangLi, fbossen, jvet@… |
Description
When xFrac and yFrac are both non-zero, the DMVR bilinear interpolation shift below is used for both vertical and horizontal filtering stages:
shift = IF_FILTER_PREC_BILINEAR - (IF_INTERNAL_PREC_BILINEAR - clpRng.bd)
This double compensates for the bit depth.
For example, when filtering is applied in both horizontal and vertical directions, with 8-bit pixels, the output is 4x larger than the same pixels interpolated in only one direction.
Change history (2)
comment:1 Changed 6 years ago by bheng
comment:2 Changed 5 years ago by bheng
- Resolution set to fixed
- Status changed from new to closed
Note: See TracTickets for help on using tickets.
One potential fix can be found here:
https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM/merge_requests/343