Opened 8 months ago

Closed 6 months ago

#210 closed defect (fixed)

M0147 DMVR interpolation filter incorrect for bit depth != 10

Reported by: bheng Owned by:
Priority: minor Milestone:
Component: VTM Version: VTM-4.0
Keywords: Cc: ksuehring, XiangLi, fbossen, jvet@…

Description

When xFrac and yFrac are both non-zero, the DMVR bilinear interpolation shift below is used for both vertical and horizontal filtering stages:

shift = IF_FILTER_PREC_BILINEAR - (IF_INTERNAL_PREC_BILINEAR - clpRng.bd)

This double compensates for the bit depth.

For example, when filtering is applied in both horizontal and vertical directions, with 8-bit pixels, the output is 4x larger than the same pixels interpolated in only one direction.

Change history (2)

comment:2 Changed 6 months ago by bheng

  • Resolution set to fixed
  • Status changed from new to closed
Note: See TracTickets for help on using tickets.