Opened 6 months ago

Last modified 2 months ago

#988 new defect

Decoder mismatch for lossless coding when RDOQ is enabled at config

Reported by: analci Owned by:
Priority: minor Milestone:
Component: VTM Version: VTM-8.0
Keywords: Cc: ksuehring, XiangLi, fbossen, jvet@…

Description

There is an encode/decode mismatch that occurs with lossless coding when RDOQ is enabled at the config level. This happens for certain frames for AI, RA and LDB configurations. An example is provided below for AI:

EncoderAppStatic -c encoder_intra_vtm.cfg -c ArenaOfValor.cfg -f 100 -ip 1 -q 0 -ts 8 -c lossless.cfg --IBC=1 --HashME=1 --DepQuant=1 --RDOQ=1 --RDOQTS=1 -b str.bin -o /dev/null -fs 0

It also appears that certain frames are being lossy coded due to this bug whereas certain frames are still lossless. A patch is provided here which prevents lossless coding from going into RDOQ for lossless. This solves the bug. A merge request will be done for this fix.

Attachments (1)

RDOQ-bug-fix-for-lossless.patch (996 bytes) - added by analci 6 months ago.

Download all attachments as: .zip

Change history (2)

Changed 6 months ago by analci

comment:1 Changed 2 months ago by ksuehring

  • Milestone VTM-8.1 deleted
Note: See TracTickets for help on using tickets.