Opened 6 months ago

Last modified 6 months ago

#992 new defect

Encoder bug when min QT size is 128 and intra dual tree off

Reported by: guichunli Owned by:
Priority: minor Milestone:
Component: VTM Version: VTM-8.0
Keywords: encoder Cc: ksuehring, XiangLi, fbossen, jvet@…

Description

Current VTM-8 encoder skips all intra mode checking when CU is larger than 64x64. As in the following code of EncModeCtrl.cpp:

if( m_pcEncCfg->getUseFastLCTU() && partitioner.currArea().lumaSize().area() > 4096 )
{

return false;

}

In special case such as when min QT is 128, and intra dual tree is off, intra mode should be checked for such CUs if no further split is allowed.

Attachments (1)

minqt128_dt0.cfg (322 bytes) - added by guichunli 6 months ago.
Configuration file that triggers the bug

Download all attachments as: .zip

Change history (3)

Changed 6 months ago by guichunli

Configuration file that triggers the bug

comment:2 Changed 6 months ago by guichunli

Attached a configuration file that can trigger this bug on the current master of VTM software.

Note: See TracTickets for help on using tickets.