Opened 4 years ago

Closed 2 years ago

#992 closed defect (fixed)

Encoder bug when min QT size is 128 and intra dual tree off

Reported by: guichunli Owned by:
Priority: minor Milestone:
Component: VTM Version: VTM-8.0
Keywords: encoder Cc: ksuehring, XiangLi, fbossen, jvet@…

Description

Current VTM-8 encoder skips all intra mode checking when CU is larger than 64x64. As in the following code of EncModeCtrl.cpp:

if( m_pcEncCfg->getUseFastLCTU() && partitioner.currArea().lumaSize().area() > 4096 )
{

return false;

}

In special case such as when min QT is 128, and intra dual tree is off, intra mode should be checked for such CUs if no further split is allowed.

Attachments (1)

minqt128_dt0.cfg (322 bytes) - added by guichunli 4 years ago.
Configuration file that triggers the bug

Download all attachments as: .zip

Change history (4)

Changed 4 years ago by guichunli

Configuration file that triggers the bug

comment:2 Changed 4 years ago by guichunli

Attached a configuration file that can trigger this bug on the current master of VTM software.

comment:3 Changed 2 years ago by fbossen

  • Resolution set to fixed
  • Status changed from new to closed
Note: See TracTickets for help on using tickets.