Opened 5 years ago
Closed 3 years ago
#992 closed defect (fixed)
Encoder bug when min QT size is 128 and intra dual tree off
Reported by: | guichunli | Owned by: | |
---|---|---|---|
Priority: | minor | Milestone: | |
Component: | VTM | Version: | VTM-8.0 |
Keywords: | encoder | Cc: | ksuehring, XiangLi, fbossen, jvet@… |
Description
Current VTM-8 encoder skips all intra mode checking when CU is larger than 64x64. As in the following code of EncModeCtrl.cpp:
if( m_pcEncCfg->getUseFastLCTU() && partitioner.currArea().lumaSize().area() > 4096 )
{
return false;
}
In special case such as when min QT is 128, and intra dual tree is off, intra mode should be checked for such CUs if no further split is allowed.
Attachments (1)
Change history (4)
comment:1 Changed 5 years ago by guichunli
comment:2 Changed 5 years ago by guichunli
Attached a configuration file that can trigger this bug on the current master of VTM software.
comment:3 Changed 3 years ago by fbossen
- Resolution set to fixed
- Status changed from new to closed
Note: See TracTickets for help on using tickets.
A MR with a fix is submitted:
https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM/-/merge_requests/1486