Variable treeType within palette_coding syntax structure

[vdrugeon]

The variable treeType is used in if conditions in the syntax of palette_coding, but it is not one of the inputs of this syntax structure. How is treeType determined within palette_coding?

[yhchao]

Suggested fixes:
The variable treeType should be included as an input as follows in 7.3.9.6:

palette_coding( x0, y0, cbWidth, cbHeight, treeType, startComp, numComps )

Changes are also needed in 7.3.9.5:

1. if( treeType = = SINGLE_TREE | | treeType = = DUAL_TREE_LUMA ) {

if( pred_mode_plt_flag ) {

if( treeType = = DUAL_TREE_LUMA )

palette_coding( x0, y0, cbWidth, cbHeight, treeType, 0, 1 )

else /* SINGLE_TREE */

palette_coding( x0, y0, cbWidth, cbHeight, treeType, 0, 3 )

2. if( ( treeType = = SINGLE_TREE | | treeType = = DUAL_TREE_CHROMA ) &&

ChromaArrayType != 0 ) {

if( pred_mode_plt_flag && treeType = = DUAL_TREE_CHROMA )

palette_coding( x0, y0, cbWidth / SubWidthC, cbHeight / SubHeightC, treeType, 1, 2 )

[bbross]

Thanks for reporting and suggesting a fix.

This will be fixed in JVET-P2001-vA.