Error processing conformance bitstreams in high bit depth mode

[fbossen]

With a recent version of VTM (3bc1ad44, post 15.2), processing of several v1 conformance bitstreams fails when compiling with JVET_R0351_HIGH_BIT_DEPTH_ENABLED set to 1:

GDR_B_NOKIA_2
GDR_C_NOKIA_2
SPATSCAL_A_Qualcomm_3

Failure also occurs with several v2 conformance bitstreams:

10b444P16_A_Sony_1
10b444P16_B_Sony_1
10b444P16_C_Sony_1
10b444P16_D_Sony_1
10b444P16_E_Sony_1
12b400P16_A_Sony_1
12b400P16_B_Sony_1
12b400P16_C_Sony_1
12b400P16_D_Sony_1
12b400P16_E_Sony_1
12b444SPetsrc_A_Kwai_1
12b444SPetsrc_B_Kwai_1
12b444SPetsrc_C_Kwai_1
16b444Ierrc_A_Qualcomm_1
16b444Ietsrc_A_Kwai_1
16b444Iprrc_A_Qualcomm_1
16b444Irlscp_A_OPPO_1
16b444Ivvc1_A_Alibaba_1
16b444SPerrc_A_Qualcomm1
16b444SPetsrc_A_Kwai_1
16b444SPetsrc_B_Kwai_1
16b444SPetsrc_C_Kwai_1
16b444SPetsrc_D_Kwai_1
16b444SPetsrc_E_Kwai_1
16b444SPetsrc_F_Kwai_1
16b444SPetsrc_G_Kwai_1
16b444SPetsrc_H_Kwai_1
16b444SPprrc_A_Qualcomm1
16b444SPrlscp_A_OPPO_1
16b444SPvvc1_A_Alibaba_1
16b444errc_A_Qualcomm_1
16b444errc_B_Qualcomm_1
16b444errc_C_Qualcomm_1
16b444etsrc_A_Kwai_1
16b444prrc_A_Qualcomm_1
16b444rlscp_A_OPPO_1
16b444vvc1_A_Alibaba_1

[fbossen]

The issue with processing v1 conformance bitstreams is caused by the function simdFilter5x5Blk_HBD_AVX2, which appears to set incorrect requirements for block width (i.e., must be a multiple of 8)

ERROR: In function "simdFilter5x5Blk_HBD_AVX2" in source/Lib/CommonLib/x86/avx2/../AdaptiveLoopFilterX86.h:443: Wrong endWidth in filtering

7405266d0 (Xiaoyu Xiu 2021-01-26 20:42:58 +0100 443) CHECK(width % step_x, "Wrong endWidth in filtering");

[fbossen]

The issue with v1 conformance bitstreams was fixed in
​https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM/-/merge_requests/2161

[fbossen]

Conformance tickets were opened for bitstream related issues