RA coding has encoder/decoder mismatch in HDR PQ CTC (Luma deltaQP enabled)

[taoranlu]

Encoder/decoder mismatches (chroma component MD5sum not matching in B-slices) are observed in multiple points in RA coding of HDR CTC (LQP=1) in commit 5280bded. Mismatch was found in MarketQP32 and QP37, BalloonFestival QP32 and QP37.

The mismatch was not observed at previous commit 20c8d508 and before.
It might be related to delta QP handling of O0050 which is the major change after 20c8d508. When turn off LQP, no mismatch is found then.

VTM6.0rc1 might also have same issue but due to the bug #441, decoder crashes before it can decode the B slices.

An example of command line to reproduce issue (Market RA QP32):
EncoderAppStatic_5280bded -c encoder_randomaccess_vtm.cfg -c classH1.cfg -c H1_Market.cfg -f 49 -ip 48 -b test.bin --SEIDecodedPictureHash=1

When decoding the encoded bitstream:
VVCSoftware: VTM Decoder Version 6.0rc1 [Linux][GCC 7.2.1][64 bit] [SIMD=AVX2]
POC 0 TId: 0 ( I-SLICE, QP 29 ) [DT 0.290] [L0 ] [L1 ] [MD5:c5778412152ee4b357464c982b4aaa71,c37bf16cab6d5c6d138cdb1d747faf17,0e9f0baffc951052f613d5b324654aa1,(OK)]
POC 16 TId: 0 ( B-SLICE, QP 33 ) [DT 0.140] [L0 0 ] [L1 0 ] [MD5:c2802d77614440c1d66baca2572a99dc,2bba132f01132188864c45a6261e3089,b39e49f29c6c29e6ea4fa4d72b782e30,(***ERROR***)] [rxMD5:c2802d77614440c1d66baca2572a99dc,c372e5f980946d8d321eef06d913d37b,f4a6c9a3662587664c3be44eccdabe68]
POC 8 TId: 1 ( B-SLICE, QP 35 ) [DT 0.110] [L0 0 16 ] [L1 16 0 ] [MD5:1b599ae81e362326aaf261388bdb127e,614d64491e56046eb44b81da68735040,ea0a512dcfaaa6007a46337d7e0f0683,(***ERROR***)] [rxMD5:1b599ae81e362326aaf261388bdb127e,41b03c5921c830881e589c34688b3bb5,efe8b830f6398cfbd452469b2454dd95]
POC 4 TId: 2 ( B-SLICE, QP 38 ) [DT 0.070] [L0 0 8 ] [L1 8 16 ] [MD5:02ec24c30a4dfabf72584143de14e10a,e50b4253d18b06720381f4657f054acf,8ffaee12afdf19d27d442e804517a09e,(***ERROR***)] [rxMD5:02ec24c30a4dfabf72584143de14e10a,3bc737ea3c73c0b50834d8111928010f,ea30fa73168a8720d82f840783cb7c06]
POC 2 TId: 3 ( B-SLICE, QP 40 ) [DT 0.060] [L0 0 4 ] [L1 4 8 ] [MD5:5daa2de03105c4c314bd4aea6546f914,c0ab68a0fa6221a39adae52bb6cd551c,3f6b537a1c961aea64cf3a67fbe90904,(***ERROR***)] [rxMD5:5daa2de03105c4c314bd4aea6546f914,5d1f641d13cdeae70dbd76ebffadab81,a074d73898b90899cd78b9e77a48aa7b]
POC 1 TId: 4 ( B-SLICE, QP 41 ) [DT 0.060] [L0 0 2 ] [L1 2 4 ] [MD5:e63782c4496c5a193207004dd0c6e17f,1c65c3830a44ce8dab9a32a2e22bde08,e9ead61f2b85abf20cc4e38eb877430c,(***ERROR***)] [rxMD5:e63782c4496c5a193207004dd0c6e17f,f5c8a6008de91157a2806660a5f8c798,198c8cf3ffd856f2fd0b95cdbba4299b]
POC 3 TId: 4 ( B-SLICE, QP 41 ) [DT 0.050] [L0 2 0 ] [L1 4 8 ] [MD5:7ebd0e3c0e14057793c989ceda71a78b,2f589d0f9eb1e9e3e5cc5eaf1566b46f,c9be6ffb29bda38c99197f0e820bfc9f,(***ERROR***)] [rxMD5:7ebd0e3c0e14057793c989ceda71a78b,ed7a641215277ba2f54458ce01e9f8b8,9af4de1de58624c2768c23536ba1729f]
POC 6 TId: 3 ( B-SLICE, QP 40 ) [DT 0.060] [L0 4 0 ] [L1 8 16 ] [MD5:d0f488f867406971accf503642a0dc78,d5123031e311903c61a37814b07b1c49,47b3662dcb458178cc62b9dfa6e56aa6,(***ERROR***)] [rxMD5:d0f488f867406971accf503642a0dc78,609719efc12c26fbf88c60d85a2954ea,016618590d97e3058cc6cbf55d10f364]
POC 5 TId: 4 ( B-SLICE, QP 41 ) [DT 0.050] [L0 4 0 ] [L1 6 8 ] [MD5:6cc9a2cf633777c71de930b060e201c7,6173e306471ef9a2492b6b6a72755254,3e36dc97c08cc92b688bc40444360d21,(***ERROR***)] [rxMD5:6cc9a2cf633777c71de930b060e201c7,155453b2cebcfc025a7e10abacfd0730,7560049466bcd6a711d0d1eb079c7cc5]
POC 7 TId: 4 ( B-SLICE, QP 41 ) [DT 0.060] [L0 6 4 ] [L1 8 16 ] [MD5:1e6f4f7c791994634844008121b4f1d3,a19040d678f1a3065072ed9a43feab3c,5dd4e47ef03d6c4c6d764dfd46a9b967,(***ERROR***)] [rxMD5:1e6f4f7c791994634844008121b4f1d3,64ac104caa91293721cfc5cdd9061612,b60f7a2a19e33b8b82a090d617b1aae8]
POC 12 TId: 2 ( B-SLICE, QP 38 ) [DT 0.080] [L0 8 0 ] [L1 16 8 ] [MD5:107623e18d80d37277353fe91df66fb9,174ecd7c826f3732841b529c3c90a5c3,f42a120be81b1e7e633f47cbd98303a6,(***ERROR***)] [rxMD5:107623e18d80d37277353fe91df66fb9,4a989062589c18248fcfd6c866d76686,ff3c6e7b50f3c99e1ec6f8f7c1c06d84]
POC 10 TId: 3 ( B-SLICE, QP 40 ) [DT 0.060] [L0 8 0 ] [L1 12 16 ] [MD5:5599037a3fbeebda6e297a7bfbc02383,7b1cc4dd9eecd3875fc54e6828ad8116,536e74d952741ef2fa088bf01b030e32,(***ERROR***)] [rxMD5:5599037a3fbeebda6e297a7bfbc02383,cc5b6f794483a0d1cfa0fe58858ac261,1d56fb10b6869684e491b1d1dcd61d86]
POC 9 TId: 4 ( B-SLICE, QP 41 ) [DT 0.050] [L0 8 0 ] [L1 10 12 ] [MD5:308e081e73a50ee33658c6dae92c7146,d0c3bf99025a279ba573795ed1674b33,6686b637a843c48a124eae6af68c9e7c,(***ERROR***)] [rxMD5:308e081e73a50ee33658c6dae92c7146,3290648598f64f1fa2a0f5a21b96a407,54f82c3f064e14daa1ad97c2147d31fc]
POC 11 TId: 4 ( B-SLICE, QP 41 ) [DT 0.050] [L0 10 8 ] [L1 12 16 ] [MD5:514b36e78e0e51623dcd73c7ceb5c6b2,bc96107bbfa8c892f4ec3e4997257c1b,e3408941f215fd45535cb263738e6b2b,(***ERROR***)] [rxMD5:514b36e78e0e51623dcd73c7ceb5c6b2,85b05f39fe5c54f85ce7436cf10e985e,60d9d50bb37f4e5235d6000ab6f0dd33]
POC 14 TId: 3 ( B-SLICE, QP 40 ) [DT 0.060] [L0 12 8 ] [L1 16 12 ] [MD5:7098399d46dc5a07b4e78d7d60642ce4,74f481d05235fe41f33e3673e919bfb5,7e0fcb0ce99dfb2aacd1cd2c74a2f52b,(***ERROR***)] [rxMD5:7098399d46dc5a07b4e78d7d60642ce4,73f0619119d33ca90581d2793bef5f83,625e838fb0373dffbb9c21fc3814f724]
POC 13 TId: 4 ( B-SLICE, QP 41 ) [DT 0.050] [L0 12 8 ] [L1 14 16 ] [MD5:609975903c7413e2190302fc15dfcfa5,44c21345def848606410966cacfb74b2,46c2b64aa9fab8cc054d365cf161905e,(***ERROR***)] [rxMD5:609975903c7413e2190302fc15dfcfa5,a6693f520d57ab7d6c2c14dc25e2b959,b7f726e537f466ed5db80842e901e6ef]
POC 15 TId: 4 ( B-SLICE, QP 41 ) [DT 0.060] [L0 14 12 ] [L1 16 14 ] [MD5:3f8929195dfcd50f8fdbb3c27384ea7f,dfc8f47507101887e69de019095c94b1,1a6304fe5d8f45201fa569f98310bc31,(***ERROR***)] [rxMD5:3f8929195dfcd50f8fdbb3c27384ea7f,2e937859f883bd4dc5f51ee45d9d81db,8fe7913c04adfccab707f084c08769f4]
POC 32 TId: 0 ( B-SLICE, QP 33 ) [DT 0.150] [L0 16 0 ] [L1 16 0 ] [MD5:7bccc5273e81e0759e77d219173ff234,0fda4e59759c9aa1ae6df62f4c7f04ea,79b73eab8588f54ecffe5338521835d3,(***ERROR***)] [rxMD5:7bccc5273e81e0759e77d219173ff234,1c5d641faa8a387e54cfc0eafd0bd062,2fa538486b2b90fcc780f5c3540ba1ff]
POC 24 TId: 1 ( B-SLICE, QP 35 ) [DT 0.090] [L0 16 8 ] [L1 32 16 ] [MD5:22e2aa3f993157d2b1ad51f4a3a4f846,235648eb959e89cd276b60b53124c7ac,1ddb2accacb581035b0b508ef7389669,(***ERROR***)] [rxMD5:22e2aa3f993157d2b1ad51f4a3a4f846,b1b16684357262ab0a165e27f6de9b86,4033a15947797f4a070162be71deeb48]
POC 20 TId: 2 ( B-SLICE, QP 38 ) [DT 0.080] [L0 16 8 ] [L1 24 32 ] [MD5:5b5f9cce95e22d830d65b231d868086f,cb5489c948269a73a40b0a3f799197c1,ce53cd629d7468e64ddcdbfee462957d,(***ERROR***)] [rxMD5:5b5f9cce95e22d830d65b231d868086f,3951abcc315cb85d1b0ea7627fb244b2,593719d6287a10f8fce1594857638de6]
POC 18 TId: 3 ( B-SLICE, QP 40 ) [DT 0.060] [L0 16 8 ] [L1 20 24 ] [MD5:c6994cd3cc39f9a87c77db63cc04f6be,eb99f5c0ad1866045fc5e727d5453e1d,d0b15d496fb936f0fe5d23a28dd49c06,(***ERROR***)] [rxMD5:c6994cd3cc39f9a87c77db63cc04f6be,2725185ea4bce9fe47612c97408414f6,04ab8226cbec44c22f2f84bae80d7155]
POC 17 TId: 4 ( B-SLICE, QP 41 ) [DT 0.050] [L0 16 18 ] [L1 18 20 ] [MD5:bc4265acc52d52c6966ab23d203fdb64,e843013d0350dad1c5a7e1175b6ae54d,24ec6a76ef8e26180aec1dfa70c9298f,(***ERROR***)] [rxMD5:bc4265acc52d52c6966ab23d203fdb64,4cb8a8fd308b12c88676a0355f57af7c,9c58e7b4bc8c013e231d8fda0dc3ae15]
POC 19 TId: 4 ( B-SLICE, QP 41 ) [DT 0.050] [L0 18 16 ] [L1 20 24 ] [MD5:8e81d62a679017c7d4a156f0fa13f9a1,d2a0134193cd95138c1601a699b9be4b,4e9d41cc6af09bebae4c9743b7dc18f7,(***ERROR***)] [rxMD5:8e81d62a679017c7d4a156f0fa13f9a1,be362e47e80db4ea89a541d0b0c88bce,c0f0227916ebab1cb1ee476a3b1e6cea]
POC 22 TId: 3 ( B-SLICE, QP 40 ) [DT 0.060] [L0 20 16 ] [L1 24 32 ] [MD5:8fb9749bb9bea7a61c292a88ebd80402,99581c41901f5f851b4df22e88ad80c3,e0a2c5112a0d3da54f4d5f35d23137f9,(***ERROR***)] [rxMD5:8fb9749bb9bea7a61c292a88ebd80402,f3a1cc607818e9f517ebd0a5af4c60f9,69c9b67c6ab62388ea081c83072e42f3]
POC 21 TId: 4 ( B-SLICE, QP 41 ) [DT 0.080] [L0 20 16 ] [L1 22 24 ] [MD5:01649daf12bf8ceb039abcf794aed87d,6f671ab616aacd89f0eb0e24be7a29a3,e65ed30945426b752a4fd60677305d1b,(***ERROR***)] [rxMD5:01649daf12bf8ceb039abcf794aed87d,1490f9cdb5c18c0e9270956dfa122f0d,86b5165b839d351d488fbdcdeebc92eb]
.......

[taoranlu]

Encoder Log

[taoranlu]

The mismatch problem can happen using small resolution clips (class D sdr clips) with HDR PQ cfg settings. Mismatch can be observed in blowingbubbles QP32, QP37, basketballpass QP32, racehorse QP37.

Example command line:
EncoderAppStatic_5280bded -c encoder_randomaccess_vtm.cfg -c classH1.cfg -c BlowingBubbles.cfg -f 49 -ip 48 -q 37 -b test.bin --SEIDecodedPictureHash=1

Encoder/decoder mismatch can be find starting at decoding POC 32.

[taoranlu]

encoder log using blowingbubbles

[taoranlu]

blowingbubbles QP37 bitstream

[zhaoyin]

A merge request has been submitted to fix this issue.
​https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM/merge_requests/848

[taoranlu]

The mismatch issue is fixed with the MR848 for HDR CTC.