Opened 6 years ago

Closed 6 years ago

#171 closed defect (fixed)

Encoder crash: Negative shift in TrQuant.cpp

Reported by: forayr Owned by:
Priority: major Milestone: VTM-4.0
Component: VTM Version:
Keywords: Cc: ksuehring, XiangLi, fbossen, jvet@…

Description

git clone ​https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM.git vtm
git checkout a2f871acebf0bd32fcf9ed73148d2abc3efc5c89
mkdir vtm/build && cd vtm/build && cmake .. && make -j8 && cd ../bin
./EncoderAppStatic --SourceWidth=64 --SourceHeight=64 --InputChromaFormat=420 --InputBitDepth=8 --Profile=next --FrameRate=60 --FramesToBeEncoded=1 --TULog2MaxSize=6 --MaxPartitionDepth=5 --LargeCTU=1 --GOPSize=1 --Frame1="B 1 5 -6.5 0.2590 0 0 1.0 0 0 0 1 1 -1 0" --ALF=0 -i src.yuv -b yo.vvc

ERROR: In function "xT" in /tmp/vtm/source/Lib/CommonLib/TrQuant.cpp:408: Negative shift

Attachments (2)

src.yuv​ (6.0 KB) - added by forayr 6 years ago.
shift_fix.patch​ (7.1 KB) - added by ksuehring 6 years ago.
proposed fix

Download all attachments as: .zip

Change history (8)

Changed 6 years ago by forayr

comment:1 Changed 6 years ago by ksuehring

Which compiler are you using?

comment:2 Changed 6 years ago by forayr

g++ 8.2.0

comment:3 Changed 6 years ago by ksuehring

Ah, it's a runtime error, not a compiler error. I'm looking at it.

Changed 6 years ago by ksuehring

proposed fix

comment:4 Changed 6 years ago by ksuehring

Can you please try the attached patch?

comment:5 Changed 6 years ago by forayr

The patch works: no more crash.
Thanks.

comment:6 Changed 6 years ago by fbossen

  • Resolution set to fixed
  • Status changed from new to closed

fixed in ​https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM/merge_requests/250

Note: See TracTickets for help on using tickets.