Opened 6 years ago

Last modified 6 years ago

#326 closed defect

AddressSanitizer: heap-buffer-overflow — at Initial Version

Reported by: fbarbier Owned by:
Priority: minor Milestone:
Component: VTM Version: VTM-5.0
Keywords: Cc: vzakharc, yuwenhe, jvet@…

Description

When building with ASAN, failures may be found.
Please reproduce with the following commands :

git checkout 04d626a060dd0140ae97b7cd0e4efafd0fcf301b

cd build
cmake .. -DCMAKE_BUILD_TYPE=Debug -DCMAKE_CXX_FLAGS="-fsanitize=address" -DCMAKE_EXE_LINKER_FLAGS="-fsanitize=address"
make -j 8
cd ..


./bin/EncoderAppStaticd --SourceWidth=192 --SourceHeight=192 --InputChromaFormat=420 --InputBitDepth=10 --Profile=next --FrameRate=60 --FramesToBeEncoded=1 --GOPSize=4 '--Frame1=B 1 5 -6.5 0.2590 0 0 1.0 0 0 0 4 4 -1 -5 -9 -13 0' '--Frame2=B 2 4 -6.5 0.2590 0 0 1.0 0 0 0 4 4 -1 -2 -6 -10 1 -1 5 1 1 1 0 1' '--Frame3=B 3 5 -6.5 0.2590 0 0 1.0 0 0 0 4 4 -1 -3 -7 -11 1 -1 5 0 1 1 1 1' '--Frame4=B 4 1  0.0 0.0    0 0 1.0 0 0 0 4 4 -1 -4 -8 -12 1 -1 5 0 1 1 1 1' --FastSearch=2 --LCTUFast=1 --LumaLevelToDeltaQPMode=1 --MaxCUWidth=16 --MaxCUHeight=24 --CTUSize=64 --MaxPartitionDepth=5 --PCMEnabledFlag=1 --SAO=0 --LoopFilterDisable=1 --ALF=1 --DisableIntraInInter=0 --DepQuant=1 --DualITree=0 --LMChroma=1 --TransformSkip=0 --MaxDeltaQP=0 --MTS=3 --IBC=0 --IMV=1 --Affine=1 --AffineType=1 --AffineAmvr=0 --MHIntra=0 --Triangle=1 --MIP=1 --SMVD=0 --SBT=0 --RDPCM=0 -i source.yuv -b encoded.vvc

=================================================================
==3913==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x63100012ba4b at pc 0x000000925935 bp 0x7ffc02255690 sp 0x7ffc02255688
READ of size 16 at 0x63100012ba4b thread T0
==3913==WARNING: invalid path to external symbolizer!
==3913==WARNING: Failed to use and restart external symbolizer!

#0 0x925934 (/home/fredb/projects/vtm/bin/EncoderAppStaticd+0x925934)
#1 0xf622b9 (/home/fredb/projects/vtm/bin/EncoderAppStaticd+0xf622b9)
#2 0xdc1824 (/home/fredb/projects/vtm/bin/EncoderAppStaticd+0xdc1824)
#3 0xb3146b (/home/fredb/projects/vtm/bin/EncoderAppStaticd+0xb3146b)
#4 0xb8507d (/home/fredb/projects/vtm/bin/EncoderAppStaticd+0xb8507d)
#5 0x53d4d1 (/home/fredb/projects/vtm/bin/EncoderAppStaticd+0x53d4d1)
#6 0x6178cc (/home/fredb/projects/vtm/bin/EncoderAppStaticd+0x6178cc)
#7 0x7f8714c4109a (/lib/x86_64-linux-gnu/libc.so.6+0x2409a)
#8 0x4540e9 (/home/fredb/projects/vtm/bin/EncoderAppStaticd+0x4540e9)

0x63100012ba4b is located 3 bytes to the right of 78408-byte region [0x631000118800,0x63100012ba48)
allocated by thread T0 here:

#0 0x4fcc09 (/home/fredb/projects/vtm/bin/EncoderAppStaticd+0x4fcc09)
#1 0x638e31 (/home/fredb/projects/vtm/bin/EncoderAppStaticd+0x638e31)
#2 0x630462 (/home/fredb/projects/vtm/bin/EncoderAppStaticd+0x630462)
#3 0xf65ef7 (/home/fredb/projects/vtm/bin/EncoderAppStaticd+0xf65ef7)
#4 0xdbbf95 (/home/fredb/projects/vtm/bin/EncoderAppStaticd+0xdbbf95)
#5 0xb7735c (/home/fredb/projects/vtm/bin/EncoderAppStaticd+0xb7735c)
#6 0x53bd15 (/home/fredb/projects/vtm/bin/EncoderAppStaticd+0x53bd15)
#7 0x53c626 (/home/fredb/projects/vtm/bin/EncoderAppStaticd+0x53c626)
#8 0x6178cc (/home/fredb/projects/vtm/bin/EncoderAppStaticd+0x6178cc)
#9 0x7f8714c4109a (/lib/x86_64-linux-gnu/libc.so.6+0x2409a)

SUMMARY: AddressSanitizer: heap-buffer-overflow (/home/fredb/projects/vtm/bin/EncoderAppStaticd+0x925934)
Shadow bytes around the buggy address:

0x0c628001d6f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0x0c628001d700: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0x0c628001d710: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0x0c628001d720: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0x0c628001d730: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

=>0x0c628001d740: 00 00 00 00 00 00 00 00 00[fa]fa fa fa fa fa fa

0x0c628001d750: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
0x0c628001d760: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
0x0c628001d770: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
0x0c628001d780: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
0x0c628001d790: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa

Shadow byte legend (one shadow byte represents 8 application bytes):

Addressable: 00
Partially addressable: 01 02 03 04 05 06 07
Heap left redzone: fa
Freed heap region: fd
Stack left redzone: f1
Stack mid redzone: f2
Stack right redzone: f3
Stack after return: f5
Stack use after scope: f8
Global redzone: f9
Global init order: f6
Poisoned by user: f7
Container overflow: fc
Array cookie: ac
Intra object redzone: bb
ASan internal: fe
Left alloca redzone: ca
Right alloca redzone: cb
Shadow gap: cc

Change history (1)

Changed 6 years ago by fbarbier

Note: See TracTickets for help on using tickets.