Opened 7 years ago

Closed 7 years ago

#96 closed defect (fixed)

Segmentation fault with low delay P config after JVET-L0646 integration

Reported by: fbossen Owned by:
Priority: blocker Milestone: VTM-3.0
Component: VTM Version:
Keywords: Cc: ksuehring, XiangLi, fbossen, jvet@…

Description

Segmentation fault occurs after encoding first I frame.

Version:

HEAD detached at 3c95ec7

Encoder parameters:

-c cfg/per-sequence/RaceHorses.cfg -c cfg/encoder_lowdelay_P_vtm.cfg -dph 1 -q 37

Encoder output:

POC    0 TId: 0 ( I-SLICE, QP 36 )      37104 bits [Y 31.7038 dB    U 36.6290 dB    V 36.9594 dB] [ET    12 ] [L0 ] [L1 ] [MD5:f2c90d233619cd127efc945d8220e07c,eaba0839afb10aa8363d3baa4d19577e,dc513735cccce3c88d573d0914196ad5]
Process 56895 stopped
* thread #1, queue = 'com.apple.main-thread', stop reason = EXC_BAD_ACCESS (code=1, address=0x12f5a0730)
    frame #0: 0x0000000100183635 EncoderApp`EncCu::xCheckRDCostInterIMV(CodingStructure*&, CodingStructure*&, Partitioner&, EncTestMode const&) + 3653
EncoderApp`EncCu::xCheckRDCostInterIMV:
->  0x100183635 <+3653>: subl   0x470(%rax,%rsi,4), %ebx
    0x10018363c <+3660>: movl   %ebx, %r8d
    0x10018363f <+3663>: movl   %ebx, %esi
    0x100183641 <+3665>: sarl   $0x1f, %r8d
Target 0: (EncoderApp) stopped.

Attachments (1)

patch.diff​ (1.1 KB) - added by chingyeh.chen 7 years ago.
patch

Download all attachments as: .zip

Change history (3)

Changed 7 years ago by chingyeh.chen

patch

comment:1 Changed 7 years ago by chingyeh.chen

It seems that xIsGBiSkip() is misused in LDP case.
One additional check is added in xIsGBiSkip().

comment:2 Changed 7 years ago by fbossen

  • Resolution set to fixed
  • Status changed from new to closed

Fix was pushed to master: commit ad6f0391

Note: See TracTickets for help on using tickets.