JSC Crash in revertCall executed from unlinkFor

[Gavriliuk]

We get reported more than 7000 such crashes per month

Crash thread #0
Frame Signature Module Source
#0 revertCall libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/WTF/wtf/SentinelLinkedList.h:60 (0x0)
#1 unlinkFor libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/JavaScriptCore/jit/Repatch.cpp:646 (0x0)
#2 unlink libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/JavaScriptCore/bytecode/CallLinkInfo.cpp:93 (0x8)
#3 unlink libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/JavaScriptCore/jit/PolymorphicCallStubRoutine.cpp:50 (0x4)
#4 unlinkIncomingCalls libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/JavaScriptCore/bytecode/CodeBlock.cpp:3353 (0x4)
#5 installCode libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/JavaScriptCore/runtime/ScriptExecutable.cpp:169 (0x0)
#6 installCode libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/JavaScriptCore/runtime/ScriptExecutable.cpp:77 (0x0)
#7 compilationDidComplete libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/JavaScriptCore/jit/JITToDFGDeferredCompilationCallback.cpp:66 (0x8)
#8 compile libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/JavaScriptCore/dfg/DFGDriver.cpp:133 (0x14)
#9 operationOptimize libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/JavaScriptCore/jit/JITOperations.cpp:1443 (0x14)
#10 @0x5c709c60
#11 allocate libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/JavaScriptCore/assembler/LinkBuffer.cpp:238 (0x1c)
#12 finalizeCodeWithoutDisassembly libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/JavaScriptCore/assembler/LinkBuffer.cpp:49 (0x0)
#13 @0xfffffff3
#14 _fini libWPEWebKit.so.0.0.20161117
#15 _fini libWPEWebKit.so.0.0.20161117
#16 loadVarargs libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/JavaScriptCore/interpreter/Interpreter.cpp:250 (0x14)
#17 @0xfffffff3
#18 loadVarargs libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/JavaScriptCore/interpreter/Interpreter.cpp:250 (0x14)
#19 setupVarargsFrame libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/JavaScriptCore/interpreter/Interpreter.cpp:269 (0x0)
#20 operationSetupVarargsFrame libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/JavaScriptCore/jit/JITOperations.cpp:2023 (0x8)
#21 @0x5c71c534
#22 isCurrentThreadBusy libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/JavaScriptCore/heap/Heap.cpp:1977 (0x0)
#23 executeCall libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/JavaScriptCore/interpreter/Interpreter.cpp:955 (0x10)
#24 call libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/JavaScriptCore/runtime/CallData.cpp:39 (0x0)
#25 boundThisNoArgsFunctionCall libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/JavaScriptCore/runtime/JSBoundFunction.cpp:54 (0x28)
#26 libWPEWebKit.so.0.0.20161117@0x92b70c libWPEWebKit.so.0.0.20161117
#27 getOwnPropertyDescriptor libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/JavaScriptCore/runtime/JSObject.cpp:2834 (0x18)
#28 @0xfffffff8
#29 lock libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/JavaScriptCore/runtime/JSLock.cpp:129 (0x14)
#30 @0xfffffff7
#31 protect libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/WTF/wtf/HashCountedSet.h:193 (0x0)
#32 JSValueProtect libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/JavaScriptCore/API/JSValueRef.cpp:437 (0x4)
#33 AAMP_JSListener::Event libaamp.so /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/aamp/1.99+git1c43a944775534b243be2f4ec8782cd15788601c-r0/git/jsbindings/jsbindings.cpp:466 (0xc)
#34 @0x7fa24b20
#35 PrivateInstanceAAMP::SendEventSync libaamp.so /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/aamp/1.99+git1c43a944775534b243be2f4ec8782cd15788601c-r0/git/main_aamp.cpp:555 (0x8)
#36 PrivateInstanceAAMP::ReportProgress libaamp.so /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/aamp/1.99+git1c43a944775534b243be2f4ec8782cd15788601c-r0/git/main_aamp.cpp:336 (0x8)
#37 ProgressCallbackOnTimeout libaamp.so /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/aamp/1.99+git1c43a944775534b243be2f4ec8782cd15788601c-r0/git/aampgstplayer.cpp:321 (0x0)
#38 g_timeout_dispatch libglib-2.0.so.0.4800.1 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/glib-2.0/1_2.48.1-r0/glib-2.48.1/glib/gmain.c:4577 (0x4)
#39 g_main_context_dispatch libglib-2.0.so.0.4800.1 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/glib-2.0/1_2.48.1-r0/glib-2.48.1/glib/gmain.c:3154 (0x0)
#40 g_main_context_iterate libglib-2.0.so.0.4800.1 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/glib-2.0/1_2.48.1-r0/glib-2.48.1/glib/gmain.c:3840 (0x4)
#41 g_main_loop_run libglib-2.0.so.0.4800.1 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/glib-2.0/1_2.48.1-r0/glib-2.48.1/glib/gmain.c:4034 (0x8)
#42 run libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/WTF/wtf/glib/RunLoopGLib.cpp:97 (0x4)
#43 ChildProcessMain<WebKit::WebProcess, WebKit::WebProcessMain> libWPEWebKit.so.0.0.20161117 /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/WebKit2/Shared/unix/ChildProcessMain.h:61 (0x4)
#44 main WPEWebProcess /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/wpe-webkit/0.3.1+gitAUTOINC+9a8f03fb37-r0/git/Source/WebKit2/WebProcess/EntryPoint/unix/WebProcessMain.cpp:52 (0x8)
#45 __libc_start_main libc-2.19.so /mnt/jenkins/workspace/PACEXG2V2-Yocto-Build/build-pacexg2v2/tmp/work/mips32el-rdk-linux/eglibc/2.19-r0/eglibc-2.19/libc/csu/libc-start.c:285 (0xc)
#46 __start WPEWebProcess

[guijemont]

Can you provide details of your configuration (hardware and software)/compilation options and steps to reproduce to help us investigate this?

[Gavriliuk]

The issue is being reported from different types of STB
Here is the last week statistics:
| SX022AN | 672 |
| PX032ANI | 512 |
| PX022AN | 372 |
| AX013AN | 123 |
| MX011AN | 88 |
| CS011AN | 86 |

The software is a standard Comcast software stack for TV STB

Which compilation options are you interested? Do I have to provide a Makefile etc.?

No steps to reproduce is known, the issue happens during watching video content in AAMPMediaPlayer

[Gavriliuk]

The stacktrace from more recent build image (with WPE 0.4.1):

0|0|libWPEWebKit.so.0.0.20170728|revertCall|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WTF/wtf/SentinelLinkedList.h|60|0x0
0|1|libWPEWebKit.so.0.0.20170728|unlinkFor|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/jit/Repatch.cpp|688|0x0
0|2|libWPEWebKit.so.0.0.20170728|unlink|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/bytecode/CallLinkInfo.cpp|93|0x4
0|3|libWPEWebKit.so.0.0.20170728|unlink|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/jit/PolymorphicCallStubRoutine.cpp|51|0x4
0|4|libWPEWebKit.so.0.0.20170728|unlinkIncomingCalls|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/bytecode/CodeBlock.cpp|1843|0x4
0|5|libWPEWebKit.so.0.0.20170728|installCode|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/runtime/ScriptExecutable.cpp|166|0x0
0|6|libWPEWebKit.so.0.0.20170728|jettison|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/bytecode/CodeBlock.cpp|2001|0x10
0|7|libWPEWebKit.so.0.0.20170728|finalizeUnconditionally|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/bytecode/CodeBlock.cpp|1423|0x10
0|8|libWPEWebKit.so.0.0.20170728|runEndPhase|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/heap/Heap.cpp|557|0x8
0|9|libWPEWebKit.so.0.0.20170728|runCurrentPhase|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/heap/Heap.cpp|1131|0x8
0|10|libWPEWebKit.so.0.0.20170728|implFunction|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/heap/Heap.cpp|1735|0xc
0|11|libWPEWebKit.so.0.0.20170728|callWithCurrentThreadState|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WTF/wtf/ScopedLambda.h|56|0x0
0|12|libWPEWebKit.so.0.0.20170728|collectInMutatorThread|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/heap/Heap.cpp|1747|0x0
0|13|libWPEWebKit.so.0.0.20170728|stopIfNecessarySlow|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/heap/Heap.cpp|1716|0x0
0|14|libWPEWebKit.so.0.0.20170728|stopIfNecessarySlow|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/heap/Heap.cpp|1690|0x4
0|15|libWPEWebKit.so.0.0.20170728|collectIfNecessaryOrDefer|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/heap/HeapInlines.h|269|0x0
0|16|libWPEWebKit.so.0.0.20170728|repatchGetByID|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/heap/HeapInlines.h|198|0x4
0|17|libWPEWebKit.so.0.0.20170728|operationGetByIdOptimize|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/jit/JITOperations.cpp|268|0x28
0|18|||||0x6f1dc4c4
0|19|libWPEWebKit.so.0.0.20170728|execute|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/jit/JITCode.cpp|81|0x8
0|20|libWPEWebKit.so.0.0.20170728|executeCall|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/interpreter/Interpreter.cpp|986|0x10
0|21|libWPEWebKit.so.0.0.20170728|call|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/runtime/CallData.cpp|41|0x0
0|22|libWPEWebKit.so.0.0.20170728|boundThisNoArgsFunctionCall|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/runtime/JSBoundFunction.cpp|54|0x28
0|23|||||0x6ec13f30
0|24|libWPEWebKit.so.0.0.20170728|execute|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/jit/JITCode.cpp|81|0x8
0|25|libWPEWebKit.so.0.0.20170728|executeCall|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/interpreter/Interpreter.cpp|986|0x10
0|26|libWPEWebKit.so.0.0.20170728|call|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/runtime/CallData.cpp|41|0x0
0|27|libWPEWebKit.so.0.0.20170728|boundThisNoArgsFunctionCall|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/runtime/JSBoundFunction.cpp|54|0x28
0|28|libWPEWebKit.so.0.0.20170728||||0x1702708
0|29|libWPEWebKit.so.0.0.20170728|executeCall|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/interpreter/Interpreter.cpp|988|0x10
0|30|libWPEWebKit.so.0.0.20170728|call|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/runtime/CallData.cpp|41|0x0
0|31|libWPEWebKit.so.0.0.20170728|call|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/runtime/CallData.cpp|48|0x0
0|32|libWPEWebKit.so.0.0.20170728|profiledCall|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/runtime/CallData.cpp|67|0x0
0|33|libWPEWebKit.so.0.0.20170728|handleEvent|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WebCore/bindings/js/JSMainThreadExecState.h|72|0x24
0|34|libWPEWebKit.so.0.0.20170728|fireEventListeners|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WebCore/dom/EventTarget.cpp|294|0xc
0|35|libWPEWebKit.so.0.0.20170728|fireEventListeners|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WebCore/dom/EventTarget.cpp|238|0x1c
0|36|libWPEWebKit.so.0.0.20170728|handleLocalEvents|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WebCore/dom/EventContext.cpp|54|0x8
0|37|libWPEWebKit.so.0.0.20170728|dispatchEvent|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WebCore/dom/EventDispatcher.cpp|91|0x8
0|38|libWPEWebKit.so.0.0.20170728|dispatchOneEvent|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WebCore/dom/GenericEventQueue.cpp|70|0x8
0|39|libWPEWebKit.so.0.0.20170728|dispatchOneTask|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WTF/wtf/Function.h|56|0x0
0|40|libWPEWebKit.so.0.0.20170728|sharedTimerFired|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WebCore/platform/GenericTaskQueue.cpp|65|0x0
0|41|libWPEWebKit.so.0.0.20170728|sharedTimerFiredInternal|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WebCore/platform/ThreadTimers.cpp|118|0x0
0|42|libWPEWebKit.so.0.0.20170728|_FUN|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WTF/wtf/glib/RunLoopGLib.cpp|166|0x0
0|43|libglib-2.0.so.0.4800.2|g_main_context_dispatch|/usr/src/debug/glib-2.0/1_2.48.2-r0/glib-2.48.2/glib/gmain.c|3154|0x0
0|44|libglib-2.0.so.0.4800.2|g_main_context_iterate|/usr/src/debug/glib-2.0/1_2.48.2-r0/glib-2.48.2/glib/gmain.c|3844|0x4
0|45|libglib-2.0.so.0.4800.2|g_main_loop_run|/usr/src/debug/glib-2.0/1_2.48.2-r0/glib-2.48.2/glib/gmain.c|4038|0x8
0|46|libWPEWebKit.so.0.0.20170728|run|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WTF/wtf/glib/RunLoopGLib.cpp|96|0x4
0|47|libWPEWebKit.so.0.0.20170728|ChildProcessMain<WebKit::WebProcess, WebKit::WebProcessMain>|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WebKit/Shared/unix/ChildProcessMain.h|61|0x4
0|48|WPEWebProcess|main|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WebKit/WebProcess/EntryPoint/unix/WebProcessMain.cpp|60|0x8
0|49|libc-2.24.so||||0x193c4
0|50|ld-2.24.so||||0xc5c

[Gavriliuk]

The stacktrace from more recent build image (with WPE 0.4.1):

0|0|libWPEWebKit.so.0.0.20170728|revertCall|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WTF/wtf/SentinelLinkedList.h|60|0x0
0|1|libWPEWebKit.so.0.0.20170728|unlinkFor|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/jit/Repatch.cpp|688|0x0
0|2|libWPEWebKit.so.0.0.20170728|unlink|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/bytecode/CallLinkInfo.cpp|93|0x4
0|3|libWPEWebKit.so.0.0.20170728|unlink|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/jit/PolymorphicCallStubRoutine.cpp|51|0x4
0|4|libWPEWebKit.so.0.0.20170728|unlinkIncomingCalls|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/bytecode/CodeBlock.cpp|1843|0x4
0|5|libWPEWebKit.so.0.0.20170728|installCode|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/runtime/ScriptExecutable.cpp|166|0x0
0|6|libWPEWebKit.so.0.0.20170728|jettison|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/bytecode/CodeBlock.cpp|2001|0x10
0|7|libWPEWebKit.so.0.0.20170728|finalizeUnconditionally|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/bytecode/CodeBlock.cpp|1423|0x10
0|8|libWPEWebKit.so.0.0.20170728|runEndPhase|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/heap/Heap.cpp|557|0x8
0|9|libWPEWebKit.so.0.0.20170728|runCurrentPhase|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/heap/Heap.cpp|1131|0x8
0|10|libWPEWebKit.so.0.0.20170728|implFunction|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/heap/Heap.cpp|1735|0xc
0|11|libWPEWebKit.so.0.0.20170728|callWithCurrentThreadState|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WTF/wtf/ScopedLambda.h|56|0x0
0|12|libWPEWebKit.so.0.0.20170728|collectInMutatorThread|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/heap/Heap.cpp|1747|0x0
0|13|libWPEWebKit.so.0.0.20170728|stopIfNecessarySlow|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/heap/Heap.cpp|1716|0x0
0|14|libWPEWebKit.so.0.0.20170728|stopIfNecessarySlow|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/heap/Heap.cpp|1690|0x4
0|15|libWPEWebKit.so.0.0.20170728|collectIfNecessaryOrDefer|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/heap/HeapInlines.h|269|0x0
0|16|libWPEWebKit.so.0.0.20170728|repatchGetByID|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/heap/HeapInlines.h|198|0x4
0|17|libWPEWebKit.so.0.0.20170728|operationGetByIdOptimize|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/jit/JITOperations.cpp|268|0x28
0|18|||||0x6f1dc4c4
0|19|libWPEWebKit.so.0.0.20170728|execute|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/jit/JITCode.cpp|81|0x8
0|20|libWPEWebKit.so.0.0.20170728|executeCall|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/interpreter/Interpreter.cpp|986|0x10
0|21|libWPEWebKit.so.0.0.20170728|call|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/runtime/CallData.cpp|41|0x0
0|22|libWPEWebKit.so.0.0.20170728|boundThisNoArgsFunctionCall|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/runtime/JSBoundFunction.cpp|54|0x28
0|23|||||0x6ec13f30
0|24|libWPEWebKit.so.0.0.20170728|execute|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/jit/JITCode.cpp|81|0x8
0|25|libWPEWebKit.so.0.0.20170728|executeCall|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/interpreter/Interpreter.cpp|986|0x10
0|26|libWPEWebKit.so.0.0.20170728|call|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/runtime/CallData.cpp|41|0x0
0|27|libWPEWebKit.so.0.0.20170728|boundThisNoArgsFunctionCall|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/runtime/JSBoundFunction.cpp|54|0x28
0|28|libWPEWebKit.so.0.0.20170728||||0x1702708
0|29|libWPEWebKit.so.0.0.20170728|executeCall|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/interpreter/Interpreter.cpp|988|0x10
0|30|libWPEWebKit.so.0.0.20170728|call|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/runtime/CallData.cpp|41|0x0
0|31|libWPEWebKit.so.0.0.20170728|call|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/runtime/CallData.cpp|48|0x0
0|32|libWPEWebKit.so.0.0.20170728|profiledCall|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/JavaScriptCore/runtime/CallData.cpp|67|0x0
0|33|libWPEWebKit.so.0.0.20170728|handleEvent|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WebCore/bindings/js/JSMainThreadExecState.h|72|0x24
0|34|libWPEWebKit.so.0.0.20170728|fireEventListeners|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WebCore/dom/EventTarget.cpp|294|0xc
0|35|libWPEWebKit.so.0.0.20170728|fireEventListeners|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WebCore/dom/EventTarget.cpp|238|0x1c
0|36|libWPEWebKit.so.0.0.20170728|handleLocalEvents|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WebCore/dom/EventContext.cpp|54|0x8
0|37|libWPEWebKit.so.0.0.20170728|dispatchEvent|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WebCore/dom/EventDispatcher.cpp|91|0x8
0|38|libWPEWebKit.so.0.0.20170728|dispatchOneEvent|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WebCore/dom/GenericEventQueue.cpp|70|0x8
0|39|libWPEWebKit.so.0.0.20170728|dispatchOneTask|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WTF/wtf/Function.h|56|0x0
0|40|libWPEWebKit.so.0.0.20170728|sharedTimerFired|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WebCore/platform/GenericTaskQueue.cpp|65|0x0
0|41|libWPEWebKit.so.0.0.20170728|sharedTimerFiredInternal|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WebCore/platform/ThreadTimers.cpp|118|0x0
0|42|libWPEWebKit.so.0.0.20170728|_FUN|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WTF/wtf/glib/RunLoopGLib.cpp|166|0x0
0|43|libglib-2.0.so.0.4800.2|g_main_context_dispatch|/usr/src/debug/glib-2.0/1_2.48.2-r0/glib-2.48.2/glib/gmain.c|3154|0x0
0|44|libglib-2.0.so.0.4800.2|g_main_context_iterate|/usr/src/debug/glib-2.0/1_2.48.2-r0/glib-2.48.2/glib/gmain.c|3844|0x4
0|45|libglib-2.0.so.0.4800.2|g_main_loop_run|/usr/src/debug/glib-2.0/1_2.48.2-r0/glib-2.48.2/glib/gmain.c|4038|0x8
0|46|libWPEWebKit.so.0.0.20170728|run|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WTF/wtf/glib/RunLoopGLib.cpp|96|0x4
0|47|libWPEWebKit.so.0.0.20170728|ChildProcessMain<WebKit::WebProcess, WebKit::WebProcessMain>|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WebKit/Shared/unix/ChildProcessMain.h|61|0x4
0|48|WPEWebProcess|main|/usr/src/debug/wpe-webkit/0.4+gitAUTOINC+c699f32f92-r0/git/Source/WebKit/WebProcess/EntryPoint/unix/WebProcessMain.cpp|60|0x8
0|49|libc-2.24.so||||0x193c4
0|50|ld-2.24.so||||0xc5c

[Gavriliuk]

All analyzed crashreports have the same symptoms:

• Polled memory pressure (critical or non-critical)
• Very high memory usage for WPEWebProcess in process list

Below are 4 examples with fragments of logs

1. Date Crashed: 2019-04-10 09:50:20

2019 Apr 10 09:50:18.153798 pacexi3v2 runAppManager.sh[4323]: Polled memory pressure (non-critical)
2019 Apr 10 09:50:18.537878 pacexi3v2 runAppManager.sh[4323]: Memory pressure relief: Total: res = 165416960/165416960/0, res+swap = 162312192/162312192/0

top - 09:50:21 up 22:47, 0 users, load average: 2.21, 1.97, 2.02
Tasks: 123 total, 1 running, 122 sleeping, 0 stopped, 0 zombie, 2 block
Cpu(s): 17.2%us, 15.9%sy, 1.9%ni, 63.1%id, 0.0%wa, 0.0%hi, 2.0%si, 0.0%st
Mem: 641176k total, 559036k used, 82140k free, 7972k buffers
Swap: 320584k total, 24384k used, 296200k free, 138116k cached

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
24572 root 20 0 868m 197m 38m S 0 31.5 113:05.54 WPEWebProcess

2. Date Crashed: 2019-04-10 06:17:25

2019 Apr 10 06:17:11.227393 pacexi3v2 runAppManager.sh[3865]: Polled memory pressure (critical)
2019 Apr 10 06:17:12.248228 pacexi3v2 runAppManager.sh[3865]: Memory pressure relief: Total: res = 192520192/171425792/-21094400, res+swap = 189415424/168321024/-21094400

top - 06:17:25 up 23:20, 0 users, load average: 1.10, 1.37, 1.58
Tasks: 124 total, 2 running, 122 sleeping, 0 stopped, 0 zombie, 2 block
Cpu(s): 14.8%us, 13.0%sy, 1.3%ni, 68.5%id, 1.1%wa, 0.0%hi, 1.3%si, 0.0%st
Mem: 641176k total, 603064k used, 38112k free, 18244k buffers
Swap: 320584k total, 24308k used, 296276k free, 147200k cached

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
32590 root 20 0 842m 214m 43m S 0 34.2 99:32.08 WPEWebProcess

3. Date Crashed: 2019-04-10 06:17:25

2019 Apr 10 06:17:11.227393 pacexi3v2 runAppManager.sh[3865]: Polled memory pressure (critical)
2019 Apr 10 06:17:12.248228 pacexi3v2 runAppManager.sh[3865]: Memory pressure relief: Total: res = 192520192/171425792/-21094400, res+swap = 189415424/168321024/-21094400

top - 06:17:25 up 23:20, 0 users, load average: 1.10, 1.37, 1.58
Tasks: 124 total, 2 running, 122 sleeping, 0 stopped, 0 zombie, 2 block
Cpu(s): 14.8%us, 13.0%sy, 1.3%ni, 68.5%id, 1.1%wa, 0.0%hi, 1.3%si, 0.0%st
Mem: 641176k total, 603064k used, 38112k free, 18244k buffers
Swap: 320584k total, 24308k used, 296276k free, 147200k cached

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
32590 root 20 0 842m 214m 43m S 0 34.2 99:32.08 WPEWebProcess

4. Date Crashed: 2019-04-10 05:01:27

2019 Apr 10 05:01:06.930529 pacexi3v2 runAppManager.sh[4004]: Polled memory pressure (critical)
2019 Apr 10 05:01:07.868783 pacexi3v2 runAppManager.sh[4004]: Memory pressure relief: Total: res = 170463232/145711104/-24752128, res+swap = 167358464/141697024/-25661440

top - 05:01:28 up 19:58, 0 users, load average: 3.01, 3.30, 2.63
Tasks: 123 total, 1 running, 122 sleeping, 0 stopped, 0 zombie, 0 block
Cpu(s): 14.7%us, 19.5%sy, 1.5%ni, 62.0%id, 0.0%wa, 0.0%hi, 2.3%si, 0.0%st
Mem: 641176k total, 580336k used, 60840k free, 11084k buffers
Swap: 320584k total, 19504k used, 301080k free, 149804k cached

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
888 root 20 0 744m 188m 43m S 0 30.1 1:55.54 WPEWebProcess

Thus, we can assume that we are dealing with memory leaks

[ryadav115]

I would like to bring your attention for the crash occuring mostly in the MIPS devices (Pace XG2v2, PXi3v2, Samsung XG2v2, Ciso C8, Pace XG1v3, Arris XG1V3)with the signature "unlink".

Affected WPE versions: 0.4.4, 2.22.2,2.22.3

In the investigation, similar callstack is observed.

Call Stack:
70a64839_1.txt

Steps for reproduction:
step 1: lunch webapp (Youtube, Hulu, Amazon prime)
step 2: play assests ( Observe crash)

From, the core logs
We again see, the condition where for 0% CPU usage higher Memory% usage.
Core logs :
Crash 1:
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
3900 root 20 0 913328 196224 51516 S 0.0 29.8 195:16.62 WPEWebProc+

Crash 2:
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
17180 root 20 0 738376 193432 34164 S 0.0 30.3 309:46.56 WPEWebProc+

[modeveci]

Inactive ticket for long time!

Closing the ticket; if you think it is still relevant and/or valid for the latest version/s. Please do not hesitate to re-open!