Channel "AWAITING_UNILATERAL" since days. Attempted force closing, CPU 100% #2171

Description

@gabridome

I found one of my channel was in "AWAITING_UNILATERAL" so I waited but days after it was still in that state.

Relevant log with grep peerID:

2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 0: 10648 satoshi (SEGWIT) 695254bb08add33af6f907960913869c25903c967541b2b8765be96431d2cb59? [100/260]
2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 1: 2005802 satoshi (SEGWIT) bd729c73e2cd2647f5ce6a2ebd24419720486f720124d9e0c66649b0b3d2835d? 2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 2: 252848 satoshi (SEGWIT) bbe3783d4c7fde8eb6433403fc1c34fa0098e4c738cedeac087243a1655a0b81? 2018-11-25T13:41:40.300Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Getting HSM to sign funding tx 2018-11-25T13:41:40.397Z lightningd(17827): lightning_channeld-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: pid 31244, msgfd 33 2018-11-25T13:41:40.397Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Waiting for funding confirmations 2018-11-25T13:41:41.001Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Peer internal error CHANNELD_AWAITING_LOCKIN: Funding broadcast exited with 25: error code: -25?error message:?Missing inputs? 2018-11-25T13:41:41.001Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Peer permanent failure in CHANNELD_AWAITING_LOCKIN: Internal error: Funding broadcast exited with 25: error code: -25?error message:?Missing inputs? 2018-11-25T13:41:41.001Z lightningd(17827): lightning_channeld-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Status closed, but not exited. Killing 2018-11-25T13:41:41.013Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: State changed from CHANNELD_AWAITING_LOCKIN to AWAITING_UNILATERAL 2018-11-25T13:42:58.779Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150096 msatoshi 2018-11-25T13:42:58.779Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (151109msat, 590blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 532217:2079:0 (150109msat, 446blk) -> 02529db69fd2ebd3126fb66fafa234fc3544477a23d509fe93ed229bb0e92e4f
b8 -> 548838:1988:1 (150098msat, 302blk) -> 031d2bbc75802689312220a017c6b51fa246efc59c7aa9355f6f7395038ffb4d6a -> 549057:2281:0 (150097msat, 158blk) -> 02c5371591b640da03f9a645e2ddfa5620d8537388b03ddd524d36766c0f550db0 -> 548930:191:0 (150096msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55
652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:04.954Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150218 msatoshi 2018-11-25T13:43:04.955Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152234msat, 446blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 550459:2332:1 (151234msat, 302blk) -> 0390b5d4492dc2f5318e5233ab2cebf6d48914881a33ef6a9c6bcdbb433ad986
d0 -> 550102:1165:0 (150219msat, 158blk) -> 02c5371591b640da03f9a645e2ddfa5620d8537388b03ddd524d36766c0f550db0 -> 548930:191:0 (150218msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:11.852Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150170 msatoshi
2018-11-25T13:43:11.852Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152271msat, 864blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 544611:1240:1 (151271msat, 720blk) -> 020e56a13babec99abdc2c4afbe34e1e44230d79b234c059fd4ff1e367765fdb
1b -> 541282:1481:0 (150271msat, 576blk) -> 03434a39cd9a537c852fc8fb72454086d726f9111e9f730cef4985c39c11fae944 -> 535271:1925:0 (150171msat, 432blk) -> 03bb88ccc444534da7b5b64b4f7b15e1eccb18e102db0e400d4b9cfe93763aa26d -> 549187:1932:1 (150170msat, 288blk) -> 03295d2e292565743a40bd44da227a820f873087
7bc3dfadebade8785bcf355258 -> 544098:2501:1 (150170msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:18.520Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150426 msatoshi
2018-11-25T13:43:18.520Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152615msat, 474blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 550180:1827:0 (151615msat, 330blk) -> 03a5927b64b1ea8657d5b770d61a3e2d0554fdb5d568773e0d6a92907913ca21
f6 -> 551184:469:0 (150628msat, 186blk) -> 0217090c397c3e8ced66abb7b8bf6e05cd49adde55766a7d14e2e4a541164b0935 -> 551318:1032:0 (150428msat, 172blk) -> 03f18da23535adee245903c81750745197e3079d3b88b3898981c90a5f2411008c -> 544620:1321:1 (150427msat, 158blk) -> 02c88a0df5e9ea7df582647f79b70b8e441047de3
08fd6b24408b8bd775f2234bd -> 549696:815:1 (150426msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 

Today I have tried to force close the channel but the command is stucked and the CPU is 100%.

lightning-cli close 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 true

I have interrupted the command but it seems like every command (getinfo included) is causing 100% CPU and the freezing of the command itself.

Restarting the service, I was able to collect some more infos:

$ lightning-cli listpeers 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 debug
{
"peers": [
{
"id": "03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56",
"connected": true,
"netaddr": [
"35.172.33.197:9735"
],
"global_features": "",
"local_features": "82",
"globalfeatures": "",
"localfeatures": "82",
"channels": [
{
"state": "AWAITING_UNILATERAL",
"scratch_txid": "458cd396b558361c2a616d0e2a0c56a50f5c8eacd9ca71e536d016bf3ae6233d",
"channel_id": "84649e5d4c01a17a4f1612c722df7be59e31cdf39f969a8794d2adcd54b1b731",
"funding_txid": "31b7b154cdadd294879a969ff3cd319ee57bdf22c712164f7aa1014c5d9e6484",
"msatoshi_to_us": 1000000000,
"msatoshi_to_us_min": 1000000000,
"msatoshi_to_us_max": 1000000000,
"msatoshi_total": 1000000000,
"dust_limit_satoshis": 546,
"max_htlc_value_in_flight_msat": 18446744073709551615,
"their_channel_reserve_satoshis": 10000,
"our_channel_reserve_satoshis": 10000,
"spendable_msatoshi": 990000000,
"htlc_minimum_msat": 0,
"their_to_self_delay": 144,
"our_to_self_delay": 144,
"max_accepted_htlcs": 483,
"status": [
"AWAITING_UNILATERAL:Attempting to reconnect"
],
"in_payments_offered": 0,
"in_msatoshi_offered": 0,
"in_payments_fulfilled": 0,
"in_msatoshi_fulfilled": 0,
"out_payments_offered": 0,
"out_msatoshi_offered": 0,
"out_payments_fulfilled": 0,
"out_msatoshi_fulfilled": 0,
"htlcs": [
]
}
],
"log": [
{
"type": "DEBUG",
"time": "5.221303026",
"source": "03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10:",
"log": "Peer has reconnected, state AWAITING_UNILATERAL"
},
{
"type": "DEBUG",
"time": "5.225104641",
"source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
"log": "pid 15044, msgfd 25"
},
{
"type": "DEBUG",
"time": "5.293310285",
"source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
"log": "peer_out WIRE_ERROR"
},
{
"type": "DEBUG",
"time": "5.294715801",
"source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
"log": "Handed peer, entering loop"
}
]
}
]
}

getinfo output

not possible (due to 100%CPU issue) but running tags/v0.6.2

EDIT: restarting the service:

lightning-cli getinfo
{
"id": "03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e",
"address": [
{
"type": "torv2",
"address": "byy4lqhaaley7e7k.onion",
"port": 9735
}
],
"binding": [
{
"type": "ipv4",
"address": "127.0.0.1",
"port": 9731
},
{
"type": "ipv4",
"address": "10.2.206.180",
"port": 9731
}
],
"version": "v0.6.2-modded",
"blockheight": 553513,
"network": "bitcoin",
"msatoshi_fees_collected": 0
}

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions

      , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all
       blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
      }
      } catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
      })();
      (function(){
      try {
      var __m = "github.com";
      var __re = new RegExp('^' + "github\\.com" + '
      
      Skip to content

      Channel "AWAITING_UNILATERAL" since days. Attempted force closing, CPU 100% #2171

      Description

      @gabridome

      I found one of my channel was in "AWAITING_UNILATERAL" so I waited but days after it was still in that state.

      Relevant log with grep peerID:

      2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 0: 10648 satoshi (SEGWIT) 695254bb08add33af6f907960913869c25903c967541b2b8765be96431d2cb59? [100/260]
      2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 1: 2005802 satoshi (SEGWIT) bd729c73e2cd2647f5ce6a2ebd24419720486f720124d9e0c66649b0b3d2835d? 2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 2: 252848 satoshi (SEGWIT) bbe3783d4c7fde8eb6433403fc1c34fa0098e4c738cedeac087243a1655a0b81? 2018-11-25T13:41:40.300Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Getting HSM to sign funding tx 2018-11-25T13:41:40.397Z lightningd(17827): lightning_channeld-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: pid 31244, msgfd 33 2018-11-25T13:41:40.397Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Waiting for funding confirmations 2018-11-25T13:41:41.001Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Peer internal error CHANNELD_AWAITING_LOCKIN: Funding broadcast exited with 25: error code: -25?error message:?Missing inputs? 2018-11-25T13:41:41.001Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Peer permanent failure in CHANNELD_AWAITING_LOCKIN: Internal error: Funding broadcast exited with 25: error code: -25?error message:?Missing inputs? 2018-11-25T13:41:41.001Z lightningd(17827): lightning_channeld-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Status closed, but not exited. Killing 2018-11-25T13:41:41.013Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: State changed from CHANNELD_AWAITING_LOCKIN to AWAITING_UNILATERAL 2018-11-25T13:42:58.779Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150096 msatoshi 2018-11-25T13:42:58.779Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (151109msat, 590blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 532217:2079:0 (150109msat, 446blk) -> 02529db69fd2ebd3126fb66fafa234fc3544477a23d509fe93ed229bb0e92e4f
      b8 -> 548838:1988:1 (150098msat, 302blk) -> 031d2bbc75802689312220a017c6b51fa246efc59c7aa9355f6f7395038ffb4d6a -> 549057:2281:0 (150097msat, 158blk) -> 02c5371591b640da03f9a645e2ddfa5620d8537388b03ddd524d36766c0f550db0 -> 548930:191:0 (150096msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55
      652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:04.954Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150218 msatoshi 2018-11-25T13:43:04.955Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152234msat, 446blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 550459:2332:1 (151234msat, 302blk) -> 0390b5d4492dc2f5318e5233ab2cebf6d48914881a33ef6a9c6bcdbb433ad986
      d0 -> 550102:1165:0 (150219msat, 158blk) -> 02c5371591b640da03f9a645e2ddfa5620d8537388b03ddd524d36766c0f550db0 -> 548930:191:0 (150218msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:11.852Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150170 msatoshi
      2018-11-25T13:43:11.852Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152271msat, 864blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 544611:1240:1 (151271msat, 720blk) -> 020e56a13babec99abdc2c4afbe34e1e44230d79b234c059fd4ff1e367765fdb
      1b -> 541282:1481:0 (150271msat, 576blk) -> 03434a39cd9a537c852fc8fb72454086d726f9111e9f730cef4985c39c11fae944 -> 535271:1925:0 (150171msat, 432blk) -> 03bb88ccc444534da7b5b64b4f7b15e1eccb18e102db0e400d4b9cfe93763aa26d -> 549187:1932:1 (150170msat, 288blk) -> 03295d2e292565743a40bd44da227a820f873087
      7bc3dfadebade8785bcf355258 -> 544098:2501:1 (150170msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:18.520Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150426 msatoshi
      2018-11-25T13:43:18.520Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152615msat, 474blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 550180:1827:0 (151615msat, 330blk) -> 03a5927b64b1ea8657d5b770d61a3e2d0554fdb5d568773e0d6a92907913ca21
      f6 -> 551184:469:0 (150628msat, 186blk) -> 0217090c397c3e8ced66abb7b8bf6e05cd49adde55766a7d14e2e4a541164b0935 -> 551318:1032:0 (150428msat, 172blk) -> 03f18da23535adee245903c81750745197e3079d3b88b3898981c90a5f2411008c -> 544620:1321:1 (150427msat, 158blk) -> 02c88a0df5e9ea7df582647f79b70b8e441047de3
      08fd6b24408b8bd775f2234bd -> 549696:815:1 (150426msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 

      Today I have tried to force close the channel but the command is stucked and the CPU is 100%.

      lightning-cli close 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 true
      

      I have interrupted the command but it seems like every command (getinfo included) is causing 100% CPU and the freezing of the command itself.

      Restarting the service, I was able to collect some more infos:

      $ lightning-cli listpeers 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 debug
      {
      "peers": [
      {
      "id": "03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56",
      "connected": true,
      "netaddr": [
      "35.172.33.197:9735"
      ],
      "global_features": "",
      "local_features": "82",
      "globalfeatures": "",
      "localfeatures": "82",
      "channels": [
      {
      "state": "AWAITING_UNILATERAL",
      "scratch_txid": "458cd396b558361c2a616d0e2a0c56a50f5c8eacd9ca71e536d016bf3ae6233d",
      "channel_id": "84649e5d4c01a17a4f1612c722df7be59e31cdf39f969a8794d2adcd54b1b731",
      "funding_txid": "31b7b154cdadd294879a969ff3cd319ee57bdf22c712164f7aa1014c5d9e6484",
      "msatoshi_to_us": 1000000000,
      "msatoshi_to_us_min": 1000000000,
      "msatoshi_to_us_max": 1000000000,
      "msatoshi_total": 1000000000,
      "dust_limit_satoshis": 546,
      "max_htlc_value_in_flight_msat": 18446744073709551615,
      "their_channel_reserve_satoshis": 10000,
      "our_channel_reserve_satoshis": 10000,
      "spendable_msatoshi": 990000000,
      "htlc_minimum_msat": 0,
      "their_to_self_delay": 144,
      "our_to_self_delay": 144,
      "max_accepted_htlcs": 483,
      "status": [
      "AWAITING_UNILATERAL:Attempting to reconnect"
      ],
      "in_payments_offered": 0,
      "in_msatoshi_offered": 0,
      "in_payments_fulfilled": 0,
      "in_msatoshi_fulfilled": 0,
      "out_payments_offered": 0,
      "out_msatoshi_offered": 0,
      "out_payments_fulfilled": 0,
      "out_msatoshi_fulfilled": 0,
      "htlcs": [
      ]
      }
      ],
      "log": [
      {
      "type": "DEBUG",
      "time": "5.221303026",
      "source": "03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10:",
      "log": "Peer has reconnected, state AWAITING_UNILATERAL"
      },
      {
      "type": "DEBUG",
      "time": "5.225104641",
      "source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
      "log": "pid 15044, msgfd 25"
      },
      {
      "type": "DEBUG",
      "time": "5.293310285",
      "source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
      "log": "peer_out WIRE_ERROR"
      },
      {
      "type": "DEBUG",
      "time": "5.294715801",
      "source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
      "log": "Handed peer, entering loop"
      }
      ]
      }
      ]
      }
      

      getinfo output

      not possible (due to 100%CPU issue) but running tags/v0.6.2

      EDIT: restarting the service:

      lightning-cli getinfo
      {
      "id": "03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e",
      "address": [
      {
      "type": "torv2",
      "address": "byy4lqhaaley7e7k.onion",
      "port": 9735
      }
      ],
      "binding": [
      {
      "type": "ipv4",
      "address": "127.0.0.1",
      "port": 9731
      },
      {
      "type": "ipv4",
      "address": "10.2.206.180",
      "port": 9731
      }
      ],
      "version": "v0.6.2-modded",
      "blockheight": 553513,
      "network": "bitcoin",
      "msatoshi_fees_collected": 0
      }
      

      Metadata

      Metadata

      Assignees

      No one assigned

        Labels

        No labels
        No labels

        Type

        No type

        Projects

        No projects

          Milestone

          No milestone

          Relationships

          None yet

          Development

          No branches or pull requests

          Issue actions

          , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix"); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
          Skip to content

          Channel "AWAITING_UNILATERAL" since days. Attempted force closing, CPU 100% #2171

          Description

          @gabridome

          I found one of my channel was in "AWAITING_UNILATERAL" so I waited but days after it was still in that state.

          Relevant log with grep peerID:

          2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 0: 10648 satoshi (SEGWIT) 695254bb08add33af6f907960913869c25903c967541b2b8765be96431d2cb59? [100/260]
          2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 1: 2005802 satoshi (SEGWIT) bd729c73e2cd2647f5ce6a2ebd24419720486f720124d9e0c66649b0b3d2835d? 2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 2: 252848 satoshi (SEGWIT) bbe3783d4c7fde8eb6433403fc1c34fa0098e4c738cedeac087243a1655a0b81? 2018-11-25T13:41:40.300Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Getting HSM to sign funding tx 2018-11-25T13:41:40.397Z lightningd(17827): lightning_channeld-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: pid 31244, msgfd 33 2018-11-25T13:41:40.397Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Waiting for funding confirmations 2018-11-25T13:41:41.001Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Peer internal error CHANNELD_AWAITING_LOCKIN: Funding broadcast exited with 25: error code: -25?error message:?Missing inputs? 2018-11-25T13:41:41.001Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Peer permanent failure in CHANNELD_AWAITING_LOCKIN: Internal error: Funding broadcast exited with 25: error code: -25?error message:?Missing inputs? 2018-11-25T13:41:41.001Z lightningd(17827): lightning_channeld-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Status closed, but not exited. Killing 2018-11-25T13:41:41.013Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: State changed from CHANNELD_AWAITING_LOCKIN to AWAITING_UNILATERAL 2018-11-25T13:42:58.779Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150096 msatoshi 2018-11-25T13:42:58.779Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (151109msat, 590blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 532217:2079:0 (150109msat, 446blk) -> 02529db69fd2ebd3126fb66fafa234fc3544477a23d509fe93ed229bb0e92e4f
          b8 -> 548838:1988:1 (150098msat, 302blk) -> 031d2bbc75802689312220a017c6b51fa246efc59c7aa9355f6f7395038ffb4d6a -> 549057:2281:0 (150097msat, 158blk) -> 02c5371591b640da03f9a645e2ddfa5620d8537388b03ddd524d36766c0f550db0 -> 548930:191:0 (150096msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55
          652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:04.954Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150218 msatoshi 2018-11-25T13:43:04.955Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152234msat, 446blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 550459:2332:1 (151234msat, 302blk) -> 0390b5d4492dc2f5318e5233ab2cebf6d48914881a33ef6a9c6bcdbb433ad986
          d0 -> 550102:1165:0 (150219msat, 158blk) -> 02c5371591b640da03f9a645e2ddfa5620d8537388b03ddd524d36766c0f550db0 -> 548930:191:0 (150218msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:11.852Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150170 msatoshi
          2018-11-25T13:43:11.852Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152271msat, 864blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 544611:1240:1 (151271msat, 720blk) -> 020e56a13babec99abdc2c4afbe34e1e44230d79b234c059fd4ff1e367765fdb
          1b -> 541282:1481:0 (150271msat, 576blk) -> 03434a39cd9a537c852fc8fb72454086d726f9111e9f730cef4985c39c11fae944 -> 535271:1925:0 (150171msat, 432blk) -> 03bb88ccc444534da7b5b64b4f7b15e1eccb18e102db0e400d4b9cfe93763aa26d -> 549187:1932:1 (150170msat, 288blk) -> 03295d2e292565743a40bd44da227a820f873087
          7bc3dfadebade8785bcf355258 -> 544098:2501:1 (150170msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:18.520Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150426 msatoshi
          2018-11-25T13:43:18.520Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152615msat, 474blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 550180:1827:0 (151615msat, 330blk) -> 03a5927b64b1ea8657d5b770d61a3e2d0554fdb5d568773e0d6a92907913ca21
          f6 -> 551184:469:0 (150628msat, 186blk) -> 0217090c397c3e8ced66abb7b8bf6e05cd49adde55766a7d14e2e4a541164b0935 -> 551318:1032:0 (150428msat, 172blk) -> 03f18da23535adee245903c81750745197e3079d3b88b3898981c90a5f2411008c -> 544620:1321:1 (150427msat, 158blk) -> 02c88a0df5e9ea7df582647f79b70b8e441047de3
          08fd6b24408b8bd775f2234bd -> 549696:815:1 (150426msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 

          Today I have tried to force close the channel but the command is stucked and the CPU is 100%.

          lightning-cli close 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 true
          

          I have interrupted the command but it seems like every command (getinfo included) is causing 100% CPU and the freezing of the command itself.

          Restarting the service, I was able to collect some more infos:

          $ lightning-cli listpeers 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 debug
          {
          "peers": [
          {
          "id": "03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56",
          "connected": true,
          "netaddr": [
          "35.172.33.197:9735"
          ],
          "global_features": "",
          "local_features": "82",
          "globalfeatures": "",
          "localfeatures": "82",
          "channels": [
          {
          "state": "AWAITING_UNILATERAL",
          "scratch_txid": "458cd396b558361c2a616d0e2a0c56a50f5c8eacd9ca71e536d016bf3ae6233d",
          "channel_id": "84649e5d4c01a17a4f1612c722df7be59e31cdf39f969a8794d2adcd54b1b731",
          "funding_txid": "31b7b154cdadd294879a969ff3cd319ee57bdf22c712164f7aa1014c5d9e6484",
          "msatoshi_to_us": 1000000000,
          "msatoshi_to_us_min": 1000000000,
          "msatoshi_to_us_max": 1000000000,
          "msatoshi_total": 1000000000,
          "dust_limit_satoshis": 546,
          "max_htlc_value_in_flight_msat": 18446744073709551615,
          "their_channel_reserve_satoshis": 10000,
          "our_channel_reserve_satoshis": 10000,
          "spendable_msatoshi": 990000000,
          "htlc_minimum_msat": 0,
          "their_to_self_delay": 144,
          "our_to_self_delay": 144,
          "max_accepted_htlcs": 483,
          "status": [
          "AWAITING_UNILATERAL:Attempting to reconnect"
          ],
          "in_payments_offered": 0,
          "in_msatoshi_offered": 0,
          "in_payments_fulfilled": 0,
          "in_msatoshi_fulfilled": 0,
          "out_payments_offered": 0,
          "out_msatoshi_offered": 0,
          "out_payments_fulfilled": 0,
          "out_msatoshi_fulfilled": 0,
          "htlcs": [
          ]
          }
          ],
          "log": [
          {
          "type": "DEBUG",
          "time": "5.221303026",
          "source": "03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10:",
          "log": "Peer has reconnected, state AWAITING_UNILATERAL"
          },
          {
          "type": "DEBUG",
          "time": "5.225104641",
          "source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
          "log": "pid 15044, msgfd 25"
          },
          {
          "type": "DEBUG",
          "time": "5.293310285",
          "source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
          "log": "peer_out WIRE_ERROR"
          },
          {
          "type": "DEBUG",
          "time": "5.294715801",
          "source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
          "log": "Handed peer, entering loop"
          }
          ]
          }
          ]
          }
          

          getinfo output

          not possible (due to 100%CPU issue) but running tags/v0.6.2

          EDIT: restarting the service:

          lightning-cli getinfo
          {
          "id": "03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e",
          "address": [
          {
          "type": "torv2",
          "address": "byy4lqhaaley7e7k.onion",
          "port": 9735
          }
          ],
          "binding": [
          {
          "type": "ipv4",
          "address": "127.0.0.1",
          "port": 9731
          },
          {
          "type": "ipv4",
          "address": "10.2.206.180",
          "port": 9731
          }
          ],
          "version": "v0.6.2-modded",
          "blockheight": 553513,
          "network": "bitcoin",
          "msatoshi_fees_collected": 0
          }
          

          Metadata

          Metadata

          Assignees

          No one assigned

            Labels

            No labels
            No labels

            Type

            No type

            Projects

            No projects

              Milestone

              No milestone

              Relationships

              None yet

              Development

              No branches or pull requests

              Issue actions

              , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms"); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
              Skip to content

              Channel "AWAITING_UNILATERAL" since days. Attempted force closing, CPU 100% #2171

              Description

              @gabridome

              I found one of my channel was in "AWAITING_UNILATERAL" so I waited but days after it was still in that state.

              Relevant log with grep peerID:

              2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 0: 10648 satoshi (SEGWIT) 695254bb08add33af6f907960913869c25903c967541b2b8765be96431d2cb59? [100/260]
              2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 1: 2005802 satoshi (SEGWIT) bd729c73e2cd2647f5ce6a2ebd24419720486f720124d9e0c66649b0b3d2835d? 2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 2: 252848 satoshi (SEGWIT) bbe3783d4c7fde8eb6433403fc1c34fa0098e4c738cedeac087243a1655a0b81? 2018-11-25T13:41:40.300Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Getting HSM to sign funding tx 2018-11-25T13:41:40.397Z lightningd(17827): lightning_channeld-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: pid 31244, msgfd 33 2018-11-25T13:41:40.397Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Waiting for funding confirmations 2018-11-25T13:41:41.001Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Peer internal error CHANNELD_AWAITING_LOCKIN: Funding broadcast exited with 25: error code: -25?error message:?Missing inputs? 2018-11-25T13:41:41.001Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Peer permanent failure in CHANNELD_AWAITING_LOCKIN: Internal error: Funding broadcast exited with 25: error code: -25?error message:?Missing inputs? 2018-11-25T13:41:41.001Z lightningd(17827): lightning_channeld-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Status closed, but not exited. Killing 2018-11-25T13:41:41.013Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: State changed from CHANNELD_AWAITING_LOCKIN to AWAITING_UNILATERAL 2018-11-25T13:42:58.779Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150096 msatoshi 2018-11-25T13:42:58.779Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (151109msat, 590blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 532217:2079:0 (150109msat, 446blk) -> 02529db69fd2ebd3126fb66fafa234fc3544477a23d509fe93ed229bb0e92e4f
              b8 -> 548838:1988:1 (150098msat, 302blk) -> 031d2bbc75802689312220a017c6b51fa246efc59c7aa9355f6f7395038ffb4d6a -> 549057:2281:0 (150097msat, 158blk) -> 02c5371591b640da03f9a645e2ddfa5620d8537388b03ddd524d36766c0f550db0 -> 548930:191:0 (150096msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55
              652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:04.954Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150218 msatoshi 2018-11-25T13:43:04.955Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152234msat, 446blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 550459:2332:1 (151234msat, 302blk) -> 0390b5d4492dc2f5318e5233ab2cebf6d48914881a33ef6a9c6bcdbb433ad986
              d0 -> 550102:1165:0 (150219msat, 158blk) -> 02c5371591b640da03f9a645e2ddfa5620d8537388b03ddd524d36766c0f550db0 -> 548930:191:0 (150218msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:11.852Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150170 msatoshi
              2018-11-25T13:43:11.852Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152271msat, 864blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 544611:1240:1 (151271msat, 720blk) -> 020e56a13babec99abdc2c4afbe34e1e44230d79b234c059fd4ff1e367765fdb
              1b -> 541282:1481:0 (150271msat, 576blk) -> 03434a39cd9a537c852fc8fb72454086d726f9111e9f730cef4985c39c11fae944 -> 535271:1925:0 (150171msat, 432blk) -> 03bb88ccc444534da7b5b64b4f7b15e1eccb18e102db0e400d4b9cfe93763aa26d -> 549187:1932:1 (150170msat, 288blk) -> 03295d2e292565743a40bd44da227a820f873087
              7bc3dfadebade8785bcf355258 -> 544098:2501:1 (150170msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:18.520Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150426 msatoshi
              2018-11-25T13:43:18.520Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152615msat, 474blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 550180:1827:0 (151615msat, 330blk) -> 03a5927b64b1ea8657d5b770d61a3e2d0554fdb5d568773e0d6a92907913ca21
              f6 -> 551184:469:0 (150628msat, 186blk) -> 0217090c397c3e8ced66abb7b8bf6e05cd49adde55766a7d14e2e4a541164b0935 -> 551318:1032:0 (150428msat, 172blk) -> 03f18da23535adee245903c81750745197e3079d3b88b3898981c90a5f2411008c -> 544620:1321:1 (150427msat, 158blk) -> 02c88a0df5e9ea7df582647f79b70b8e441047de3
              08fd6b24408b8bd775f2234bd -> 549696:815:1 (150426msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 

              Today I have tried to force close the channel but the command is stucked and the CPU is 100%.

              lightning-cli close 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 true
              

              I have interrupted the command but it seems like every command (getinfo included) is causing 100% CPU and the freezing of the command itself.

              Restarting the service, I was able to collect some more infos:

              $ lightning-cli listpeers 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 debug
              {
              "peers": [
              {
              "id": "03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56",
              "connected": true,
              "netaddr": [
              "35.172.33.197:9735"
              ],
              "global_features": "",
              "local_features": "82",
              "globalfeatures": "",
              "localfeatures": "82",
              "channels": [
              {
              "state": "AWAITING_UNILATERAL",
              "scratch_txid": "458cd396b558361c2a616d0e2a0c56a50f5c8eacd9ca71e536d016bf3ae6233d",
              "channel_id": "84649e5d4c01a17a4f1612c722df7be59e31cdf39f969a8794d2adcd54b1b731",
              "funding_txid": "31b7b154cdadd294879a969ff3cd319ee57bdf22c712164f7aa1014c5d9e6484",
              "msatoshi_to_us": 1000000000,
              "msatoshi_to_us_min": 1000000000,
              "msatoshi_to_us_max": 1000000000,
              "msatoshi_total": 1000000000,
              "dust_limit_satoshis": 546,
              "max_htlc_value_in_flight_msat": 18446744073709551615,
              "their_channel_reserve_satoshis": 10000,
              "our_channel_reserve_satoshis": 10000,
              "spendable_msatoshi": 990000000,
              "htlc_minimum_msat": 0,
              "their_to_self_delay": 144,
              "our_to_self_delay": 144,
              "max_accepted_htlcs": 483,
              "status": [
              "AWAITING_UNILATERAL:Attempting to reconnect"
              ],
              "in_payments_offered": 0,
              "in_msatoshi_offered": 0,
              "in_payments_fulfilled": 0,
              "in_msatoshi_fulfilled": 0,
              "out_payments_offered": 0,
              "out_msatoshi_offered": 0,
              "out_payments_fulfilled": 0,
              "out_msatoshi_fulfilled": 0,
              "htlcs": [
              ]
              }
              ],
              "log": [
              {
              "type": "DEBUG",
              "time": "5.221303026",
              "source": "03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10:",
              "log": "Peer has reconnected, state AWAITING_UNILATERAL"
              },
              {
              "type": "DEBUG",
              "time": "5.225104641",
              "source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
              "log": "pid 15044, msgfd 25"
              },
              {
              "type": "DEBUG",
              "time": "5.293310285",
              "source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
              "log": "peer_out WIRE_ERROR"
              },
              {
              "type": "DEBUG",
              "time": "5.294715801",
              "source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
              "log": "Handed peer, entering loop"
              }
              ]
              }
              ]
              }
              

              getinfo output

              not possible (due to 100%CPU issue) but running tags/v0.6.2

              EDIT: restarting the service:

              lightning-cli getinfo
              {
              "id": "03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e",
              "address": [
              {
              "type": "torv2",
              "address": "byy4lqhaaley7e7k.onion",
              "port": 9735
              }
              ],
              "binding": [
              {
              "type": "ipv4",
              "address": "127.0.0.1",
              "port": 9731
              },
              {
              "type": "ipv4",
              "address": "10.2.206.180",
              "port": 9731
              }
              ],
              "version": "v0.6.2-modded",
              "blockheight": 553513,
              "network": "bitcoin",
              "msatoshi_fees_collected": 0
              }
              

              Metadata

              Metadata

              Assignees

              No one assigned

                Labels

                No labels
                No labels

                Type

                No type

                Projects

                No projects

                  Milestone

                  No milestone

                  Relationships

                  None yet

                  Development

                  No branches or pull requests

                  Issue actions

                  , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links"); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + '
                  Skip to content

                  Channel "AWAITING_UNILATERAL" since days. Attempted force closing, CPU 100% #2171

                  Description

                  @gabridome

                  I found one of my channel was in "AWAITING_UNILATERAL" so I waited but days after it was still in that state.

                  Relevant log with grep peerID:

                  2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 0: 10648 satoshi (SEGWIT) 695254bb08add33af6f907960913869c25903c967541b2b8765be96431d2cb59? [100/260]
                  2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 1: 2005802 satoshi (SEGWIT) bd729c73e2cd2647f5ce6a2ebd24419720486f720124d9e0c66649b0b3d2835d? 2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 2: 252848 satoshi (SEGWIT) bbe3783d4c7fde8eb6433403fc1c34fa0098e4c738cedeac087243a1655a0b81? 2018-11-25T13:41:40.300Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Getting HSM to sign funding tx 2018-11-25T13:41:40.397Z lightningd(17827): lightning_channeld-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: pid 31244, msgfd 33 2018-11-25T13:41:40.397Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Waiting for funding confirmations 2018-11-25T13:41:41.001Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Peer internal error CHANNELD_AWAITING_LOCKIN: Funding broadcast exited with 25: error code: -25?error message:?Missing inputs? 2018-11-25T13:41:41.001Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Peer permanent failure in CHANNELD_AWAITING_LOCKIN: Internal error: Funding broadcast exited with 25: error code: -25?error message:?Missing inputs? 2018-11-25T13:41:41.001Z lightningd(17827): lightning_channeld-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Status closed, but not exited. Killing 2018-11-25T13:41:41.013Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: State changed from CHANNELD_AWAITING_LOCKIN to AWAITING_UNILATERAL 2018-11-25T13:42:58.779Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150096 msatoshi 2018-11-25T13:42:58.779Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (151109msat, 590blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 532217:2079:0 (150109msat, 446blk) -> 02529db69fd2ebd3126fb66fafa234fc3544477a23d509fe93ed229bb0e92e4f
                  b8 -> 548838:1988:1 (150098msat, 302blk) -> 031d2bbc75802689312220a017c6b51fa246efc59c7aa9355f6f7395038ffb4d6a -> 549057:2281:0 (150097msat, 158blk) -> 02c5371591b640da03f9a645e2ddfa5620d8537388b03ddd524d36766c0f550db0 -> 548930:191:0 (150096msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55
                  652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:04.954Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150218 msatoshi 2018-11-25T13:43:04.955Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152234msat, 446blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 550459:2332:1 (151234msat, 302blk) -> 0390b5d4492dc2f5318e5233ab2cebf6d48914881a33ef6a9c6bcdbb433ad986
                  d0 -> 550102:1165:0 (150219msat, 158blk) -> 02c5371591b640da03f9a645e2ddfa5620d8537388b03ddd524d36766c0f550db0 -> 548930:191:0 (150218msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:11.852Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150170 msatoshi
                  2018-11-25T13:43:11.852Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152271msat, 864blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 544611:1240:1 (151271msat, 720blk) -> 020e56a13babec99abdc2c4afbe34e1e44230d79b234c059fd4ff1e367765fdb
                  1b -> 541282:1481:0 (150271msat, 576blk) -> 03434a39cd9a537c852fc8fb72454086d726f9111e9f730cef4985c39c11fae944 -> 535271:1925:0 (150171msat, 432blk) -> 03bb88ccc444534da7b5b64b4f7b15e1eccb18e102db0e400d4b9cfe93763aa26d -> 549187:1932:1 (150170msat, 288blk) -> 03295d2e292565743a40bd44da227a820f873087
                  7bc3dfadebade8785bcf355258 -> 544098:2501:1 (150170msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:18.520Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150426 msatoshi
                  2018-11-25T13:43:18.520Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152615msat, 474blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 550180:1827:0 (151615msat, 330blk) -> 03a5927b64b1ea8657d5b770d61a3e2d0554fdb5d568773e0d6a92907913ca21
                  f6 -> 551184:469:0 (150628msat, 186blk) -> 0217090c397c3e8ced66abb7b8bf6e05cd49adde55766a7d14e2e4a541164b0935 -> 551318:1032:0 (150428msat, 172blk) -> 03f18da23535adee245903c81750745197e3079d3b88b3898981c90a5f2411008c -> 544620:1321:1 (150427msat, 158blk) -> 02c88a0df5e9ea7df582647f79b70b8e441047de3
                  08fd6b24408b8bd775f2234bd -> 549696:815:1 (150426msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 

                  Today I have tried to force close the channel but the command is stucked and the CPU is 100%.

                  lightning-cli close 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 true
                  

                  I have interrupted the command but it seems like every command (getinfo included) is causing 100% CPU and the freezing of the command itself.

                  Restarting the service, I was able to collect some more infos:

                  $ lightning-cli listpeers 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 debug
                  {
                  "peers": [
                  {
                  "id": "03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56",
                  "connected": true,
                  "netaddr": [
                  "35.172.33.197:9735"
                  ],
                  "global_features": "",
                  "local_features": "82",
                  "globalfeatures": "",
                  "localfeatures": "82",
                  "channels": [
                  {
                  "state": "AWAITING_UNILATERAL",
                  "scratch_txid": "458cd396b558361c2a616d0e2a0c56a50f5c8eacd9ca71e536d016bf3ae6233d",
                  "channel_id": "84649e5d4c01a17a4f1612c722df7be59e31cdf39f969a8794d2adcd54b1b731",
                  "funding_txid": "31b7b154cdadd294879a969ff3cd319ee57bdf22c712164f7aa1014c5d9e6484",
                  "msatoshi_to_us": 1000000000,
                  "msatoshi_to_us_min": 1000000000,
                  "msatoshi_to_us_max": 1000000000,
                  "msatoshi_total": 1000000000,
                  "dust_limit_satoshis": 546,
                  "max_htlc_value_in_flight_msat": 18446744073709551615,
                  "their_channel_reserve_satoshis": 10000,
                  "our_channel_reserve_satoshis": 10000,
                  "spendable_msatoshi": 990000000,
                  "htlc_minimum_msat": 0,
                  "their_to_self_delay": 144,
                  "our_to_self_delay": 144,
                  "max_accepted_htlcs": 483,
                  "status": [
                  "AWAITING_UNILATERAL:Attempting to reconnect"
                  ],
                  "in_payments_offered": 0,
                  "in_msatoshi_offered": 0,
                  "in_payments_fulfilled": 0,
                  "in_msatoshi_fulfilled": 0,
                  "out_payments_offered": 0,
                  "out_msatoshi_offered": 0,
                  "out_payments_fulfilled": 0,
                  "out_msatoshi_fulfilled": 0,
                  "htlcs": [
                  ]
                  }
                  ],
                  "log": [
                  {
                  "type": "DEBUG",
                  "time": "5.221303026",
                  "source": "03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10:",
                  "log": "Peer has reconnected, state AWAITING_UNILATERAL"
                  },
                  {
                  "type": "DEBUG",
                  "time": "5.225104641",
                  "source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
                  "log": "pid 15044, msgfd 25"
                  },
                  {
                  "type": "DEBUG",
                  "time": "5.293310285",
                  "source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
                  "log": "peer_out WIRE_ERROR"
                  },
                  {
                  "type": "DEBUG",
                  "time": "5.294715801",
                  "source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
                  "log": "Handed peer, entering loop"
                  }
                  ]
                  }
                  ]
                  }
                  

                  getinfo output

                  not possible (due to 100%CPU issue) but running tags/v0.6.2

                  EDIT: restarting the service:

                  lightning-cli getinfo
                  {
                  "id": "03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e",
                  "address": [
                  {
                  "type": "torv2",
                  "address": "byy4lqhaaley7e7k.onion",
                  "port": 9735
                  }
                  ],
                  "binding": [
                  {
                  "type": "ipv4",
                  "address": "127.0.0.1",
                  "port": 9731
                  },
                  {
                  "type": "ipv4",
                  "address": "10.2.206.180",
                  "port": 9731
                  }
                  ],
                  "version": "v0.6.2-modded",
                  "blockheight": 553513,
                  "network": "bitcoin",
                  "msatoshi_fees_collected": 0
                  }
                  

                  Metadata

                  Metadata

                  Assignees

                  No one assigned

                    Labels

                    No labels
                    No labels

                    Type

                    No type

                    Projects

                    No projects

                      Milestone

                      No milestone

                      Relationships

                      None yet

                      Development

                      No branches or pull requests

                      Issue actions

                      , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default"); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
                      Skip to content

                      Channel "AWAITING_UNILATERAL" since days. Attempted force closing, CPU 100% #2171

                      Description

                      @gabridome

                      I found one of my channel was in "AWAITING_UNILATERAL" so I waited but days after it was still in that state.

                      Relevant log with grep peerID:

                      2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 0: 10648 satoshi (SEGWIT) 695254bb08add33af6f907960913869c25903c967541b2b8765be96431d2cb59? [100/260]
                      2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 1: 2005802 satoshi (SEGWIT) bd729c73e2cd2647f5ce6a2ebd24419720486f720124d9e0c66649b0b3d2835d? 2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 2: 252848 satoshi (SEGWIT) bbe3783d4c7fde8eb6433403fc1c34fa0098e4c738cedeac087243a1655a0b81? 2018-11-25T13:41:40.300Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Getting HSM to sign funding tx 2018-11-25T13:41:40.397Z lightningd(17827): lightning_channeld-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: pid 31244, msgfd 33 2018-11-25T13:41:40.397Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Waiting for funding confirmations 2018-11-25T13:41:41.001Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Peer internal error CHANNELD_AWAITING_LOCKIN: Funding broadcast exited with 25: error code: -25?error message:?Missing inputs? 2018-11-25T13:41:41.001Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Peer permanent failure in CHANNELD_AWAITING_LOCKIN: Internal error: Funding broadcast exited with 25: error code: -25?error message:?Missing inputs? 2018-11-25T13:41:41.001Z lightningd(17827): lightning_channeld-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Status closed, but not exited. Killing 2018-11-25T13:41:41.013Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: State changed from CHANNELD_AWAITING_LOCKIN to AWAITING_UNILATERAL 2018-11-25T13:42:58.779Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150096 msatoshi 2018-11-25T13:42:58.779Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (151109msat, 590blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 532217:2079:0 (150109msat, 446blk) -> 02529db69fd2ebd3126fb66fafa234fc3544477a23d509fe93ed229bb0e92e4f
                      b8 -> 548838:1988:1 (150098msat, 302blk) -> 031d2bbc75802689312220a017c6b51fa246efc59c7aa9355f6f7395038ffb4d6a -> 549057:2281:0 (150097msat, 158blk) -> 02c5371591b640da03f9a645e2ddfa5620d8537388b03ddd524d36766c0f550db0 -> 548930:191:0 (150096msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55
                      652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:04.954Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150218 msatoshi 2018-11-25T13:43:04.955Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152234msat, 446blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 550459:2332:1 (151234msat, 302blk) -> 0390b5d4492dc2f5318e5233ab2cebf6d48914881a33ef6a9c6bcdbb433ad986
                      d0 -> 550102:1165:0 (150219msat, 158blk) -> 02c5371591b640da03f9a645e2ddfa5620d8537388b03ddd524d36766c0f550db0 -> 548930:191:0 (150218msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:11.852Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150170 msatoshi
                      2018-11-25T13:43:11.852Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152271msat, 864blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 544611:1240:1 (151271msat, 720blk) -> 020e56a13babec99abdc2c4afbe34e1e44230d79b234c059fd4ff1e367765fdb
                      1b -> 541282:1481:0 (150271msat, 576blk) -> 03434a39cd9a537c852fc8fb72454086d726f9111e9f730cef4985c39c11fae944 -> 535271:1925:0 (150171msat, 432blk) -> 03bb88ccc444534da7b5b64b4f7b15e1eccb18e102db0e400d4b9cfe93763aa26d -> 549187:1932:1 (150170msat, 288blk) -> 03295d2e292565743a40bd44da227a820f873087
                      7bc3dfadebade8785bcf355258 -> 544098:2501:1 (150170msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:18.520Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150426 msatoshi
                      2018-11-25T13:43:18.520Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152615msat, 474blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 550180:1827:0 (151615msat, 330blk) -> 03a5927b64b1ea8657d5b770d61a3e2d0554fdb5d568773e0d6a92907913ca21
                      f6 -> 551184:469:0 (150628msat, 186blk) -> 0217090c397c3e8ced66abb7b8bf6e05cd49adde55766a7d14e2e4a541164b0935 -> 551318:1032:0 (150428msat, 172blk) -> 03f18da23535adee245903c81750745197e3079d3b88b3898981c90a5f2411008c -> 544620:1321:1 (150427msat, 158blk) -> 02c88a0df5e9ea7df582647f79b70b8e441047de3
                      08fd6b24408b8bd775f2234bd -> 549696:815:1 (150426msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 

                      Today I have tried to force close the channel but the command is stucked and the CPU is 100%.

                      lightning-cli close 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 true
                      

                      I have interrupted the command but it seems like every command (getinfo included) is causing 100% CPU and the freezing of the command itself.

                      Restarting the service, I was able to collect some more infos:

                      $ lightning-cli listpeers 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 debug
                      {
                      "peers": [
                      {
                      "id": "03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56",
                      "connected": true,
                      "netaddr": [
                      "35.172.33.197:9735"
                      ],
                      "global_features": "",
                      "local_features": "82",
                      "globalfeatures": "",
                      "localfeatures": "82",
                      "channels": [
                      {
                      "state": "AWAITING_UNILATERAL",
                      "scratch_txid": "458cd396b558361c2a616d0e2a0c56a50f5c8eacd9ca71e536d016bf3ae6233d",
                      "channel_id": "84649e5d4c01a17a4f1612c722df7be59e31cdf39f969a8794d2adcd54b1b731",
                      "funding_txid": "31b7b154cdadd294879a969ff3cd319ee57bdf22c712164f7aa1014c5d9e6484",
                      "msatoshi_to_us": 1000000000,
                      "msatoshi_to_us_min": 1000000000,
                      "msatoshi_to_us_max": 1000000000,
                      "msatoshi_total": 1000000000,
                      "dust_limit_satoshis": 546,
                      "max_htlc_value_in_flight_msat": 18446744073709551615,
                      "their_channel_reserve_satoshis": 10000,
                      "our_channel_reserve_satoshis": 10000,
                      "spendable_msatoshi": 990000000,
                      "htlc_minimum_msat": 0,
                      "their_to_self_delay": 144,
                      "our_to_self_delay": 144,
                      "max_accepted_htlcs": 483,
                      "status": [
                      "AWAITING_UNILATERAL:Attempting to reconnect"
                      ],
                      "in_payments_offered": 0,
                      "in_msatoshi_offered": 0,
                      "in_payments_fulfilled": 0,
                      "in_msatoshi_fulfilled": 0,
                      "out_payments_offered": 0,
                      "out_msatoshi_offered": 0,
                      "out_payments_fulfilled": 0,
                      "out_msatoshi_fulfilled": 0,
                      "htlcs": [
                      ]
                      }
                      ],
                      "log": [
                      {
                      "type": "DEBUG",
                      "time": "5.221303026",
                      "source": "03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10:",
                      "log": "Peer has reconnected, state AWAITING_UNILATERAL"
                      },
                      {
                      "type": "DEBUG",
                      "time": "5.225104641",
                      "source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
                      "log": "pid 15044, msgfd 25"
                      },
                      {
                      "type": "DEBUG",
                      "time": "5.293310285",
                      "source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
                      "log": "peer_out WIRE_ERROR"
                      },
                      {
                      "type": "DEBUG",
                      "time": "5.294715801",
                      "source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
                      "log": "Handed peer, entering loop"
                      }
                      ]
                      }
                      ]
                      }
                      

                      getinfo output

                      not possible (due to 100%CPU issue) but running tags/v0.6.2

                      EDIT: restarting the service:

                      lightning-cli getinfo
                      {
                      "id": "03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e",
                      "address": [
                      {
                      "type": "torv2",
                      "address": "byy4lqhaaley7e7k.onion",
                      "port": 9735
                      }
                      ],
                      "binding": [
                      {
                      "type": "ipv4",
                      "address": "127.0.0.1",
                      "port": 9731
                      },
                      {
                      "type": "ipv4",
                      "address": "10.2.206.180",
                      "port": 9731
                      }
                      ],
                      "version": "v0.6.2-modded",
                      "blockheight": 553513,
                      "network": "bitcoin",
                      "msatoshi_fees_collected": 0
                      }
                      

                      Metadata

                      Metadata

                      Assignees

                      No one assigned

                        Labels

                        No labels
                        No labels

                        Type

                        No type

                        Projects

                        No projects

                          Milestone

                          No milestone

                          Relationships

                          None yet

                          Development

                          No branches or pull requests

                          Issue actions

                          , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers"); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
                          Skip to content

                          Channel "AWAITING_UNILATERAL" since days. Attempted force closing, CPU 100% #2171

                          Description

                          @gabridome

                          I found one of my channel was in "AWAITING_UNILATERAL" so I waited but days after it was still in that state.

                          Relevant log with grep peerID:

                          2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 0: 10648 satoshi (SEGWIT) 695254bb08add33af6f907960913869c25903c967541b2b8765be96431d2cb59? [100/260]
                          2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 1: 2005802 satoshi (SEGWIT) bd729c73e2cd2647f5ce6a2ebd24419720486f720124d9e0c66649b0b3d2835d? 2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 2: 252848 satoshi (SEGWIT) bbe3783d4c7fde8eb6433403fc1c34fa0098e4c738cedeac087243a1655a0b81? 2018-11-25T13:41:40.300Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Getting HSM to sign funding tx 2018-11-25T13:41:40.397Z lightningd(17827): lightning_channeld-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: pid 31244, msgfd 33 2018-11-25T13:41:40.397Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Waiting for funding confirmations 2018-11-25T13:41:41.001Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Peer internal error CHANNELD_AWAITING_LOCKIN: Funding broadcast exited with 25: error code: -25?error message:?Missing inputs? 2018-11-25T13:41:41.001Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Peer permanent failure in CHANNELD_AWAITING_LOCKIN: Internal error: Funding broadcast exited with 25: error code: -25?error message:?Missing inputs? 2018-11-25T13:41:41.001Z lightningd(17827): lightning_channeld-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Status closed, but not exited. Killing 2018-11-25T13:41:41.013Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: State changed from CHANNELD_AWAITING_LOCKIN to AWAITING_UNILATERAL 2018-11-25T13:42:58.779Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150096 msatoshi 2018-11-25T13:42:58.779Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (151109msat, 590blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 532217:2079:0 (150109msat, 446blk) -> 02529db69fd2ebd3126fb66fafa234fc3544477a23d509fe93ed229bb0e92e4f
                          b8 -> 548838:1988:1 (150098msat, 302blk) -> 031d2bbc75802689312220a017c6b51fa246efc59c7aa9355f6f7395038ffb4d6a -> 549057:2281:0 (150097msat, 158blk) -> 02c5371591b640da03f9a645e2ddfa5620d8537388b03ddd524d36766c0f550db0 -> 548930:191:0 (150096msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55
                          652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:04.954Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150218 msatoshi 2018-11-25T13:43:04.955Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152234msat, 446blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 550459:2332:1 (151234msat, 302blk) -> 0390b5d4492dc2f5318e5233ab2cebf6d48914881a33ef6a9c6bcdbb433ad986
                          d0 -> 550102:1165:0 (150219msat, 158blk) -> 02c5371591b640da03f9a645e2ddfa5620d8537388b03ddd524d36766c0f550db0 -> 548930:191:0 (150218msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:11.852Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150170 msatoshi
                          2018-11-25T13:43:11.852Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152271msat, 864blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 544611:1240:1 (151271msat, 720blk) -> 020e56a13babec99abdc2c4afbe34e1e44230d79b234c059fd4ff1e367765fdb
                          1b -> 541282:1481:0 (150271msat, 576blk) -> 03434a39cd9a537c852fc8fb72454086d726f9111e9f730cef4985c39c11fae944 -> 535271:1925:0 (150171msat, 432blk) -> 03bb88ccc444534da7b5b64b4f7b15e1eccb18e102db0e400d4b9cfe93763aa26d -> 549187:1932:1 (150170msat, 288blk) -> 03295d2e292565743a40bd44da227a820f873087
                          7bc3dfadebade8785bcf355258 -> 544098:2501:1 (150170msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:18.520Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150426 msatoshi
                          2018-11-25T13:43:18.520Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152615msat, 474blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 550180:1827:0 (151615msat, 330blk) -> 03a5927b64b1ea8657d5b770d61a3e2d0554fdb5d568773e0d6a92907913ca21
                          f6 -> 551184:469:0 (150628msat, 186blk) -> 0217090c397c3e8ced66abb7b8bf6e05cd49adde55766a7d14e2e4a541164b0935 -> 551318:1032:0 (150428msat, 172blk) -> 03f18da23535adee245903c81750745197e3079d3b88b3898981c90a5f2411008c -> 544620:1321:1 (150427msat, 158blk) -> 02c88a0df5e9ea7df582647f79b70b8e441047de3
                          08fd6b24408b8bd775f2234bd -> 549696:815:1 (150426msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 

                          Today I have tried to force close the channel but the command is stucked and the CPU is 100%.

                          lightning-cli close 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 true
                          

                          I have interrupted the command but it seems like every command (getinfo included) is causing 100% CPU and the freezing of the command itself.

                          Restarting the service, I was able to collect some more infos:

                          $ lightning-cli listpeers 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 debug
                          {
                          "peers": [
                          {
                          "id": "03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56",
                          "connected": true,
                          "netaddr": [
                          "35.172.33.197:9735"
                          ],
                          "global_features": "",
                          "local_features": "82",
                          "globalfeatures": "",
                          "localfeatures": "82",
                          "channels": [
                          {
                          "state": "AWAITING_UNILATERAL",
                          "scratch_txid": "458cd396b558361c2a616d0e2a0c56a50f5c8eacd9ca71e536d016bf3ae6233d",
                          "channel_id": "84649e5d4c01a17a4f1612c722df7be59e31cdf39f969a8794d2adcd54b1b731",
                          "funding_txid": "31b7b154cdadd294879a969ff3cd319ee57bdf22c712164f7aa1014c5d9e6484",
                          "msatoshi_to_us": 1000000000,
                          "msatoshi_to_us_min": 1000000000,
                          "msatoshi_to_us_max": 1000000000,
                          "msatoshi_total": 1000000000,
                          "dust_limit_satoshis": 546,
                          "max_htlc_value_in_flight_msat": 18446744073709551615,
                          "their_channel_reserve_satoshis": 10000,
                          "our_channel_reserve_satoshis": 10000,
                          "spendable_msatoshi": 990000000,
                          "htlc_minimum_msat": 0,
                          "their_to_self_delay": 144,
                          "our_to_self_delay": 144,
                          "max_accepted_htlcs": 483,
                          "status": [
                          "AWAITING_UNILATERAL:Attempting to reconnect"
                          ],
                          "in_payments_offered": 0,
                          "in_msatoshi_offered": 0,
                          "in_payments_fulfilled": 0,
                          "in_msatoshi_fulfilled": 0,
                          "out_payments_offered": 0,
                          "out_msatoshi_offered": 0,
                          "out_payments_fulfilled": 0,
                          "out_msatoshi_fulfilled": 0,
                          "htlcs": [
                          ]
                          }
                          ],
                          "log": [
                          {
                          "type": "DEBUG",
                          "time": "5.221303026",
                          "source": "03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10:",
                          "log": "Peer has reconnected, state AWAITING_UNILATERAL"
                          },
                          {
                          "type": "DEBUG",
                          "time": "5.225104641",
                          "source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
                          "log": "pid 15044, msgfd 25"
                          },
                          {
                          "type": "DEBUG",
                          "time": "5.293310285",
                          "source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
                          "log": "peer_out WIRE_ERROR"
                          },
                          {
                          "type": "DEBUG",
                          "time": "5.294715801",
                          "source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
                          "log": "Handed peer, entering loop"
                          }
                          ]
                          }
                          ]
                          }
                          

                          getinfo output

                          not possible (due to 100%CPU issue) but running tags/v0.6.2

                          EDIT: restarting the service:

                          lightning-cli getinfo
                          {
                          "id": "03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e",
                          "address": [
                          {
                          "type": "torv2",
                          "address": "byy4lqhaaley7e7k.onion",
                          "port": 9735
                          }
                          ],
                          "binding": [
                          {
                          "type": "ipv4",
                          "address": "127.0.0.1",
                          "port": 9731
                          },
                          {
                          "type": "ipv4",
                          "address": "10.2.206.180",
                          "port": 9731
                          }
                          ],
                          "version": "v0.6.2-modded",
                          "blockheight": 553513,
                          "network": "bitcoin",
                          "msatoshi_fees_collected": 0
                          }
                          

                          Metadata

                          Metadata

                          Assignees

                          No one assigned

                            Labels

                            No labels
                            No labels

                            Type

                            No type

                            Projects

                            No projects

                              Milestone

                              No milestone

                              Relationships

                              None yet

                              Development

                              No branches or pull requests

                              Issue actions

                              , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode"); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })();
                              Skip to content

                              Channel "AWAITING_UNILATERAL" since days. Attempted force closing, CPU 100% #2171

                              Description

                              @gabridome

                              I found one of my channel was in "AWAITING_UNILATERAL" so I waited but days after it was still in that state.

                              Relevant log with grep peerID:

                              2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 0: 10648 satoshi (SEGWIT) 695254bb08add33af6f907960913869c25903c967541b2b8765be96431d2cb59? [100/260]
                              2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 1: 2005802 satoshi (SEGWIT) bd729c73e2cd2647f5ce6a2ebd24419720486f720124d9e0c66649b0b3d2835d? 2018-11-25T13:41:40.283Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: 2: 252848 satoshi (SEGWIT) bbe3783d4c7fde8eb6433403fc1c34fa0098e4c738cedeac087243a1655a0b81? 2018-11-25T13:41:40.300Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Getting HSM to sign funding tx 2018-11-25T13:41:40.397Z lightningd(17827): lightning_channeld-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: pid 31244, msgfd 33 2018-11-25T13:41:40.397Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Waiting for funding confirmations 2018-11-25T13:41:41.001Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Peer internal error CHANNELD_AWAITING_LOCKIN: Funding broadcast exited with 25: error code: -25?error message:?Missing inputs? 2018-11-25T13:41:41.001Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Peer permanent failure in CHANNELD_AWAITING_LOCKIN: Internal error: Funding broadcast exited with 25: error code: -25?error message:?Missing inputs? 2018-11-25T13:41:41.001Z lightningd(17827): lightning_channeld-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: Status closed, but not exited. Killing 2018-11-25T13:41:41.013Z lightningd(17827): 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10: State changed from CHANNELD_AWAITING_LOCKIN to AWAITING_UNILATERAL 2018-11-25T13:42:58.779Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150096 msatoshi 2018-11-25T13:42:58.779Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (151109msat, 590blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 532217:2079:0 (150109msat, 446blk) -> 02529db69fd2ebd3126fb66fafa234fc3544477a23d509fe93ed229bb0e92e4f
                              b8 -> 548838:1988:1 (150098msat, 302blk) -> 031d2bbc75802689312220a017c6b51fa246efc59c7aa9355f6f7395038ffb4d6a -> 549057:2281:0 (150097msat, 158blk) -> 02c5371591b640da03f9a645e2ddfa5620d8537388b03ddd524d36766c0f550db0 -> 548930:191:0 (150096msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55
                              652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:04.954Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150218 msatoshi 2018-11-25T13:43:04.955Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152234msat, 446blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 550459:2332:1 (151234msat, 302blk) -> 0390b5d4492dc2f5318e5233ab2cebf6d48914881a33ef6a9c6bcdbb433ad986
                              d0 -> 550102:1165:0 (150219msat, 158blk) -> 02c5371591b640da03f9a645e2ddfa5620d8537388b03ddd524d36766c0f550db0 -> 548930:191:0 (150218msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:11.852Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150170 msatoshi
                              2018-11-25T13:43:11.852Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152271msat, 864blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 544611:1240:1 (151271msat, 720blk) -> 020e56a13babec99abdc2c4afbe34e1e44230d79b234c059fd4ff1e367765fdb
                              1b -> 541282:1481:0 (150271msat, 576blk) -> 03434a39cd9a537c852fc8fb72454086d726f9111e9f730cef4985c39c11fae944 -> 535271:1925:0 (150171msat, 432blk) -> 03bb88ccc444534da7b5b64b4f7b15e1eccb18e102db0e400d4b9cfe93763aa26d -> 549187:1932:1 (150170msat, 288blk) -> 03295d2e292565743a40bd44da227a820f873087
                              7bc3dfadebade8785bcf355258 -> 544098:2501:1 (150170msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 2018-11-25T13:43:18.520Z lightning_gossipd(17983): Trying to find a route from 03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e to 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 for 150426 msatoshi
                              2018-11-25T13:43:18.520Z lightningd(17827): pay(0x5599e8874d28): sendpay via route: us -> 551183:2675:1 (152615msat, 474blk) -> 036ac04a69f2ab587fd83c4f2aca255a81f138276fbca344ac3ecfae28d733be56 -> 550180:1827:0 (151615msat, 330blk) -> 03a5927b64b1ea8657d5b770d61a3e2d0554fdb5d568773e0d6a92907913ca21
                              f6 -> 551184:469:0 (150628msat, 186blk) -> 0217090c397c3e8ced66abb7b8bf6e05cd49adde55766a7d14e2e4a541164b0935 -> 551318:1032:0 (150428msat, 172blk) -> 03f18da23535adee245903c81750745197e3079d3b88b3898981c90a5f2411008c -> 544620:1321:1 (150427msat, 158blk) -> 02c88a0df5e9ea7df582647f79b70b8e441047de3
                              08fd6b24408b8bd775f2234bd -> 549696:815:1 (150426msat, 144blk) -> 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 

                              Today I have tried to force close the channel but the command is stucked and the CPU is 100%.

                              lightning-cli close 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 true
                              

                              I have interrupted the command but it seems like every command (getinfo included) is causing 100% CPU and the freezing of the command itself.

                              Restarting the service, I was able to collect some more infos:

                              $ lightning-cli listpeers 03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 debug
                              {
                              "peers": [
                              {
                              "id": "03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56",
                              "connected": true,
                              "netaddr": [
                              "35.172.33.197:9735"
                              ],
                              "global_features": "",
                              "local_features": "82",
                              "globalfeatures": "",
                              "localfeatures": "82",
                              "channels": [
                              {
                              "state": "AWAITING_UNILATERAL",
                              "scratch_txid": "458cd396b558361c2a616d0e2a0c56a50f5c8eacd9ca71e536d016bf3ae6233d",
                              "channel_id": "84649e5d4c01a17a4f1612c722df7be59e31cdf39f969a8794d2adcd54b1b731",
                              "funding_txid": "31b7b154cdadd294879a969ff3cd319ee57bdf22c712164f7aa1014c5d9e6484",
                              "msatoshi_to_us": 1000000000,
                              "msatoshi_to_us_min": 1000000000,
                              "msatoshi_to_us_max": 1000000000,
                              "msatoshi_total": 1000000000,
                              "dust_limit_satoshis": 546,
                              "max_htlc_value_in_flight_msat": 18446744073709551615,
                              "their_channel_reserve_satoshis": 10000,
                              "our_channel_reserve_satoshis": 10000,
                              "spendable_msatoshi": 990000000,
                              "htlc_minimum_msat": 0,
                              "their_to_self_delay": 144,
                              "our_to_self_delay": 144,
                              "max_accepted_htlcs": 483,
                              "status": [
                              "AWAITING_UNILATERAL:Attempting to reconnect"
                              ],
                              "in_payments_offered": 0,
                              "in_msatoshi_offered": 0,
                              "in_payments_fulfilled": 0,
                              "in_msatoshi_fulfilled": 0,
                              "out_payments_offered": 0,
                              "out_msatoshi_offered": 0,
                              "out_payments_fulfilled": 0,
                              "out_msatoshi_fulfilled": 0,
                              "htlcs": [
                              ]
                              }
                              ],
                              "log": [
                              {
                              "type": "DEBUG",
                              "time": "5.221303026",
                              "source": "03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #10:",
                              "log": "Peer has reconnected, state AWAITING_UNILATERAL"
                              },
                              {
                              "type": "DEBUG",
                              "time": "5.225104641",
                              "source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
                              "log": "pid 15044, msgfd 25"
                              },
                              {
                              "type": "DEBUG",
                              "time": "5.293310285",
                              "source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
                              "log": "peer_out WIRE_ERROR"
                              },
                              {
                              "type": "DEBUG",
                              "time": "5.294715801",
                              "source": "lightning_openingd-03e50492eab4107a773141bb419e107bda3de3d55652e6e1a41225f06a0bbf2d56 chan #11:",
                              "log": "Handed peer, entering loop"
                              }
                              ]
                              }
                              ]
                              }
                              

                              getinfo output

                              not possible (due to 100%CPU issue) but running tags/v0.6.2

                              EDIT: restarting the service:

                              lightning-cli getinfo
                              {
                              "id": "03b49e64e9bce0de005d774c3fbe39dcafd9ce96b6c8ffaaf3a1e111d4f9554e2e",
                              "address": [
                              {
                              "type": "torv2",
                              "address": "byy4lqhaaley7e7k.onion",
                              "port": 9735
                              }
                              ],
                              "binding": [
                              {
                              "type": "ipv4",
                              "address": "127.0.0.1",
                              "port": 9731
                              },
                              {
                              "type": "ipv4",
                              "address": "10.2.206.180",
                              "port": 9731
                              }
                              ],
                              "version": "v0.6.2-modded",
                              "blockheight": 553513,
                              "network": "bitcoin",
                              "msatoshi_fees_collected": 0
                              }
                              

                              Metadata

                              Metadata

                              Assignees

                              No one assigned

                                Labels

                                No labels
                                No labels

                                Type

                                No type

                                Projects

                                No projects

                                  Milestone

                                  No milestone

                                  Relationships

                                  None yet

                                  Development

                                  No branches or pull requests

                                  Issue actions