Funding_tx: add anti-fee sniping recommendation and check if final - #1531

Merged
TheBlueMatt merged 2 commits into
lightningdevkit:mainfrom
ariard:2022-06-fee-sniping
Jun 16, 2022
Merged

Funding_tx: add anti-fee sniping recommendation and check if final#1531
TheBlueMatt merged 2 commits into
lightningdevkit:mainfrom
ariard:2022-06-fee-sniping

Conversation

@ariard

Copy link
Copy Markdown

First commit checks if the funding transaction is final for propagation. If the nLocktime field has been set for any reason (e.g anti-fee sniping) and our bitcoind client is a bit behind, we may fail the p2p propagation in case of fast signatures exchange with our counterparty.

While this check is implemented the nearest from the user to allow correction, one alternative could be to make a requirement of BroadcastInterface::broadcast_transaction to check for transaction finality, beyond our scope. broadcast_transaction could be modified to return a boolean, potentially signaling a transaction standardness issue, that we would propagate back to the user within an APIError::BroadcastFailure ?

Second commit invites funding transaction software to implement anti-fee sniping, I think a wallet best practice across the ecosystem to align the long-term incentives of the miners.

@TheBlueMattTheBlueMatt left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, makes sense.

Comment threadlightning/src/ln/channelmanager.rs Outdated
///
/// Note to keep the miner incentives aligned in moving the blockchain forward, we recommend
/// the wallet software generating the funding transaction to apply anti-fee sniping as
/// implemented by Bitcoin Core wallet. See https://github.com/bitcoin/bitcoin/blob/e3c08eb620a2f317fc09fdf20969fa26f02afb91/src/wallet/spend.cpp#L612

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: wrap with <> to make it a "real" link (and add a \n). Also...man there needs to be a better link, maybe optech has one?

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah I was thinking to point towards BIP326, though Taproot-only and I don't believe the nSequence will be really binding in practice for off-chain contract : https://github.com/bitcoin/bips/blob/master/bip-0326.mediawiki

Optech good one : https://bitcoinops.org/en/topics/fee-sniping/

Comment threadlightning/src/ln/channelmanager.rs Outdated
{
let height = self.best_block.read().unwrap().height();
// Transactions are evaluated as final by network mempools at the next block.
if funding_transaction.lock_time < 500_000_000 && funding_transaction.lock_time > height + 1 {

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe +2 or +3 to give a little bit of headroom?

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IIRC Core is strict on the +1 ? If we give a headroom and the transaction is inside that window, we fail ?

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, true. I guess I worry that if we reject hard at exactly +1 we'll fail to accept in some race conditions around block connection orders and the easy way to fix that is to break the anti-fee-sniping stuff by just subtracting one.

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, thinking more I would assume that your bitcoind is never behind as it should be the authoritative source of blocks for the other modules I think it's really hard to make assumption on the block connection orders between your wallet and LDK. So taking the +2 in case the wallet is faster than LDK. However, unless you have multiple and non-reconciliated (meeeeh...) block sources, your wallet shouldn't be faster than bitcoind-or-equivalent and not hit the headroom window (contrary what I was worried about in previous comment).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we rebroadcast funding transactions (e.g., every block), we could be a bit more forgiving here regarding the window. I wonder if this is something we'd want to do anyway outside of this context to ensure transaction propagation, as they could be dropped from mempools due to other higher fee transactions.

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Apart of the funding and closing transactions, I think we fee-bump and rebroadcast all our LN transactions in OnchainTxHandler. Of course, it would be really nice if we implement fee-bumping for those transactions suiting the user confirmation requirements (or to hedge against unreliable tx-relay peers). I think it's better implemented by us rather than BroadcastInterface as we might have view on the user UTXO set (at least after anchor output). My thinking on that has always been to wait to support dual-funding and splicing, as fee-bumping is part of the spec for both opening and close. That way we would have all our transactions scheduled by one unified component OnchainTxHandler (where it would become a trait and given access to ChannelManager, only of being a ChannelMonitor's struct for now).

@codecov-commenter

codecov-commenter commented Jun 9, 2022

Copy link
Copy Markdown

Codecov Report

Merging #1531 (f99fa81) into main (22dc964) will decrease coverage by 0.01%.
The diff coverage is 91.17%.

❗ Current head f99fa81 differs from pull request most recent head 69344fa. Consider uploading reports for the commit 69344fa to get more accurate results

@@ Coverage Diff @@## main #1531 +/- ##
==========================================
- Coverage 90.94% 90.93% -0.02% 
==========================================
Files 80 80 Lines 43469 43503 +34 Branches 43469 43503 +34 ==========================================
+ Hits 39533 39559 +26 - Misses 3936 3944 +8 
Impacted FilesCoverage Δ
lightning/src/ln/functional_tests.rs97.04% <90.00%> (-0.13%)⬇️
lightning/src/ln/channelmanager.rs84.34% <100.00%> (+0.01%)⬆️
lightning-net-tokio/src/lib.rs77.16% <0.00%> (+0.30%)⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 22dc964...69344fa. Read the comment docs.

@ariard

Copy link
Copy Markdown
Author

Updated at 2cae4ef with suggestions. Added test_non_final_funding_tx to exercise new APIError.

@wpaulinowpaulino left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not something to worry about yet, but we should make this very clear in the release notes, as I'm unsure of how prevalent the use of final transactions is across our users.

Comment threadlightning/src/ln/channelmanager.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs Outdated
{
let height = self.best_block.read().unwrap().height();
// Transactions are evaluated as final by network mempools at the next block.
if funding_transaction.lock_time < 500_000_000 && funding_transaction.lock_time > height + 1 {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we rebroadcast funding transactions (e.g., every block), we could be a bit more forgiving here regarding the window. I wonder if this is something we'd want to do anyway outside of this context to ensure transaction propagation, as they could be dropped from mempools due to other higher fee transactions.

@ariard

ariard commented Jun 10, 2022

Copy link
Copy Markdown
Author

Updated at f99fa81, with review comment addressed.

Not something to worry about yet, but we should make this very clear in the release notes, as I'm unsure of how prevalent the use of final transactions is across our users.

Well to be propagated and included a transaction must be final no ? I think what is worrying are users calling our API with non-final transactions, and from now on we would reject them. At least with an error instead of a silent sendrawtransaction if you implement a really basic BroadcastInterface. Though yep, better to document that clearly in release notes.

Comment threadlightning/src/ln/channelmanager.rs Outdated
@ariard

Copy link
Copy Markdown
Author

Updated at 6e4a895 with comment addressed. Test has been updated in consequence.

Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs
Antoine Riard added 2 commits June 14, 2022 15:57
If the funding transaction is timelocked beyond the next block of
our best known chain tip, return an APIError instead of silently
failing at broadcast attempt.
@ariard

Copy link
Copy Markdown
Author

Updated at 69344fa with comments addressed.

@TheBlueMatt
TheBlueMatt merged commit e533446 into lightningdevkit:mainJun 16, 2022
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@ariard@codecov-commenter@TheBlueMatt@wpaulino
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all
 blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
Skip to content

Funding_tx: add anti-fee sniping recommendation and check if final - #1531

Merged
TheBlueMatt merged 2 commits into
lightningdevkit:mainfrom
ariard:2022-06-fee-sniping
Jun 16, 2022
Merged

Funding_tx: add anti-fee sniping recommendation and check if final#1531
TheBlueMatt merged 2 commits into
lightningdevkit:mainfrom
ariard:2022-06-fee-sniping

Conversation

@ariard

Copy link
Copy Markdown

First commit checks if the funding transaction is final for propagation. If the nLocktime field has been set for any reason (e.g anti-fee sniping) and our bitcoind client is a bit behind, we may fail the p2p propagation in case of fast signatures exchange with our counterparty.

While this check is implemented the nearest from the user to allow correction, one alternative could be to make a requirement of BroadcastInterface::broadcast_transaction to check for transaction finality, beyond our scope. broadcast_transaction could be modified to return a boolean, potentially signaling a transaction standardness issue, that we would propagate back to the user within an APIError::BroadcastFailure ?

Second commit invites funding transaction software to implement anti-fee sniping, I think a wallet best practice across the ecosystem to align the long-term incentives of the miners.

@TheBlueMattTheBlueMatt left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, makes sense.

Comment threadlightning/src/ln/channelmanager.rs Outdated
///
/// Note to keep the miner incentives aligned in moving the blockchain forward, we recommend
/// the wallet software generating the funding transaction to apply anti-fee sniping as
/// implemented by Bitcoin Core wallet. See https://github.com/bitcoin/bitcoin/blob/e3c08eb620a2f317fc09fdf20969fa26f02afb91/src/wallet/spend.cpp#L612

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: wrap with <> to make it a "real" link (and add a \n). Also...man there needs to be a better link, maybe optech has one?

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah I was thinking to point towards BIP326, though Taproot-only and I don't believe the nSequence will be really binding in practice for off-chain contract : https://github.com/bitcoin/bips/blob/master/bip-0326.mediawiki

Optech good one : https://bitcoinops.org/en/topics/fee-sniping/

Comment threadlightning/src/ln/channelmanager.rs Outdated
{
let height = self.best_block.read().unwrap().height();
// Transactions are evaluated as final by network mempools at the next block.
if funding_transaction.lock_time < 500_000_000 && funding_transaction.lock_time > height + 1 {

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe +2 or +3 to give a little bit of headroom?

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IIRC Core is strict on the +1 ? If we give a headroom and the transaction is inside that window, we fail ?

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, true. I guess I worry that if we reject hard at exactly +1 we'll fail to accept in some race conditions around block connection orders and the easy way to fix that is to break the anti-fee-sniping stuff by just subtracting one.

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, thinking more I would assume that your bitcoind is never behind as it should be the authoritative source of blocks for the other modules I think it's really hard to make assumption on the block connection orders between your wallet and LDK. So taking the +2 in case the wallet is faster than LDK. However, unless you have multiple and non-reconciliated (meeeeh...) block sources, your wallet shouldn't be faster than bitcoind-or-equivalent and not hit the headroom window (contrary what I was worried about in previous comment).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we rebroadcast funding transactions (e.g., every block), we could be a bit more forgiving here regarding the window. I wonder if this is something we'd want to do anyway outside of this context to ensure transaction propagation, as they could be dropped from mempools due to other higher fee transactions.

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Apart of the funding and closing transactions, I think we fee-bump and rebroadcast all our LN transactions in OnchainTxHandler. Of course, it would be really nice if we implement fee-bumping for those transactions suiting the user confirmation requirements (or to hedge against unreliable tx-relay peers). I think it's better implemented by us rather than BroadcastInterface as we might have view on the user UTXO set (at least after anchor output). My thinking on that has always been to wait to support dual-funding and splicing, as fee-bumping is part of the spec for both opening and close. That way we would have all our transactions scheduled by one unified component OnchainTxHandler (where it would become a trait and given access to ChannelManager, only of being a ChannelMonitor's struct for now).

@codecov-commenter

codecov-commenter commented Jun 9, 2022

Copy link
Copy Markdown

Codecov Report

Merging #1531 (f99fa81) into main (22dc964) will decrease coverage by 0.01%.
The diff coverage is 91.17%.

❗ Current head f99fa81 differs from pull request most recent head 69344fa. Consider uploading reports for the commit 69344fa to get more accurate results

@@ Coverage Diff @@## main #1531 +/- ##
==========================================
- Coverage 90.94% 90.93% -0.02% 
==========================================
Files 80 80 Lines 43469 43503 +34 Branches 43469 43503 +34 ==========================================
+ Hits 39533 39559 +26 - Misses 3936 3944 +8 
Impacted FilesCoverage Δ
lightning/src/ln/functional_tests.rs97.04% <90.00%> (-0.13%)⬇️
lightning/src/ln/channelmanager.rs84.34% <100.00%> (+0.01%)⬆️
lightning-net-tokio/src/lib.rs77.16% <0.00%> (+0.30%)⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 22dc964...69344fa. Read the comment docs.

@ariard

Copy link
Copy Markdown
Author

Updated at 2cae4ef with suggestions. Added test_non_final_funding_tx to exercise new APIError.

@wpaulinowpaulino left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not something to worry about yet, but we should make this very clear in the release notes, as I'm unsure of how prevalent the use of final transactions is across our users.

Comment threadlightning/src/ln/channelmanager.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs Outdated
{
let height = self.best_block.read().unwrap().height();
// Transactions are evaluated as final by network mempools at the next block.
if funding_transaction.lock_time < 500_000_000 && funding_transaction.lock_time > height + 1 {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we rebroadcast funding transactions (e.g., every block), we could be a bit more forgiving here regarding the window. I wonder if this is something we'd want to do anyway outside of this context to ensure transaction propagation, as they could be dropped from mempools due to other higher fee transactions.

@ariard

ariard commented Jun 10, 2022

Copy link
Copy Markdown
Author

Updated at f99fa81, with review comment addressed.

Not something to worry about yet, but we should make this very clear in the release notes, as I'm unsure of how prevalent the use of final transactions is across our users.

Well to be propagated and included a transaction must be final no ? I think what is worrying are users calling our API with non-final transactions, and from now on we would reject them. At least with an error instead of a silent sendrawtransaction if you implement a really basic BroadcastInterface. Though yep, better to document that clearly in release notes.

Comment threadlightning/src/ln/channelmanager.rs Outdated
@ariard

Copy link
Copy Markdown
Author

Updated at 6e4a895 with comment addressed. Test has been updated in consequence.

Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs
Antoine Riard added 2 commits June 14, 2022 15:57
If the funding transaction is timelocked beyond the next block of
our best known chain tip, return an APIError instead of silently
failing at broadcast attempt.
@ariard

Copy link
Copy Markdown
Author

Updated at 69344fa with comments addressed.

@TheBlueMatt
TheBlueMatt merged commit e533446 into lightningdevkit:mainJun 16, 2022
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@ariard@codecov-commenter@TheBlueMatt@wpaulino
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix"); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Funding_tx: add anti-fee sniping recommendation and check if final - #1531

Merged
TheBlueMatt merged 2 commits into
lightningdevkit:mainfrom
ariard:2022-06-fee-sniping
Jun 16, 2022
Merged

Funding_tx: add anti-fee sniping recommendation and check if final#1531
TheBlueMatt merged 2 commits into
lightningdevkit:mainfrom
ariard:2022-06-fee-sniping

Conversation

@ariard

Copy link
Copy Markdown

First commit checks if the funding transaction is final for propagation. If the nLocktime field has been set for any reason (e.g anti-fee sniping) and our bitcoind client is a bit behind, we may fail the p2p propagation in case of fast signatures exchange with our counterparty.

While this check is implemented the nearest from the user to allow correction, one alternative could be to make a requirement of BroadcastInterface::broadcast_transaction to check for transaction finality, beyond our scope. broadcast_transaction could be modified to return a boolean, potentially signaling a transaction standardness issue, that we would propagate back to the user within an APIError::BroadcastFailure ?

Second commit invites funding transaction software to implement anti-fee sniping, I think a wallet best practice across the ecosystem to align the long-term incentives of the miners.

@TheBlueMattTheBlueMatt left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, makes sense.

Comment threadlightning/src/ln/channelmanager.rs Outdated
///
/// Note to keep the miner incentives aligned in moving the blockchain forward, we recommend
/// the wallet software generating the funding transaction to apply anti-fee sniping as
/// implemented by Bitcoin Core wallet. See https://github.com/bitcoin/bitcoin/blob/e3c08eb620a2f317fc09fdf20969fa26f02afb91/src/wallet/spend.cpp#L612

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: wrap with <> to make it a "real" link (and add a \n). Also...man there needs to be a better link, maybe optech has one?

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah I was thinking to point towards BIP326, though Taproot-only and I don't believe the nSequence will be really binding in practice for off-chain contract : https://github.com/bitcoin/bips/blob/master/bip-0326.mediawiki

Optech good one : https://bitcoinops.org/en/topics/fee-sniping/

Comment threadlightning/src/ln/channelmanager.rs Outdated
{
let height = self.best_block.read().unwrap().height();
// Transactions are evaluated as final by network mempools at the next block.
if funding_transaction.lock_time < 500_000_000 && funding_transaction.lock_time > height + 1 {

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe +2 or +3 to give a little bit of headroom?

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IIRC Core is strict on the +1 ? If we give a headroom and the transaction is inside that window, we fail ?

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, true. I guess I worry that if we reject hard at exactly +1 we'll fail to accept in some race conditions around block connection orders and the easy way to fix that is to break the anti-fee-sniping stuff by just subtracting one.

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, thinking more I would assume that your bitcoind is never behind as it should be the authoritative source of blocks for the other modules I think it's really hard to make assumption on the block connection orders between your wallet and LDK. So taking the +2 in case the wallet is faster than LDK. However, unless you have multiple and non-reconciliated (meeeeh...) block sources, your wallet shouldn't be faster than bitcoind-or-equivalent and not hit the headroom window (contrary what I was worried about in previous comment).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we rebroadcast funding transactions (e.g., every block), we could be a bit more forgiving here regarding the window. I wonder if this is something we'd want to do anyway outside of this context to ensure transaction propagation, as they could be dropped from mempools due to other higher fee transactions.

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Apart of the funding and closing transactions, I think we fee-bump and rebroadcast all our LN transactions in OnchainTxHandler. Of course, it would be really nice if we implement fee-bumping for those transactions suiting the user confirmation requirements (or to hedge against unreliable tx-relay peers). I think it's better implemented by us rather than BroadcastInterface as we might have view on the user UTXO set (at least after anchor output). My thinking on that has always been to wait to support dual-funding and splicing, as fee-bumping is part of the spec for both opening and close. That way we would have all our transactions scheduled by one unified component OnchainTxHandler (where it would become a trait and given access to ChannelManager, only of being a ChannelMonitor's struct for now).

@codecov-commenter

codecov-commenter commented Jun 9, 2022

Copy link
Copy Markdown

Codecov Report

Merging #1531 (f99fa81) into main (22dc964) will decrease coverage by 0.01%.
The diff coverage is 91.17%.

❗ Current head f99fa81 differs from pull request most recent head 69344fa. Consider uploading reports for the commit 69344fa to get more accurate results

@@ Coverage Diff @@## main #1531 +/- ##
==========================================
- Coverage 90.94% 90.93% -0.02% 
==========================================
Files 80 80 Lines 43469 43503 +34 Branches 43469 43503 +34 ==========================================
+ Hits 39533 39559 +26 - Misses 3936 3944 +8 
Impacted FilesCoverage Δ
lightning/src/ln/functional_tests.rs97.04% <90.00%> (-0.13%)⬇️
lightning/src/ln/channelmanager.rs84.34% <100.00%> (+0.01%)⬆️
lightning-net-tokio/src/lib.rs77.16% <0.00%> (+0.30%)⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 22dc964...69344fa. Read the comment docs.

@ariard

Copy link
Copy Markdown
Author

Updated at 2cae4ef with suggestions. Added test_non_final_funding_tx to exercise new APIError.

@wpaulinowpaulino left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not something to worry about yet, but we should make this very clear in the release notes, as I'm unsure of how prevalent the use of final transactions is across our users.

Comment threadlightning/src/ln/channelmanager.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs Outdated
{
let height = self.best_block.read().unwrap().height();
// Transactions are evaluated as final by network mempools at the next block.
if funding_transaction.lock_time < 500_000_000 && funding_transaction.lock_time > height + 1 {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we rebroadcast funding transactions (e.g., every block), we could be a bit more forgiving here regarding the window. I wonder if this is something we'd want to do anyway outside of this context to ensure transaction propagation, as they could be dropped from mempools due to other higher fee transactions.

@ariard

ariard commented Jun 10, 2022

Copy link
Copy Markdown
Author

Updated at f99fa81, with review comment addressed.

Not something to worry about yet, but we should make this very clear in the release notes, as I'm unsure of how prevalent the use of final transactions is across our users.

Well to be propagated and included a transaction must be final no ? I think what is worrying are users calling our API with non-final transactions, and from now on we would reject them. At least with an error instead of a silent sendrawtransaction if you implement a really basic BroadcastInterface. Though yep, better to document that clearly in release notes.

Comment threadlightning/src/ln/channelmanager.rs Outdated
@ariard

Copy link
Copy Markdown
Author

Updated at 6e4a895 with comment addressed. Test has been updated in consequence.

Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs
Antoine Riard added 2 commits June 14, 2022 15:57
If the funding transaction is timelocked beyond the next block of
our best known chain tip, return an APIError instead of silently
failing at broadcast attempt.
@ariard

Copy link
Copy Markdown
Author

Updated at 69344fa with comments addressed.

@TheBlueMatt
TheBlueMatt merged commit e533446 into lightningdevkit:mainJun 16, 2022
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@ariard@codecov-commenter@TheBlueMatt@wpaulino
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms"); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Funding_tx: add anti-fee sniping recommendation and check if final - #1531

Merged
TheBlueMatt merged 2 commits into
lightningdevkit:mainfrom
ariard:2022-06-fee-sniping
Jun 16, 2022
Merged

Funding_tx: add anti-fee sniping recommendation and check if final#1531
TheBlueMatt merged 2 commits into
lightningdevkit:mainfrom
ariard:2022-06-fee-sniping

Conversation

@ariard

Copy link
Copy Markdown

First commit checks if the funding transaction is final for propagation. If the nLocktime field has been set for any reason (e.g anti-fee sniping) and our bitcoind client is a bit behind, we may fail the p2p propagation in case of fast signatures exchange with our counterparty.

While this check is implemented the nearest from the user to allow correction, one alternative could be to make a requirement of BroadcastInterface::broadcast_transaction to check for transaction finality, beyond our scope. broadcast_transaction could be modified to return a boolean, potentially signaling a transaction standardness issue, that we would propagate back to the user within an APIError::BroadcastFailure ?

Second commit invites funding transaction software to implement anti-fee sniping, I think a wallet best practice across the ecosystem to align the long-term incentives of the miners.

@TheBlueMattTheBlueMatt left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, makes sense.

Comment threadlightning/src/ln/channelmanager.rs Outdated
///
/// Note to keep the miner incentives aligned in moving the blockchain forward, we recommend
/// the wallet software generating the funding transaction to apply anti-fee sniping as
/// implemented by Bitcoin Core wallet. See https://github.com/bitcoin/bitcoin/blob/e3c08eb620a2f317fc09fdf20969fa26f02afb91/src/wallet/spend.cpp#L612

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: wrap with <> to make it a "real" link (and add a \n). Also...man there needs to be a better link, maybe optech has one?

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah I was thinking to point towards BIP326, though Taproot-only and I don't believe the nSequence will be really binding in practice for off-chain contract : https://github.com/bitcoin/bips/blob/master/bip-0326.mediawiki

Optech good one : https://bitcoinops.org/en/topics/fee-sniping/

Comment threadlightning/src/ln/channelmanager.rs Outdated
{
let height = self.best_block.read().unwrap().height();
// Transactions are evaluated as final by network mempools at the next block.
if funding_transaction.lock_time < 500_000_000 && funding_transaction.lock_time > height + 1 {

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe +2 or +3 to give a little bit of headroom?

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IIRC Core is strict on the +1 ? If we give a headroom and the transaction is inside that window, we fail ?

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, true. I guess I worry that if we reject hard at exactly +1 we'll fail to accept in some race conditions around block connection orders and the easy way to fix that is to break the anti-fee-sniping stuff by just subtracting one.

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, thinking more I would assume that your bitcoind is never behind as it should be the authoritative source of blocks for the other modules I think it's really hard to make assumption on the block connection orders between your wallet and LDK. So taking the +2 in case the wallet is faster than LDK. However, unless you have multiple and non-reconciliated (meeeeh...) block sources, your wallet shouldn't be faster than bitcoind-or-equivalent and not hit the headroom window (contrary what I was worried about in previous comment).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we rebroadcast funding transactions (e.g., every block), we could be a bit more forgiving here regarding the window. I wonder if this is something we'd want to do anyway outside of this context to ensure transaction propagation, as they could be dropped from mempools due to other higher fee transactions.

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Apart of the funding and closing transactions, I think we fee-bump and rebroadcast all our LN transactions in OnchainTxHandler. Of course, it would be really nice if we implement fee-bumping for those transactions suiting the user confirmation requirements (or to hedge against unreliable tx-relay peers). I think it's better implemented by us rather than BroadcastInterface as we might have view on the user UTXO set (at least after anchor output). My thinking on that has always been to wait to support dual-funding and splicing, as fee-bumping is part of the spec for both opening and close. That way we would have all our transactions scheduled by one unified component OnchainTxHandler (where it would become a trait and given access to ChannelManager, only of being a ChannelMonitor's struct for now).

@codecov-commenter

codecov-commenter commented Jun 9, 2022

Copy link
Copy Markdown

Codecov Report

Merging #1531 (f99fa81) into main (22dc964) will decrease coverage by 0.01%.
The diff coverage is 91.17%.

❗ Current head f99fa81 differs from pull request most recent head 69344fa. Consider uploading reports for the commit 69344fa to get more accurate results

@@ Coverage Diff @@## main #1531 +/- ##
==========================================
- Coverage 90.94% 90.93% -0.02% 
==========================================
Files 80 80 Lines 43469 43503 +34 Branches 43469 43503 +34 ==========================================
+ Hits 39533 39559 +26 - Misses 3936 3944 +8 
Impacted FilesCoverage Δ
lightning/src/ln/functional_tests.rs97.04% <90.00%> (-0.13%)⬇️
lightning/src/ln/channelmanager.rs84.34% <100.00%> (+0.01%)⬆️
lightning-net-tokio/src/lib.rs77.16% <0.00%> (+0.30%)⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 22dc964...69344fa. Read the comment docs.

@ariard

Copy link
Copy Markdown
Author

Updated at 2cae4ef with suggestions. Added test_non_final_funding_tx to exercise new APIError.

@wpaulinowpaulino left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not something to worry about yet, but we should make this very clear in the release notes, as I'm unsure of how prevalent the use of final transactions is across our users.

Comment threadlightning/src/ln/channelmanager.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs Outdated
{
let height = self.best_block.read().unwrap().height();
// Transactions are evaluated as final by network mempools at the next block.
if funding_transaction.lock_time < 500_000_000 && funding_transaction.lock_time > height + 1 {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we rebroadcast funding transactions (e.g., every block), we could be a bit more forgiving here regarding the window. I wonder if this is something we'd want to do anyway outside of this context to ensure transaction propagation, as they could be dropped from mempools due to other higher fee transactions.

@ariard

ariard commented Jun 10, 2022

Copy link
Copy Markdown
Author

Updated at f99fa81, with review comment addressed.

Not something to worry about yet, but we should make this very clear in the release notes, as I'm unsure of how prevalent the use of final transactions is across our users.

Well to be propagated and included a transaction must be final no ? I think what is worrying are users calling our API with non-final transactions, and from now on we would reject them. At least with an error instead of a silent sendrawtransaction if you implement a really basic BroadcastInterface. Though yep, better to document that clearly in release notes.

Comment threadlightning/src/ln/channelmanager.rs Outdated
@ariard

Copy link
Copy Markdown
Author

Updated at 6e4a895 with comment addressed. Test has been updated in consequence.

Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs
Antoine Riard added 2 commits June 14, 2022 15:57
If the funding transaction is timelocked beyond the next block of
our best known chain tip, return an APIError instead of silently
failing at broadcast attempt.
@ariard

Copy link
Copy Markdown
Author

Updated at 69344fa with comments addressed.

@TheBlueMatt
TheBlueMatt merged commit e533446 into lightningdevkit:mainJun 16, 2022
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@ariard@codecov-commenter@TheBlueMatt@wpaulino
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links"); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + '
Skip to content

Funding_tx: add anti-fee sniping recommendation and check if final - #1531

Merged
TheBlueMatt merged 2 commits into
lightningdevkit:mainfrom
ariard:2022-06-fee-sniping
Jun 16, 2022
Merged

Funding_tx: add anti-fee sniping recommendation and check if final#1531
TheBlueMatt merged 2 commits into
lightningdevkit:mainfrom
ariard:2022-06-fee-sniping

Conversation

@ariard

Copy link
Copy Markdown

First commit checks if the funding transaction is final for propagation. If the nLocktime field has been set for any reason (e.g anti-fee sniping) and our bitcoind client is a bit behind, we may fail the p2p propagation in case of fast signatures exchange with our counterparty.

While this check is implemented the nearest from the user to allow correction, one alternative could be to make a requirement of BroadcastInterface::broadcast_transaction to check for transaction finality, beyond our scope. broadcast_transaction could be modified to return a boolean, potentially signaling a transaction standardness issue, that we would propagate back to the user within an APIError::BroadcastFailure ?

Second commit invites funding transaction software to implement anti-fee sniping, I think a wallet best practice across the ecosystem to align the long-term incentives of the miners.

@TheBlueMattTheBlueMatt left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, makes sense.

Comment threadlightning/src/ln/channelmanager.rs Outdated
///
/// Note to keep the miner incentives aligned in moving the blockchain forward, we recommend
/// the wallet software generating the funding transaction to apply anti-fee sniping as
/// implemented by Bitcoin Core wallet. See https://github.com/bitcoin/bitcoin/blob/e3c08eb620a2f317fc09fdf20969fa26f02afb91/src/wallet/spend.cpp#L612

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: wrap with <> to make it a "real" link (and add a \n). Also...man there needs to be a better link, maybe optech has one?

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah I was thinking to point towards BIP326, though Taproot-only and I don't believe the nSequence will be really binding in practice for off-chain contract : https://github.com/bitcoin/bips/blob/master/bip-0326.mediawiki

Optech good one : https://bitcoinops.org/en/topics/fee-sniping/

Comment threadlightning/src/ln/channelmanager.rs Outdated
{
let height = self.best_block.read().unwrap().height();
// Transactions are evaluated as final by network mempools at the next block.
if funding_transaction.lock_time < 500_000_000 && funding_transaction.lock_time > height + 1 {

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe +2 or +3 to give a little bit of headroom?

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IIRC Core is strict on the +1 ? If we give a headroom and the transaction is inside that window, we fail ?

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, true. I guess I worry that if we reject hard at exactly +1 we'll fail to accept in some race conditions around block connection orders and the easy way to fix that is to break the anti-fee-sniping stuff by just subtracting one.

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, thinking more I would assume that your bitcoind is never behind as it should be the authoritative source of blocks for the other modules I think it's really hard to make assumption on the block connection orders between your wallet and LDK. So taking the +2 in case the wallet is faster than LDK. However, unless you have multiple and non-reconciliated (meeeeh...) block sources, your wallet shouldn't be faster than bitcoind-or-equivalent and not hit the headroom window (contrary what I was worried about in previous comment).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we rebroadcast funding transactions (e.g., every block), we could be a bit more forgiving here regarding the window. I wonder if this is something we'd want to do anyway outside of this context to ensure transaction propagation, as they could be dropped from mempools due to other higher fee transactions.

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Apart of the funding and closing transactions, I think we fee-bump and rebroadcast all our LN transactions in OnchainTxHandler. Of course, it would be really nice if we implement fee-bumping for those transactions suiting the user confirmation requirements (or to hedge against unreliable tx-relay peers). I think it's better implemented by us rather than BroadcastInterface as we might have view on the user UTXO set (at least after anchor output). My thinking on that has always been to wait to support dual-funding and splicing, as fee-bumping is part of the spec for both opening and close. That way we would have all our transactions scheduled by one unified component OnchainTxHandler (where it would become a trait and given access to ChannelManager, only of being a ChannelMonitor's struct for now).

@codecov-commenter

codecov-commenter commented Jun 9, 2022

Copy link
Copy Markdown

Codecov Report

Merging #1531 (f99fa81) into main (22dc964) will decrease coverage by 0.01%.
The diff coverage is 91.17%.

❗ Current head f99fa81 differs from pull request most recent head 69344fa. Consider uploading reports for the commit 69344fa to get more accurate results

@@ Coverage Diff @@## main #1531 +/- ##
==========================================
- Coverage 90.94% 90.93% -0.02% 
==========================================
Files 80 80 Lines 43469 43503 +34 Branches 43469 43503 +34 ==========================================
+ Hits 39533 39559 +26 - Misses 3936 3944 +8 
Impacted FilesCoverage Δ
lightning/src/ln/functional_tests.rs97.04% <90.00%> (-0.13%)⬇️
lightning/src/ln/channelmanager.rs84.34% <100.00%> (+0.01%)⬆️
lightning-net-tokio/src/lib.rs77.16% <0.00%> (+0.30%)⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 22dc964...69344fa. Read the comment docs.

@ariard

Copy link
Copy Markdown
Author

Updated at 2cae4ef with suggestions. Added test_non_final_funding_tx to exercise new APIError.

@wpaulinowpaulino left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not something to worry about yet, but we should make this very clear in the release notes, as I'm unsure of how prevalent the use of final transactions is across our users.

Comment threadlightning/src/ln/channelmanager.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs Outdated
{
let height = self.best_block.read().unwrap().height();
// Transactions are evaluated as final by network mempools at the next block.
if funding_transaction.lock_time < 500_000_000 && funding_transaction.lock_time > height + 1 {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we rebroadcast funding transactions (e.g., every block), we could be a bit more forgiving here regarding the window. I wonder if this is something we'd want to do anyway outside of this context to ensure transaction propagation, as they could be dropped from mempools due to other higher fee transactions.

@ariard

ariard commented Jun 10, 2022

Copy link
Copy Markdown
Author

Updated at f99fa81, with review comment addressed.

Not something to worry about yet, but we should make this very clear in the release notes, as I'm unsure of how prevalent the use of final transactions is across our users.

Well to be propagated and included a transaction must be final no ? I think what is worrying are users calling our API with non-final transactions, and from now on we would reject them. At least with an error instead of a silent sendrawtransaction if you implement a really basic BroadcastInterface. Though yep, better to document that clearly in release notes.

Comment threadlightning/src/ln/channelmanager.rs Outdated
@ariard

Copy link
Copy Markdown
Author

Updated at 6e4a895 with comment addressed. Test has been updated in consequence.

Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs
Antoine Riard added 2 commits June 14, 2022 15:57
If the funding transaction is timelocked beyond the next block of
our best known chain tip, return an APIError instead of silently
failing at broadcast attempt.
@ariard

Copy link
Copy Markdown
Author

Updated at 69344fa with comments addressed.

@TheBlueMatt
TheBlueMatt merged commit e533446 into lightningdevkit:mainJun 16, 2022
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@ariard@codecov-commenter@TheBlueMatt@wpaulino
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default"); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Funding_tx: add anti-fee sniping recommendation and check if final - #1531

Merged
TheBlueMatt merged 2 commits into
lightningdevkit:mainfrom
ariard:2022-06-fee-sniping
Jun 16, 2022
Merged

Funding_tx: add anti-fee sniping recommendation and check if final#1531
TheBlueMatt merged 2 commits into
lightningdevkit:mainfrom
ariard:2022-06-fee-sniping

Conversation

@ariard

Copy link
Copy Markdown

First commit checks if the funding transaction is final for propagation. If the nLocktime field has been set for any reason (e.g anti-fee sniping) and our bitcoind client is a bit behind, we may fail the p2p propagation in case of fast signatures exchange with our counterparty.

While this check is implemented the nearest from the user to allow correction, one alternative could be to make a requirement of BroadcastInterface::broadcast_transaction to check for transaction finality, beyond our scope. broadcast_transaction could be modified to return a boolean, potentially signaling a transaction standardness issue, that we would propagate back to the user within an APIError::BroadcastFailure ?

Second commit invites funding transaction software to implement anti-fee sniping, I think a wallet best practice across the ecosystem to align the long-term incentives of the miners.

@TheBlueMattTheBlueMatt left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, makes sense.

Comment threadlightning/src/ln/channelmanager.rs Outdated
///
/// Note to keep the miner incentives aligned in moving the blockchain forward, we recommend
/// the wallet software generating the funding transaction to apply anti-fee sniping as
/// implemented by Bitcoin Core wallet. See https://github.com/bitcoin/bitcoin/blob/e3c08eb620a2f317fc09fdf20969fa26f02afb91/src/wallet/spend.cpp#L612

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: wrap with <> to make it a "real" link (and add a \n). Also...man there needs to be a better link, maybe optech has one?

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah I was thinking to point towards BIP326, though Taproot-only and I don't believe the nSequence will be really binding in practice for off-chain contract : https://github.com/bitcoin/bips/blob/master/bip-0326.mediawiki

Optech good one : https://bitcoinops.org/en/topics/fee-sniping/

Comment threadlightning/src/ln/channelmanager.rs Outdated
{
let height = self.best_block.read().unwrap().height();
// Transactions are evaluated as final by network mempools at the next block.
if funding_transaction.lock_time < 500_000_000 && funding_transaction.lock_time > height + 1 {

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe +2 or +3 to give a little bit of headroom?

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IIRC Core is strict on the +1 ? If we give a headroom and the transaction is inside that window, we fail ?

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, true. I guess I worry that if we reject hard at exactly +1 we'll fail to accept in some race conditions around block connection orders and the easy way to fix that is to break the anti-fee-sniping stuff by just subtracting one.

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, thinking more I would assume that your bitcoind is never behind as it should be the authoritative source of blocks for the other modules I think it's really hard to make assumption on the block connection orders between your wallet and LDK. So taking the +2 in case the wallet is faster than LDK. However, unless you have multiple and non-reconciliated (meeeeh...) block sources, your wallet shouldn't be faster than bitcoind-or-equivalent and not hit the headroom window (contrary what I was worried about in previous comment).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we rebroadcast funding transactions (e.g., every block), we could be a bit more forgiving here regarding the window. I wonder if this is something we'd want to do anyway outside of this context to ensure transaction propagation, as they could be dropped from mempools due to other higher fee transactions.

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Apart of the funding and closing transactions, I think we fee-bump and rebroadcast all our LN transactions in OnchainTxHandler. Of course, it would be really nice if we implement fee-bumping for those transactions suiting the user confirmation requirements (or to hedge against unreliable tx-relay peers). I think it's better implemented by us rather than BroadcastInterface as we might have view on the user UTXO set (at least after anchor output). My thinking on that has always been to wait to support dual-funding and splicing, as fee-bumping is part of the spec for both opening and close. That way we would have all our transactions scheduled by one unified component OnchainTxHandler (where it would become a trait and given access to ChannelManager, only of being a ChannelMonitor's struct for now).

@codecov-commenter

codecov-commenter commented Jun 9, 2022

Copy link
Copy Markdown

Codecov Report

Merging #1531 (f99fa81) into main (22dc964) will decrease coverage by 0.01%.
The diff coverage is 91.17%.

❗ Current head f99fa81 differs from pull request most recent head 69344fa. Consider uploading reports for the commit 69344fa to get more accurate results

@@ Coverage Diff @@## main #1531 +/- ##
==========================================
- Coverage 90.94% 90.93% -0.02% 
==========================================
Files 80 80 Lines 43469 43503 +34 Branches 43469 43503 +34 ==========================================
+ Hits 39533 39559 +26 - Misses 3936 3944 +8 
Impacted FilesCoverage Δ
lightning/src/ln/functional_tests.rs97.04% <90.00%> (-0.13%)⬇️
lightning/src/ln/channelmanager.rs84.34% <100.00%> (+0.01%)⬆️
lightning-net-tokio/src/lib.rs77.16% <0.00%> (+0.30%)⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 22dc964...69344fa. Read the comment docs.

@ariard

Copy link
Copy Markdown
Author

Updated at 2cae4ef with suggestions. Added test_non_final_funding_tx to exercise new APIError.

@wpaulinowpaulino left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not something to worry about yet, but we should make this very clear in the release notes, as I'm unsure of how prevalent the use of final transactions is across our users.

Comment threadlightning/src/ln/channelmanager.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs Outdated
{
let height = self.best_block.read().unwrap().height();
// Transactions are evaluated as final by network mempools at the next block.
if funding_transaction.lock_time < 500_000_000 && funding_transaction.lock_time > height + 1 {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we rebroadcast funding transactions (e.g., every block), we could be a bit more forgiving here regarding the window. I wonder if this is something we'd want to do anyway outside of this context to ensure transaction propagation, as they could be dropped from mempools due to other higher fee transactions.

@ariard

ariard commented Jun 10, 2022

Copy link
Copy Markdown
Author

Updated at f99fa81, with review comment addressed.

Not something to worry about yet, but we should make this very clear in the release notes, as I'm unsure of how prevalent the use of final transactions is across our users.

Well to be propagated and included a transaction must be final no ? I think what is worrying are users calling our API with non-final transactions, and from now on we would reject them. At least with an error instead of a silent sendrawtransaction if you implement a really basic BroadcastInterface. Though yep, better to document that clearly in release notes.

Comment threadlightning/src/ln/channelmanager.rs Outdated
@ariard

Copy link
Copy Markdown
Author

Updated at 6e4a895 with comment addressed. Test has been updated in consequence.

Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs
Antoine Riard added 2 commits June 14, 2022 15:57
If the funding transaction is timelocked beyond the next block of
our best known chain tip, return an APIError instead of silently
failing at broadcast attempt.
@ariard

Copy link
Copy Markdown
Author

Updated at 69344fa with comments addressed.

@TheBlueMatt
TheBlueMatt merged commit e533446 into lightningdevkit:mainJun 16, 2022
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@ariard@codecov-commenter@TheBlueMatt@wpaulino
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers"); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Funding_tx: add anti-fee sniping recommendation and check if final - #1531

Merged
TheBlueMatt merged 2 commits into
lightningdevkit:mainfrom
ariard:2022-06-fee-sniping
Jun 16, 2022
Merged

Funding_tx: add anti-fee sniping recommendation and check if final#1531
TheBlueMatt merged 2 commits into
lightningdevkit:mainfrom
ariard:2022-06-fee-sniping

Conversation

@ariard

Copy link
Copy Markdown

First commit checks if the funding transaction is final for propagation. If the nLocktime field has been set for any reason (e.g anti-fee sniping) and our bitcoind client is a bit behind, we may fail the p2p propagation in case of fast signatures exchange with our counterparty.

While this check is implemented the nearest from the user to allow correction, one alternative could be to make a requirement of BroadcastInterface::broadcast_transaction to check for transaction finality, beyond our scope. broadcast_transaction could be modified to return a boolean, potentially signaling a transaction standardness issue, that we would propagate back to the user within an APIError::BroadcastFailure ?

Second commit invites funding transaction software to implement anti-fee sniping, I think a wallet best practice across the ecosystem to align the long-term incentives of the miners.

@TheBlueMattTheBlueMatt left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, makes sense.

Comment threadlightning/src/ln/channelmanager.rs Outdated
///
/// Note to keep the miner incentives aligned in moving the blockchain forward, we recommend
/// the wallet software generating the funding transaction to apply anti-fee sniping as
/// implemented by Bitcoin Core wallet. See https://github.com/bitcoin/bitcoin/blob/e3c08eb620a2f317fc09fdf20969fa26f02afb91/src/wallet/spend.cpp#L612

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: wrap with <> to make it a "real" link (and add a \n). Also...man there needs to be a better link, maybe optech has one?

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah I was thinking to point towards BIP326, though Taproot-only and I don't believe the nSequence will be really binding in practice for off-chain contract : https://github.com/bitcoin/bips/blob/master/bip-0326.mediawiki

Optech good one : https://bitcoinops.org/en/topics/fee-sniping/

Comment threadlightning/src/ln/channelmanager.rs Outdated
{
let height = self.best_block.read().unwrap().height();
// Transactions are evaluated as final by network mempools at the next block.
if funding_transaction.lock_time < 500_000_000 && funding_transaction.lock_time > height + 1 {

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe +2 or +3 to give a little bit of headroom?

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IIRC Core is strict on the +1 ? If we give a headroom and the transaction is inside that window, we fail ?

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, true. I guess I worry that if we reject hard at exactly +1 we'll fail to accept in some race conditions around block connection orders and the easy way to fix that is to break the anti-fee-sniping stuff by just subtracting one.

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, thinking more I would assume that your bitcoind is never behind as it should be the authoritative source of blocks for the other modules I think it's really hard to make assumption on the block connection orders between your wallet and LDK. So taking the +2 in case the wallet is faster than LDK. However, unless you have multiple and non-reconciliated (meeeeh...) block sources, your wallet shouldn't be faster than bitcoind-or-equivalent and not hit the headroom window (contrary what I was worried about in previous comment).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we rebroadcast funding transactions (e.g., every block), we could be a bit more forgiving here regarding the window. I wonder if this is something we'd want to do anyway outside of this context to ensure transaction propagation, as they could be dropped from mempools due to other higher fee transactions.

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Apart of the funding and closing transactions, I think we fee-bump and rebroadcast all our LN transactions in OnchainTxHandler. Of course, it would be really nice if we implement fee-bumping for those transactions suiting the user confirmation requirements (or to hedge against unreliable tx-relay peers). I think it's better implemented by us rather than BroadcastInterface as we might have view on the user UTXO set (at least after anchor output). My thinking on that has always been to wait to support dual-funding and splicing, as fee-bumping is part of the spec for both opening and close. That way we would have all our transactions scheduled by one unified component OnchainTxHandler (where it would become a trait and given access to ChannelManager, only of being a ChannelMonitor's struct for now).

@codecov-commenter

codecov-commenter commented Jun 9, 2022

Copy link
Copy Markdown

Codecov Report

Merging #1531 (f99fa81) into main (22dc964) will decrease coverage by 0.01%.
The diff coverage is 91.17%.

❗ Current head f99fa81 differs from pull request most recent head 69344fa. Consider uploading reports for the commit 69344fa to get more accurate results

@@ Coverage Diff @@## main #1531 +/- ##
==========================================
- Coverage 90.94% 90.93% -0.02% 
==========================================
Files 80 80 Lines 43469 43503 +34 Branches 43469 43503 +34 ==========================================
+ Hits 39533 39559 +26 - Misses 3936 3944 +8 
Impacted FilesCoverage Δ
lightning/src/ln/functional_tests.rs97.04% <90.00%> (-0.13%)⬇️
lightning/src/ln/channelmanager.rs84.34% <100.00%> (+0.01%)⬆️
lightning-net-tokio/src/lib.rs77.16% <0.00%> (+0.30%)⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 22dc964...69344fa. Read the comment docs.

@ariard

Copy link
Copy Markdown
Author

Updated at 2cae4ef with suggestions. Added test_non_final_funding_tx to exercise new APIError.

@wpaulinowpaulino left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not something to worry about yet, but we should make this very clear in the release notes, as I'm unsure of how prevalent the use of final transactions is across our users.

Comment threadlightning/src/ln/channelmanager.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs Outdated
{
let height = self.best_block.read().unwrap().height();
// Transactions are evaluated as final by network mempools at the next block.
if funding_transaction.lock_time < 500_000_000 && funding_transaction.lock_time > height + 1 {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we rebroadcast funding transactions (e.g., every block), we could be a bit more forgiving here regarding the window. I wonder if this is something we'd want to do anyway outside of this context to ensure transaction propagation, as they could be dropped from mempools due to other higher fee transactions.

@ariard

ariard commented Jun 10, 2022

Copy link
Copy Markdown
Author

Updated at f99fa81, with review comment addressed.

Not something to worry about yet, but we should make this very clear in the release notes, as I'm unsure of how prevalent the use of final transactions is across our users.

Well to be propagated and included a transaction must be final no ? I think what is worrying are users calling our API with non-final transactions, and from now on we would reject them. At least with an error instead of a silent sendrawtransaction if you implement a really basic BroadcastInterface. Though yep, better to document that clearly in release notes.

Comment threadlightning/src/ln/channelmanager.rs Outdated
@ariard

Copy link
Copy Markdown
Author

Updated at 6e4a895 with comment addressed. Test has been updated in consequence.

Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs
Antoine Riard added 2 commits June 14, 2022 15:57
If the funding transaction is timelocked beyond the next block of
our best known chain tip, return an APIError instead of silently
failing at broadcast attempt.
@ariard

Copy link
Copy Markdown
Author

Updated at 69344fa with comments addressed.

@TheBlueMatt
TheBlueMatt merged commit e533446 into lightningdevkit:mainJun 16, 2022
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@ariard@codecov-commenter@TheBlueMatt@wpaulino
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode"); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })();
Skip to content

Funding_tx: add anti-fee sniping recommendation and check if final - #1531

Merged
TheBlueMatt merged 2 commits into
lightningdevkit:mainfrom
ariard:2022-06-fee-sniping
Jun 16, 2022
Merged

Funding_tx: add anti-fee sniping recommendation and check if final#1531
TheBlueMatt merged 2 commits into
lightningdevkit:mainfrom
ariard:2022-06-fee-sniping

Conversation

@ariard

Copy link
Copy Markdown

First commit checks if the funding transaction is final for propagation. If the nLocktime field has been set for any reason (e.g anti-fee sniping) and our bitcoind client is a bit behind, we may fail the p2p propagation in case of fast signatures exchange with our counterparty.

While this check is implemented the nearest from the user to allow correction, one alternative could be to make a requirement of BroadcastInterface::broadcast_transaction to check for transaction finality, beyond our scope. broadcast_transaction could be modified to return a boolean, potentially signaling a transaction standardness issue, that we would propagate back to the user within an APIError::BroadcastFailure ?

Second commit invites funding transaction software to implement anti-fee sniping, I think a wallet best practice across the ecosystem to align the long-term incentives of the miners.

@TheBlueMattTheBlueMatt left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, makes sense.

Comment threadlightning/src/ln/channelmanager.rs Outdated
///
/// Note to keep the miner incentives aligned in moving the blockchain forward, we recommend
/// the wallet software generating the funding transaction to apply anti-fee sniping as
/// implemented by Bitcoin Core wallet. See https://github.com/bitcoin/bitcoin/blob/e3c08eb620a2f317fc09fdf20969fa26f02afb91/src/wallet/spend.cpp#L612

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: wrap with <> to make it a "real" link (and add a \n). Also...man there needs to be a better link, maybe optech has one?

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah I was thinking to point towards BIP326, though Taproot-only and I don't believe the nSequence will be really binding in practice for off-chain contract : https://github.com/bitcoin/bips/blob/master/bip-0326.mediawiki

Optech good one : https://bitcoinops.org/en/topics/fee-sniping/

Comment threadlightning/src/ln/channelmanager.rs Outdated
{
let height = self.best_block.read().unwrap().height();
// Transactions are evaluated as final by network mempools at the next block.
if funding_transaction.lock_time < 500_000_000 && funding_transaction.lock_time > height + 1 {

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe +2 or +3 to give a little bit of headroom?

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IIRC Core is strict on the +1 ? If we give a headroom and the transaction is inside that window, we fail ?

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, true. I guess I worry that if we reject hard at exactly +1 we'll fail to accept in some race conditions around block connection orders and the easy way to fix that is to break the anti-fee-sniping stuff by just subtracting one.

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, thinking more I would assume that your bitcoind is never behind as it should be the authoritative source of blocks for the other modules I think it's really hard to make assumption on the block connection orders between your wallet and LDK. So taking the +2 in case the wallet is faster than LDK. However, unless you have multiple and non-reconciliated (meeeeh...) block sources, your wallet shouldn't be faster than bitcoind-or-equivalent and not hit the headroom window (contrary what I was worried about in previous comment).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we rebroadcast funding transactions (e.g., every block), we could be a bit more forgiving here regarding the window. I wonder if this is something we'd want to do anyway outside of this context to ensure transaction propagation, as they could be dropped from mempools due to other higher fee transactions.

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Apart of the funding and closing transactions, I think we fee-bump and rebroadcast all our LN transactions in OnchainTxHandler. Of course, it would be really nice if we implement fee-bumping for those transactions suiting the user confirmation requirements (or to hedge against unreliable tx-relay peers). I think it's better implemented by us rather than BroadcastInterface as we might have view on the user UTXO set (at least after anchor output). My thinking on that has always been to wait to support dual-funding and splicing, as fee-bumping is part of the spec for both opening and close. That way we would have all our transactions scheduled by one unified component OnchainTxHandler (where it would become a trait and given access to ChannelManager, only of being a ChannelMonitor's struct for now).

@codecov-commenter

codecov-commenter commented Jun 9, 2022

Copy link
Copy Markdown

Codecov Report

Merging #1531 (f99fa81) into main (22dc964) will decrease coverage by 0.01%.
The diff coverage is 91.17%.

❗ Current head f99fa81 differs from pull request most recent head 69344fa. Consider uploading reports for the commit 69344fa to get more accurate results

@@ Coverage Diff @@## main #1531 +/- ##
==========================================
- Coverage 90.94% 90.93% -0.02% 
==========================================
Files 80 80 Lines 43469 43503 +34 Branches 43469 43503 +34 ==========================================
+ Hits 39533 39559 +26 - Misses 3936 3944 +8 
Impacted FilesCoverage Δ
lightning/src/ln/functional_tests.rs97.04% <90.00%> (-0.13%)⬇️
lightning/src/ln/channelmanager.rs84.34% <100.00%> (+0.01%)⬆️
lightning-net-tokio/src/lib.rs77.16% <0.00%> (+0.30%)⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 22dc964...69344fa. Read the comment docs.

@ariard

Copy link
Copy Markdown
Author

Updated at 2cae4ef with suggestions. Added test_non_final_funding_tx to exercise new APIError.

@wpaulinowpaulino left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not something to worry about yet, but we should make this very clear in the release notes, as I'm unsure of how prevalent the use of final transactions is across our users.

Comment threadlightning/src/ln/channelmanager.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs Outdated
{
let height = self.best_block.read().unwrap().height();
// Transactions are evaluated as final by network mempools at the next block.
if funding_transaction.lock_time < 500_000_000 && funding_transaction.lock_time > height + 1 {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we rebroadcast funding transactions (e.g., every block), we could be a bit more forgiving here regarding the window. I wonder if this is something we'd want to do anyway outside of this context to ensure transaction propagation, as they could be dropped from mempools due to other higher fee transactions.

@ariard

ariard commented Jun 10, 2022

Copy link
Copy Markdown
Author

Updated at f99fa81, with review comment addressed.

Not something to worry about yet, but we should make this very clear in the release notes, as I'm unsure of how prevalent the use of final transactions is across our users.

Well to be propagated and included a transaction must be final no ? I think what is worrying are users calling our API with non-final transactions, and from now on we would reject them. At least with an error instead of a silent sendrawtransaction if you implement a really basic BroadcastInterface. Though yep, better to document that clearly in release notes.

Comment threadlightning/src/ln/channelmanager.rs Outdated
@ariard

Copy link
Copy Markdown
Author

Updated at 6e4a895 with comment addressed. Test has been updated in consequence.

Comment threadlightning/src/ln/functional_tests.rs Outdated
Comment threadlightning/src/ln/channelmanager.rs
Antoine Riard added 2 commits June 14, 2022 15:57
If the funding transaction is timelocked beyond the next block of
our best known chain tip, return an APIError instead of silently
failing at broadcast attempt.
@ariard

Copy link
Copy Markdown
Author

Updated at 69344fa with comments addressed.

@TheBlueMatt
TheBlueMatt merged commit e533446 into lightningdevkit:mainJun 16, 2022
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@ariard@codecov-commenter@TheBlueMatt@wpaulino