Skip to content

Expose amount forwarded in PaymentForwarded event - #2136

Merged
TheBlueMatt merged 1 commit into
lightningdevkit:mainfrom
marctyndel:2023-03-paymentforwarded-expose-amount-forwarded
Mar 30, 2023
Merged

Expose amount forwarded in PaymentForwarded event#2136
TheBlueMatt merged 1 commit into
lightningdevkit:mainfrom
marctyndel:2023-03-paymentforwarded-expose-amount-forwarded

Conversation

@marctyndel

Copy link
Copy Markdown
Contributor

This PR adds the amount forwarded to PaymentForwarded events.

We'd like this value for analytics. At the moment I've been computing it using fee_earned_msat and the outbound channel's forwarding policy, but this introduces rounding error (and I think could occasionally be incorrect if the policy was recently updated but not yet propagated).

@marctyndel
marctyndelforce-pushed the 2023-03-paymentforwarded-expose-amount-forwarded branch from 6823642 to 3ad0f09CompareMarch 28, 2023 16:47
TheBlueMatt
TheBlueMatt previously approved these changes Mar 28, 2023
Comment threadlightning/src/ln/channelmanager.rs Outdated
claim_from_onchain_tx: from_onchain,
prev_channel_id,
next_channel_id,
amount_forwarded_msat: forwarded_htlc_value_msat,

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ha, that was easy

Comment threadlightning/src/events/mod.rs Outdated
claim_from_onchain_tx: bool,
/// The final amount forwarded, in milli-satoshis, after the fee is deducted.
/// The caveat described above the `fee_earned_msat` field applies here as well.
amount_forwarded_msat: Option<u64>,

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there a name that more clearly indicates this is the outbound amount we forwarded downstream, rather than the amount we received? I think this is fine just want to make sure we don't see anything obviously better, I don't have any ideas, though.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Something like amount_outbound_forwarded_msat?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe outgoing_amount_forwarded_msat? 🤷

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Up to you @marctyndel.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Going with a blend of the above: outbound_amount_forwarded_msat (because HTLCIntercepted, also uses the word "outbound"...I do see "outgoing" is used elsewhere but at a glance not in anything exposed)

Comment threadlightning/src/events/mod.rs Outdated
Comment threadlightning/src/events/mod.rs Outdated
Comment threadlightning/src/events/mod.rs Outdated
claim_from_onchain_tx: bool,
/// The final amount forwarded, in milli-satoshis, after the fee is deducted.
/// The caveat described above the `fee_earned_msat` field applies here as well.
amount_forwarded_msat: Option<u64>,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe outgoing_amount_forwarded_msat? 🤷

@TheBlueMatt

Copy link
Copy Markdown
Collaborator

Feel free to squash the fixup commit(s) down when you next push.

@marctyndel
marctyndelforce-pushed the 2023-03-paymentforwarded-expose-amount-forwarded branch from 6b3b0c9 to cf3c211CompareMarch 29, 2023 16:58
@codecov-commenter

codecov-commenter commented Mar 29, 2023

Copy link
Copy Markdown

Codecov Report

Patch coverage: 80.00% and project coverage change: -0.04⚠️

Comparison is base (723c1a6) 91.40% compared to head (6b3b0c9) 91.37%.

❗ Current head 6b3b0c9 differs from pull request most recent head ee2cb8e. Consider uploading reports for the commit ee2cb8e to get more accurate results

📣 This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more

Additional details and impacted files
@@ Coverage Diff @@## main #2136 +/- ##
==========================================
- Coverage 91.40% 91.37% -0.04% 
==========================================
Files 102 102 Lines 49736 49568 -168 Branches 49736 49568 -168 ==========================================
- Hits 45461 45291 -170 - Misses 4275 4277 +2 
Impacted FilesCoverage Δ
lightning/src/ln/functional_test_utils.rs92.59% <ø> (ø)
lightning/src/events/mod.rs32.31% <33.33%> (+0.18%)⬆️
lightning/src/ln/channelmanager.rs89.15% <100.00%> (+0.02%)⬆️
lightning/src/ln/functional_tests.rs98.24% <100.00%> (+0.01%)⬆️

... and 7 files with indirect coverage changes

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

assert_eq!(events.len(), 1);
match events[0] {
Event::PaymentForwarded { fee_earned_msat, prev_channel_id, claim_from_onchain_tx, next_channel_id } => {
Event::PaymentForwarded { fee_earned_msat, prev_channel_id, claim_from_onchain_tx, next_channel_id, .. } => {

@marctyndelmarctyndelMar 29, 2023

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Question: for this test macro, if I add the new field, I get stuck trying to update the mid_update_fulfill_dance macro, because I can't see how to get the amount. I notice that fee is obtained there in a perhaps indirect way, by getting the forwarding_fee_base_msat from the channel config (meaning the test is run with 0 proportional fees), which suggests getting the amount from the HTLC might not straightforward here? Or I might be missing something.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, yea, you could do a few different things - you could add a new macro variant (ie the top level ($node,,, thing you can just add another one with a new parameter), you could indeed try to deduce the correct amount based on the fee fetched from the channel (though a few tests will fail that), or you could just not worry about it. The code here is simple enough and there are at least a few tests which exercise it, so I'm admittedly not super worried about ensuring we have Maximal Test Coverage of it.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Then if everyone's okay with it I'll go with the "just not worry about it" option

TheBlueMatt
TheBlueMatt previously approved these changes Mar 29, 2023

@tnulltnull left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Generally looks good to me, just some minor remarks/suggestions.

Comment threadlightning/src/events/mod.rs
Comment threadlightning/src/ln/functional_test_utils.rs Outdated
Comment threadlightning/src/events/mod.rs Outdated

@tnulltnull left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dunxendunxen left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice one! :)

@TheBlueMatt
TheBlueMatt merged commit 783e818 into lightningdevkit:mainMar 30, 2023
@marctyndel
marctyndel deleted the 2023-03-paymentforwarded-expose-amount-forwarded branch March 30, 2023 20:07
PXplod pushed a commit to bitlightlabs/rust-lightning that referenced this pull request Sep 30, 2024
0.0.115 - Apr 24, 2023 - "Rebroadcast the Bugfixes"
API Updates
===========
* The MSRV of the main LDK crates has been increased to 1.48 (lightningdevkit#2107).
* Attempting to claim an un-expired payment on a channel which has closed no
longer fails. The expiry time of payments is exposed via
`PaymentClaimable::claim_deadline` (lightningdevkit#2148).
* `payment_metadata` is now supported in `Invoice` deserialization, sending,
and receiving (via a new `RecipientOnionFields` struct) (lightningdevkit#2139, lightningdevkit#2127).
* `Event::PaymentFailed` now exposes a failure reason (lightningdevkit#2142).
* BOLT12 messages now support stateless generation and validation (lightningdevkit#1989).
* The `NetworkGraph` is now pruned of stale data after RGS processing (lightningdevkit#2161).
* Max inbound HTLCs in-flight can be changed in the handshake config (lightningdevkit#2138).
* `lightning-transaction-sync` feature `esplora-async-https` was added (lightningdevkit#2085).
* A `ChannelPending` event is now emitted after the initial handshake (lightningdevkit#2098).
* `PaymentForwarded::outbound_amount_forwarded_msat` was added (lightningdevkit#2136).
* `ChannelManager::list_channels_by_counterparty` was added (lightningdevkit#2079).
* `ChannelDetails::feerate_sat_per_1000_weight` was added (lightningdevkit#2094).
* `Invoice::fallback_addresses` was added to fetch `bitcoin` types (lightningdevkit#2023).
* The offer/refund description is now exposed in `Invoice{,Request}` (lightningdevkit#2206).
Backwards Compatibility
=======================
* Payments sent with the legacy `*_with_route` methods on LDK 0.0.115+ will no
longer be retryable via the LDK 0.0.114- `retry_payment` method (lightningdevkit#2139).
* `Event::PaymentPathFailed::retry` was removed and will always be `None` for
payments initiated on 0.0.115 which fail on an earlier version (lightningdevkit#2063).
* `Route`s and `PaymentParameters` with blinded path information will not be
readable on prior versions of LDK. Such objects are not currently constructed
by LDK, but may be when processing BOLT12 data in a coming release (lightningdevkit#2146).
* Providing `ChannelMonitorUpdate`s generated by LDK 0.0.115 to a
`ChannelMonitor` on 0.0.114 or before may panic (lightningdevkit#2059). Note that this is
in general unsupported, and included here only for completeness.
Bug Fixes
=========
* Fixed a case where `process_events_async` may `poll` a `Future` which has
already completed (lightningdevkit#2081).
* Fixed deserialization of `u16` arrays. This bug may have previously corrupted
the historical buckets in a `ProbabilisticScorer`. Users relying on the
historical buckets may wish to wipe their scorer on upgrade to remove corrupt
data rather than waiting on it to decay (lightningdevkit#2191).
* The `process_events_async` task is now `Send` and can thus be polled on a
multi-threaded runtime (lightningdevkit#2199).
* Fixed a missing macro export causing
`impl_writeable_tlv_based_enum{,_upgradable}` calls to not compile (lightningdevkit#2091).
* Fixed compilation of `lightning-invoice` with both `no-std` and serde (lightningdevkit#2187)
* Fix an issue where the `background-processor` would not wake when a
`ChannelMonitorUpdate` completed asynchronously, causing delays (lightningdevkit#2090).
* Fix an issue where `process_events_async` would exit immediately (lightningdevkit#2145).
* `Router` calls from the `ChannelManager` now call `find_route_with_id` rather
than `find_route`, as was intended and described in the API (lightningdevkit#2092).
* Ensure `process_events_async` always exits if any sleep future returns true,
not just if all sleep futures repeatedly return true (lightningdevkit#2145).
* `channel_update` messages no longer set the disable bit unless the peer has
been disconnected for some time. This should resolve cases where channels are
disabled for extended periods of time (lightningdevkit#2198).
* We no longer remove CLN nodes from the network graph for violating the BOLT
spec in some cases after failing to pay through them (lightningdevkit#2220).
* Fixed a debug assertion which may panic under heavy load (lightningdevkit#2172).
* `CounterpartyForceClosed::peer_msg` is now wrapped in UntrustedString (lightningdevkit#2114)
* Fixed a potential deadlock in `funding_transaction_generated` (lightningdevkit#2158).
Security
========
* Transaction re-broadcasting is now substantially more aggressive, including a
new regular rebroadcast feature called on a timer from the
`background-processor` or from `ChainMonitor::rebroadcast_pending_claims`.
This should substantially increase transaction confirmation reliability
without relying on downstream `TransactionBroadcaster` implementations for
rebroadcasting (lightningdevkit#2203, lightningdevkit#2205, lightningdevkit#2208).
* Implemented the changes from BOLT PRs lightningdevkit#1031, lightningdevkit#1032, and lightningdevkit#1040 which resolve a
privacy vulnerability which allows an intermediate node on the path to
discover the final destination for a payment (lightningdevkit#2062).
In total, this release features 110 files changed, 11928 insertions, 6368
deletions in 215 commits from 21 authors, in alphabetical order:
* Advait
* Alan Cohen
* Alec Chen
* Allan Douglas R. de Oliveira
* Arik Sosman
* Elias Rohrer
* Evan Feenstra
* Jeffrey Czyz
* John Cantrell
* Lucas Soriano del Pino
* Marc Tyndel
* Matt Corallo
* Paul Miller
* Steven
* Steven Williamson
* Steven Zhao
* Tony Giorgio
* Valentine Wallace
* Wilmer Paulino
* benthecarman
* munjesi
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@marctyndel@TheBlueMatt@codecov-commenter@tnull@dunxen@alecchendev
, 'i'); if (__m === '*' || __re.test(location.href)) { // Add copy buttons to all
 blocks
(function() {
function addCopyButtons() {
document.querySelectorAll('pre code').forEach(function(codeBlock) {
if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;
codeBlock.parentElement.setAttribute('data-copy-added', 'true');
var btn = document.createElement('button');
btn.textContent = 'Copy';
btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';
btn.onmouseover = function() { this.style.opacity = '1'; };
btn.onmouseout = function() { this.style.opacity = '0.7'; };
btn.onclick = function() {
navigator.clipboard.writeText(codeBlock.textContent).then(function() {
btn.textContent = 'Copied!';
setTimeout(function() { btn.textContent = 'Copy'; }, 1500);
});
};
codeBlock.parentElement.style.position = 'relative';
codeBlock.parentElement.appendChild(btn);
});
}
addCopyButtons();
// Re-run on dynamic content
var observer = new MutationObserver(addCopyButtons);
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
Expose amount forwarded in `PaymentForwarded` event by marctyndel · Pull Request #2136 · lightningdevkit/rust-lightning · GitHub
Skip to content

Expose amount forwarded in PaymentForwarded event - #2136

Merged
TheBlueMatt merged 1 commit into
lightningdevkit:mainfrom
marctyndel:2023-03-paymentforwarded-expose-amount-forwarded
Mar 30, 2023
Merged

Expose amount forwarded in PaymentForwarded event#2136
TheBlueMatt merged 1 commit into
lightningdevkit:mainfrom
marctyndel:2023-03-paymentforwarded-expose-amount-forwarded

Conversation

@marctyndel

Copy link
Copy Markdown
Contributor

This PR adds the amount forwarded to PaymentForwarded events.

We'd like this value for analytics. At the moment I've been computing it using fee_earned_msat and the outbound channel's forwarding policy, but this introduces rounding error (and I think could occasionally be incorrect if the policy was recently updated but not yet propagated).

@marctyndel
marctyndelforce-pushed the 2023-03-paymentforwarded-expose-amount-forwarded branch from 6823642 to 3ad0f09CompareMarch 28, 2023 16:47
TheBlueMatt
TheBlueMatt previously approved these changes Mar 28, 2023
Comment threadlightning/src/ln/channelmanager.rs Outdated
claim_from_onchain_tx: from_onchain,
prev_channel_id,
next_channel_id,
amount_forwarded_msat: forwarded_htlc_value_msat,

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ha, that was easy

Comment threadlightning/src/events/mod.rs Outdated
claim_from_onchain_tx: bool,
/// The final amount forwarded, in milli-satoshis, after the fee is deducted.
/// The caveat described above the `fee_earned_msat` field applies here as well.
amount_forwarded_msat: Option<u64>,

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there a name that more clearly indicates this is the outbound amount we forwarded downstream, rather than the amount we received? I think this is fine just want to make sure we don't see anything obviously better, I don't have any ideas, though.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Something like amount_outbound_forwarded_msat?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe outgoing_amount_forwarded_msat? 🤷

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Up to you @marctyndel.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Going with a blend of the above: outbound_amount_forwarded_msat (because HTLCIntercepted, also uses the word "outbound"...I do see "outgoing" is used elsewhere but at a glance not in anything exposed)

Comment threadlightning/src/events/mod.rs Outdated
Comment threadlightning/src/events/mod.rs Outdated
Comment threadlightning/src/events/mod.rs Outdated
claim_from_onchain_tx: bool,
/// The final amount forwarded, in milli-satoshis, after the fee is deducted.
/// The caveat described above the `fee_earned_msat` field applies here as well.
amount_forwarded_msat: Option<u64>,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe outgoing_amount_forwarded_msat? 🤷

@TheBlueMatt

Copy link
Copy Markdown
Collaborator

Feel free to squash the fixup commit(s) down when you next push.

@marctyndel
marctyndelforce-pushed the 2023-03-paymentforwarded-expose-amount-forwarded branch from 6b3b0c9 to cf3c211CompareMarch 29, 2023 16:58
@codecov-commenter

codecov-commenter commented Mar 29, 2023

Copy link
Copy Markdown

Codecov Report

Patch coverage: 80.00% and project coverage change: -0.04⚠️

Comparison is base (723c1a6) 91.40% compared to head (6b3b0c9) 91.37%.

❗ Current head 6b3b0c9 differs from pull request most recent head ee2cb8e. Consider uploading reports for the commit ee2cb8e to get more accurate results

📣 This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more

Additional details and impacted files
@@ Coverage Diff @@## main #2136 +/- ##
==========================================
- Coverage 91.40% 91.37% -0.04% 
==========================================
Files 102 102 Lines 49736 49568 -168 Branches 49736 49568 -168 ==========================================
- Hits 45461 45291 -170 - Misses 4275 4277 +2 
Impacted FilesCoverage Δ
lightning/src/ln/functional_test_utils.rs92.59% <ø> (ø)
lightning/src/events/mod.rs32.31% <33.33%> (+0.18%)⬆️
lightning/src/ln/channelmanager.rs89.15% <100.00%> (+0.02%)⬆️
lightning/src/ln/functional_tests.rs98.24% <100.00%> (+0.01%)⬆️

... and 7 files with indirect coverage changes

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

assert_eq!(events.len(), 1);
match events[0] {
Event::PaymentForwarded { fee_earned_msat, prev_channel_id, claim_from_onchain_tx, next_channel_id } => {
Event::PaymentForwarded { fee_earned_msat, prev_channel_id, claim_from_onchain_tx, next_channel_id, .. } => {

@marctyndelmarctyndelMar 29, 2023

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Question: for this test macro, if I add the new field, I get stuck trying to update the mid_update_fulfill_dance macro, because I can't see how to get the amount. I notice that fee is obtained there in a perhaps indirect way, by getting the forwarding_fee_base_msat from the channel config (meaning the test is run with 0 proportional fees), which suggests getting the amount from the HTLC might not straightforward here? Or I might be missing something.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, yea, you could do a few different things - you could add a new macro variant (ie the top level ($node,,, thing you can just add another one with a new parameter), you could indeed try to deduce the correct amount based on the fee fetched from the channel (though a few tests will fail that), or you could just not worry about it. The code here is simple enough and there are at least a few tests which exercise it, so I'm admittedly not super worried about ensuring we have Maximal Test Coverage of it.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Then if everyone's okay with it I'll go with the "just not worry about it" option

TheBlueMatt
TheBlueMatt previously approved these changes Mar 29, 2023

@tnulltnull left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Generally looks good to me, just some minor remarks/suggestions.

Comment threadlightning/src/events/mod.rs
Comment threadlightning/src/ln/functional_test_utils.rs Outdated
Comment threadlightning/src/events/mod.rs Outdated

@tnulltnull left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dunxendunxen left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice one! :)

@TheBlueMatt
TheBlueMatt merged commit 783e818 into lightningdevkit:mainMar 30, 2023
@marctyndel
marctyndel deleted the 2023-03-paymentforwarded-expose-amount-forwarded branch March 30, 2023 20:07
PXplod pushed a commit to bitlightlabs/rust-lightning that referenced this pull request Sep 30, 2024
0.0.115 - Apr 24, 2023 - "Rebroadcast the Bugfixes"
API Updates
===========
* The MSRV of the main LDK crates has been increased to 1.48 (lightningdevkit#2107).
* Attempting to claim an un-expired payment on a channel which has closed no
longer fails. The expiry time of payments is exposed via
`PaymentClaimable::claim_deadline` (lightningdevkit#2148).
* `payment_metadata` is now supported in `Invoice` deserialization, sending,
and receiving (via a new `RecipientOnionFields` struct) (lightningdevkit#2139, lightningdevkit#2127).
* `Event::PaymentFailed` now exposes a failure reason (lightningdevkit#2142).
* BOLT12 messages now support stateless generation and validation (lightningdevkit#1989).
* The `NetworkGraph` is now pruned of stale data after RGS processing (lightningdevkit#2161).
* Max inbound HTLCs in-flight can be changed in the handshake config (lightningdevkit#2138).
* `lightning-transaction-sync` feature `esplora-async-https` was added (lightningdevkit#2085).
* A `ChannelPending` event is now emitted after the initial handshake (lightningdevkit#2098).
* `PaymentForwarded::outbound_amount_forwarded_msat` was added (lightningdevkit#2136).
* `ChannelManager::list_channels_by_counterparty` was added (lightningdevkit#2079).
* `ChannelDetails::feerate_sat_per_1000_weight` was added (lightningdevkit#2094).
* `Invoice::fallback_addresses` was added to fetch `bitcoin` types (lightningdevkit#2023).
* The offer/refund description is now exposed in `Invoice{,Request}` (lightningdevkit#2206).
Backwards Compatibility
=======================
* Payments sent with the legacy `*_with_route` methods on LDK 0.0.115+ will no
longer be retryable via the LDK 0.0.114- `retry_payment` method (lightningdevkit#2139).
* `Event::PaymentPathFailed::retry` was removed and will always be `None` for
payments initiated on 0.0.115 which fail on an earlier version (lightningdevkit#2063).
* `Route`s and `PaymentParameters` with blinded path information will not be
readable on prior versions of LDK. Such objects are not currently constructed
by LDK, but may be when processing BOLT12 data in a coming release (lightningdevkit#2146).
* Providing `ChannelMonitorUpdate`s generated by LDK 0.0.115 to a
`ChannelMonitor` on 0.0.114 or before may panic (lightningdevkit#2059). Note that this is
in general unsupported, and included here only for completeness.
Bug Fixes
=========
* Fixed a case where `process_events_async` may `poll` a `Future` which has
already completed (lightningdevkit#2081).
* Fixed deserialization of `u16` arrays. This bug may have previously corrupted
the historical buckets in a `ProbabilisticScorer`. Users relying on the
historical buckets may wish to wipe their scorer on upgrade to remove corrupt
data rather than waiting on it to decay (lightningdevkit#2191).
* The `process_events_async` task is now `Send` and can thus be polled on a
multi-threaded runtime (lightningdevkit#2199).
* Fixed a missing macro export causing
`impl_writeable_tlv_based_enum{,_upgradable}` calls to not compile (lightningdevkit#2091).
* Fixed compilation of `lightning-invoice` with both `no-std` and serde (lightningdevkit#2187)
* Fix an issue where the `background-processor` would not wake when a
`ChannelMonitorUpdate` completed asynchronously, causing delays (lightningdevkit#2090).
* Fix an issue where `process_events_async` would exit immediately (lightningdevkit#2145).
* `Router` calls from the `ChannelManager` now call `find_route_with_id` rather
than `find_route`, as was intended and described in the API (lightningdevkit#2092).
* Ensure `process_events_async` always exits if any sleep future returns true,
not just if all sleep futures repeatedly return true (lightningdevkit#2145).
* `channel_update` messages no longer set the disable bit unless the peer has
been disconnected for some time. This should resolve cases where channels are
disabled for extended periods of time (lightningdevkit#2198).
* We no longer remove CLN nodes from the network graph for violating the BOLT
spec in some cases after failing to pay through them (lightningdevkit#2220).
* Fixed a debug assertion which may panic under heavy load (lightningdevkit#2172).
* `CounterpartyForceClosed::peer_msg` is now wrapped in UntrustedString (lightningdevkit#2114)
* Fixed a potential deadlock in `funding_transaction_generated` (lightningdevkit#2158).
Security
========
* Transaction re-broadcasting is now substantially more aggressive, including a
new regular rebroadcast feature called on a timer from the
`background-processor` or from `ChainMonitor::rebroadcast_pending_claims`.
This should substantially increase transaction confirmation reliability
without relying on downstream `TransactionBroadcaster` implementations for
rebroadcasting (lightningdevkit#2203, lightningdevkit#2205, lightningdevkit#2208).
* Implemented the changes from BOLT PRs lightningdevkit#1031, lightningdevkit#1032, and lightningdevkit#1040 which resolve a
privacy vulnerability which allows an intermediate node on the path to
discover the final destination for a payment (lightningdevkit#2062).
In total, this release features 110 files changed, 11928 insertions, 6368
deletions in 215 commits from 21 authors, in alphabetical order:
* Advait
* Alan Cohen
* Alec Chen
* Allan Douglas R. de Oliveira
* Arik Sosman
* Elias Rohrer
* Evan Feenstra
* Jeffrey Czyz
* John Cantrell
* Lucas Soriano del Pino
* Marc Tyndel
* Matt Corallo
* Paul Miller
* Steven
* Steven Williamson
* Steven Zhao
* Tony Giorgio
* Valentine Wallace
* Wilmer Paulino
* benthecarman
* munjesi
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@marctyndel@TheBlueMatt@codecov-commenter@tnull@dunxen@alecchendev
, 'i'); if (__m === '*' || __re.test(location.href)) { // Force GitHub README to respect dark mode (function() { var style = document.createElement('style'); style.textContent = ' .markdown-body { color-scheme: dark light; } .markdown-body pre { background: #161b22 !important; } .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; } .markdown-body table th, .markdown-body table td { border-color: #30363d !important; } .markdown-body img { background: #0d1117; } .markdown-body blockquote { border-left-color: #8b949e; } .markdown-body hr { border-color: #30363d; } '; document.head.appendChild(style); })(); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' Expose amount forwarded in `PaymentForwarded` event by marctyndel · Pull Request #2136 · lightningdevkit/rust-lightning · GitHub
Skip to content

Expose amount forwarded in PaymentForwarded event - #2136

Merged
TheBlueMatt merged 1 commit into
lightningdevkit:mainfrom
marctyndel:2023-03-paymentforwarded-expose-amount-forwarded
Mar 30, 2023
Merged

Expose amount forwarded in PaymentForwarded event#2136
TheBlueMatt merged 1 commit into
lightningdevkit:mainfrom
marctyndel:2023-03-paymentforwarded-expose-amount-forwarded

Conversation

@marctyndel

Copy link
Copy Markdown
Contributor

This PR adds the amount forwarded to PaymentForwarded events.

We'd like this value for analytics. At the moment I've been computing it using fee_earned_msat and the outbound channel's forwarding policy, but this introduces rounding error (and I think could occasionally be incorrect if the policy was recently updated but not yet propagated).

@marctyndel
marctyndelforce-pushed the 2023-03-paymentforwarded-expose-amount-forwarded branch from 6823642 to 3ad0f09CompareMarch 28, 2023 16:47
TheBlueMatt
TheBlueMatt previously approved these changes Mar 28, 2023
Comment threadlightning/src/ln/channelmanager.rs Outdated
claim_from_onchain_tx: from_onchain,
prev_channel_id,
next_channel_id,
amount_forwarded_msat: forwarded_htlc_value_msat,

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ha, that was easy

Comment threadlightning/src/events/mod.rs Outdated
claim_from_onchain_tx: bool,
/// The final amount forwarded, in milli-satoshis, after the fee is deducted.
/// The caveat described above the `fee_earned_msat` field applies here as well.
amount_forwarded_msat: Option<u64>,

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there a name that more clearly indicates this is the outbound amount we forwarded downstream, rather than the amount we received? I think this is fine just want to make sure we don't see anything obviously better, I don't have any ideas, though.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Something like amount_outbound_forwarded_msat?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe outgoing_amount_forwarded_msat? 🤷

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Up to you @marctyndel.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Going with a blend of the above: outbound_amount_forwarded_msat (because HTLCIntercepted, also uses the word "outbound"...I do see "outgoing" is used elsewhere but at a glance not in anything exposed)

Comment threadlightning/src/events/mod.rs Outdated
Comment threadlightning/src/events/mod.rs Outdated
Comment threadlightning/src/events/mod.rs Outdated
claim_from_onchain_tx: bool,
/// The final amount forwarded, in milli-satoshis, after the fee is deducted.
/// The caveat described above the `fee_earned_msat` field applies here as well.
amount_forwarded_msat: Option<u64>,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe outgoing_amount_forwarded_msat? 🤷

@TheBlueMatt

Copy link
Copy Markdown
Collaborator

Feel free to squash the fixup commit(s) down when you next push.

@marctyndel
marctyndelforce-pushed the 2023-03-paymentforwarded-expose-amount-forwarded branch from 6b3b0c9 to cf3c211CompareMarch 29, 2023 16:58
@codecov-commenter

codecov-commenter commented Mar 29, 2023

Copy link
Copy Markdown

Codecov Report

Patch coverage: 80.00% and project coverage change: -0.04⚠️

Comparison is base (723c1a6) 91.40% compared to head (6b3b0c9) 91.37%.

❗ Current head 6b3b0c9 differs from pull request most recent head ee2cb8e. Consider uploading reports for the commit ee2cb8e to get more accurate results

📣 This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more

Additional details and impacted files
@@ Coverage Diff @@## main #2136 +/- ##
==========================================
- Coverage 91.40% 91.37% -0.04% 
==========================================
Files 102 102 Lines 49736 49568 -168 Branches 49736 49568 -168 ==========================================
- Hits 45461 45291 -170 - Misses 4275 4277 +2 
Impacted FilesCoverage Δ
lightning/src/ln/functional_test_utils.rs92.59% <ø> (ø)
lightning/src/events/mod.rs32.31% <33.33%> (+0.18%)⬆️
lightning/src/ln/channelmanager.rs89.15% <100.00%> (+0.02%)⬆️
lightning/src/ln/functional_tests.rs98.24% <100.00%> (+0.01%)⬆️

... and 7 files with indirect coverage changes

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

assert_eq!(events.len(), 1);
match events[0] {
Event::PaymentForwarded { fee_earned_msat, prev_channel_id, claim_from_onchain_tx, next_channel_id } => {
Event::PaymentForwarded { fee_earned_msat, prev_channel_id, claim_from_onchain_tx, next_channel_id, .. } => {

@marctyndelmarctyndelMar 29, 2023

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Question: for this test macro, if I add the new field, I get stuck trying to update the mid_update_fulfill_dance macro, because I can't see how to get the amount. I notice that fee is obtained there in a perhaps indirect way, by getting the forwarding_fee_base_msat from the channel config (meaning the test is run with 0 proportional fees), which suggests getting the amount from the HTLC might not straightforward here? Or I might be missing something.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, yea, you could do a few different things - you could add a new macro variant (ie the top level ($node,,, thing you can just add another one with a new parameter), you could indeed try to deduce the correct amount based on the fee fetched from the channel (though a few tests will fail that), or you could just not worry about it. The code here is simple enough and there are at least a few tests which exercise it, so I'm admittedly not super worried about ensuring we have Maximal Test Coverage of it.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Then if everyone's okay with it I'll go with the "just not worry about it" option

TheBlueMatt
TheBlueMatt previously approved these changes Mar 29, 2023

@tnulltnull left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Generally looks good to me, just some minor remarks/suggestions.

Comment threadlightning/src/events/mod.rs
Comment threadlightning/src/ln/functional_test_utils.rs Outdated
Comment threadlightning/src/events/mod.rs Outdated

@tnulltnull left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dunxendunxen left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice one! :)

@TheBlueMatt
TheBlueMatt merged commit 783e818 into lightningdevkit:mainMar 30, 2023
@marctyndel
marctyndel deleted the 2023-03-paymentforwarded-expose-amount-forwarded branch March 30, 2023 20:07
PXplod pushed a commit to bitlightlabs/rust-lightning that referenced this pull request Sep 30, 2024
0.0.115 - Apr 24, 2023 - "Rebroadcast the Bugfixes"
API Updates
===========
* The MSRV of the main LDK crates has been increased to 1.48 (lightningdevkit#2107).
* Attempting to claim an un-expired payment on a channel which has closed no
longer fails. The expiry time of payments is exposed via
`PaymentClaimable::claim_deadline` (lightningdevkit#2148).
* `payment_metadata` is now supported in `Invoice` deserialization, sending,
and receiving (via a new `RecipientOnionFields` struct) (lightningdevkit#2139, lightningdevkit#2127).
* `Event::PaymentFailed` now exposes a failure reason (lightningdevkit#2142).
* BOLT12 messages now support stateless generation and validation (lightningdevkit#1989).
* The `NetworkGraph` is now pruned of stale data after RGS processing (lightningdevkit#2161).
* Max inbound HTLCs in-flight can be changed in the handshake config (lightningdevkit#2138).
* `lightning-transaction-sync` feature `esplora-async-https` was added (lightningdevkit#2085).
* A `ChannelPending` event is now emitted after the initial handshake (lightningdevkit#2098).
* `PaymentForwarded::outbound_amount_forwarded_msat` was added (lightningdevkit#2136).
* `ChannelManager::list_channels_by_counterparty` was added (lightningdevkit#2079).
* `ChannelDetails::feerate_sat_per_1000_weight` was added (lightningdevkit#2094).
* `Invoice::fallback_addresses` was added to fetch `bitcoin` types (lightningdevkit#2023).
* The offer/refund description is now exposed in `Invoice{,Request}` (lightningdevkit#2206).
Backwards Compatibility
=======================
* Payments sent with the legacy `*_with_route` methods on LDK 0.0.115+ will no
longer be retryable via the LDK 0.0.114- `retry_payment` method (lightningdevkit#2139).
* `Event::PaymentPathFailed::retry` was removed and will always be `None` for
payments initiated on 0.0.115 which fail on an earlier version (lightningdevkit#2063).
* `Route`s and `PaymentParameters` with blinded path information will not be
readable on prior versions of LDK. Such objects are not currently constructed
by LDK, but may be when processing BOLT12 data in a coming release (lightningdevkit#2146).
* Providing `ChannelMonitorUpdate`s generated by LDK 0.0.115 to a
`ChannelMonitor` on 0.0.114 or before may panic (lightningdevkit#2059). Note that this is
in general unsupported, and included here only for completeness.
Bug Fixes
=========
* Fixed a case where `process_events_async` may `poll` a `Future` which has
already completed (lightningdevkit#2081).
* Fixed deserialization of `u16` arrays. This bug may have previously corrupted
the historical buckets in a `ProbabilisticScorer`. Users relying on the
historical buckets may wish to wipe their scorer on upgrade to remove corrupt
data rather than waiting on it to decay (lightningdevkit#2191).
* The `process_events_async` task is now `Send` and can thus be polled on a
multi-threaded runtime (lightningdevkit#2199).
* Fixed a missing macro export causing
`impl_writeable_tlv_based_enum{,_upgradable}` calls to not compile (lightningdevkit#2091).
* Fixed compilation of `lightning-invoice` with both `no-std` and serde (lightningdevkit#2187)
* Fix an issue where the `background-processor` would not wake when a
`ChannelMonitorUpdate` completed asynchronously, causing delays (lightningdevkit#2090).
* Fix an issue where `process_events_async` would exit immediately (lightningdevkit#2145).
* `Router` calls from the `ChannelManager` now call `find_route_with_id` rather
than `find_route`, as was intended and described in the API (lightningdevkit#2092).
* Ensure `process_events_async` always exits if any sleep future returns true,
not just if all sleep futures repeatedly return true (lightningdevkit#2145).
* `channel_update` messages no longer set the disable bit unless the peer has
been disconnected for some time. This should resolve cases where channels are
disabled for extended periods of time (lightningdevkit#2198).
* We no longer remove CLN nodes from the network graph for violating the BOLT
spec in some cases after failing to pay through them (lightningdevkit#2220).
* Fixed a debug assertion which may panic under heavy load (lightningdevkit#2172).
* `CounterpartyForceClosed::peer_msg` is now wrapped in UntrustedString (lightningdevkit#2114)
* Fixed a potential deadlock in `funding_transaction_generated` (lightningdevkit#2158).
Security
========
* Transaction re-broadcasting is now substantially more aggressive, including a
new regular rebroadcast feature called on a timer from the
`background-processor` or from `ChainMonitor::rebroadcast_pending_claims`.
This should substantially increase transaction confirmation reliability
without relying on downstream `TransactionBroadcaster` implementations for
rebroadcasting (lightningdevkit#2203, lightningdevkit#2205, lightningdevkit#2208).
* Implemented the changes from BOLT PRs lightningdevkit#1031, lightningdevkit#1032, and lightningdevkit#1040 which resolve a
privacy vulnerability which allows an intermediate node on the path to
discover the final destination for a payment (lightningdevkit#2062).
In total, this release features 110 files changed, 11928 insertions, 6368
deletions in 215 commits from 21 authors, in alphabetical order:
* Advait
* Alan Cohen
* Alec Chen
* Allan Douglas R. de Oliveira
* Arik Sosman
* Elias Rohrer
* Evan Feenstra
* Jeffrey Czyz
* John Cantrell
* Lucas Soriano del Pino
* Marc Tyndel
* Matt Corallo
* Paul Miller
* Steven
* Steven Williamson
* Steven Zhao
* Tony Giorgio
* Valentine Wallace
* Wilmer Paulino
* benthecarman
* munjesi
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@marctyndel@TheBlueMatt@codecov-commenter@tnull@dunxen@alecchendev
, 'i'); if (__m === '*' || __re.test(location.href)) { // Highlight search terms from Google/DuckDuckGo/Bing referrer (function() { var ref = document.referrer; var terms = []; if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) { var url = new URL(ref); var q = url.searchParams.get('q') || url.searchParams.get('p'); if (q) { terms = q.split(/\s+/).filter(function(t) { return t.length > 2; }); } } if (terms.length === 0) return; var style = document.createElement('style'); style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }'; document.head.appendChild(style); function highlight(node) { if (node.nodeType === 3) { // text node var text = node.textContent; var found = false; terms.forEach(function(term) { var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\]\\]/g, '\\') + ')', 'gi'); if (regex.test(text)) { found = true; var frag = document.createDocumentFragment(); var parts = text.split(regex); parts.forEach(function(part, i) { if (i % 2 === 0) { frag.appendChild(document.createTextNode(part)); } else { var span = document.createElement('span'); span.className = 'userscript-highlight'; span.textContent = part; frag.appendChild(span); } }); node.parentNode.replaceChild(frag, node); } }); } else if (node.nodeType === 1 && node.childNodes) { // element var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT']; if (!skipTags.includes(node.tagName)) { Array.from(node.childNodes).forEach(highlight); } } } highlight(document.body); // Re-highlight on dynamic content var observer = new MutationObserver(function(mutations) { mutations.forEach(function(m) { m.addedNodes.forEach(function(node) { if (node.nodeType === 1 || node.nodeType === 3) highlight(node); }); }); }); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' Expose amount forwarded in `PaymentForwarded` event by marctyndel · Pull Request #2136 · lightningdevkit/rust-lightning · GitHub
Skip to content

Expose amount forwarded in PaymentForwarded event - #2136

Merged
TheBlueMatt merged 1 commit into
lightningdevkit:mainfrom
marctyndel:2023-03-paymentforwarded-expose-amount-forwarded
Mar 30, 2023
Merged

Expose amount forwarded in PaymentForwarded event#2136
TheBlueMatt merged 1 commit into
lightningdevkit:mainfrom
marctyndel:2023-03-paymentforwarded-expose-amount-forwarded

Conversation

@marctyndel

Copy link
Copy Markdown
Contributor

This PR adds the amount forwarded to PaymentForwarded events.

We'd like this value for analytics. At the moment I've been computing it using fee_earned_msat and the outbound channel's forwarding policy, but this introduces rounding error (and I think could occasionally be incorrect if the policy was recently updated but not yet propagated).

@marctyndel
marctyndelforce-pushed the 2023-03-paymentforwarded-expose-amount-forwarded branch from 6823642 to 3ad0f09CompareMarch 28, 2023 16:47
TheBlueMatt
TheBlueMatt previously approved these changes Mar 28, 2023
Comment threadlightning/src/ln/channelmanager.rs Outdated
claim_from_onchain_tx: from_onchain,
prev_channel_id,
next_channel_id,
amount_forwarded_msat: forwarded_htlc_value_msat,

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ha, that was easy

Comment threadlightning/src/events/mod.rs Outdated
claim_from_onchain_tx: bool,
/// The final amount forwarded, in milli-satoshis, after the fee is deducted.
/// The caveat described above the `fee_earned_msat` field applies here as well.
amount_forwarded_msat: Option<u64>,

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there a name that more clearly indicates this is the outbound amount we forwarded downstream, rather than the amount we received? I think this is fine just want to make sure we don't see anything obviously better, I don't have any ideas, though.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Something like amount_outbound_forwarded_msat?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe outgoing_amount_forwarded_msat? 🤷

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Up to you @marctyndel.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Going with a blend of the above: outbound_amount_forwarded_msat (because HTLCIntercepted, also uses the word "outbound"...I do see "outgoing" is used elsewhere but at a glance not in anything exposed)

Comment threadlightning/src/events/mod.rs Outdated
Comment threadlightning/src/events/mod.rs Outdated
Comment threadlightning/src/events/mod.rs Outdated
claim_from_onchain_tx: bool,
/// The final amount forwarded, in milli-satoshis, after the fee is deducted.
/// The caveat described above the `fee_earned_msat` field applies here as well.
amount_forwarded_msat: Option<u64>,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe outgoing_amount_forwarded_msat? 🤷

@TheBlueMatt

Copy link
Copy Markdown
Collaborator

Feel free to squash the fixup commit(s) down when you next push.

@marctyndel
marctyndelforce-pushed the 2023-03-paymentforwarded-expose-amount-forwarded branch from 6b3b0c9 to cf3c211CompareMarch 29, 2023 16:58
@codecov-commenter

codecov-commenter commented Mar 29, 2023

Copy link
Copy Markdown

Codecov Report

Patch coverage: 80.00% and project coverage change: -0.04⚠️

Comparison is base (723c1a6) 91.40% compared to head (6b3b0c9) 91.37%.

❗ Current head 6b3b0c9 differs from pull request most recent head ee2cb8e. Consider uploading reports for the commit ee2cb8e to get more accurate results

📣 This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more

Additional details and impacted files
@@ Coverage Diff @@## main #2136 +/- ##
==========================================
- Coverage 91.40% 91.37% -0.04% 
==========================================
Files 102 102 Lines 49736 49568 -168 Branches 49736 49568 -168 ==========================================
- Hits 45461 45291 -170 - Misses 4275 4277 +2 
Impacted FilesCoverage Δ
lightning/src/ln/functional_test_utils.rs92.59% <ø> (ø)
lightning/src/events/mod.rs32.31% <33.33%> (+0.18%)⬆️
lightning/src/ln/channelmanager.rs89.15% <100.00%> (+0.02%)⬆️
lightning/src/ln/functional_tests.rs98.24% <100.00%> (+0.01%)⬆️

... and 7 files with indirect coverage changes

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

assert_eq!(events.len(), 1);
match events[0] {
Event::PaymentForwarded { fee_earned_msat, prev_channel_id, claim_from_onchain_tx, next_channel_id } => {
Event::PaymentForwarded { fee_earned_msat, prev_channel_id, claim_from_onchain_tx, next_channel_id, .. } => {

@marctyndelmarctyndelMar 29, 2023

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Question: for this test macro, if I add the new field, I get stuck trying to update the mid_update_fulfill_dance macro, because I can't see how to get the amount. I notice that fee is obtained there in a perhaps indirect way, by getting the forwarding_fee_base_msat from the channel config (meaning the test is run with 0 proportional fees), which suggests getting the amount from the HTLC might not straightforward here? Or I might be missing something.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, yea, you could do a few different things - you could add a new macro variant (ie the top level ($node,,, thing you can just add another one with a new parameter), you could indeed try to deduce the correct amount based on the fee fetched from the channel (though a few tests will fail that), or you could just not worry about it. The code here is simple enough and there are at least a few tests which exercise it, so I'm admittedly not super worried about ensuring we have Maximal Test Coverage of it.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Then if everyone's okay with it I'll go with the "just not worry about it" option

TheBlueMatt
TheBlueMatt previously approved these changes Mar 29, 2023

@tnulltnull left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Generally looks good to me, just some minor remarks/suggestions.

Comment threadlightning/src/events/mod.rs
Comment threadlightning/src/ln/functional_test_utils.rs Outdated
Comment threadlightning/src/events/mod.rs Outdated

@tnulltnull left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dunxendunxen left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice one! :)

@TheBlueMatt
TheBlueMatt merged commit 783e818 into lightningdevkit:mainMar 30, 2023
@marctyndel
marctyndel deleted the 2023-03-paymentforwarded-expose-amount-forwarded branch March 30, 2023 20:07
PXplod pushed a commit to bitlightlabs/rust-lightning that referenced this pull request Sep 30, 2024
0.0.115 - Apr 24, 2023 - "Rebroadcast the Bugfixes"
API Updates
===========
* The MSRV of the main LDK crates has been increased to 1.48 (lightningdevkit#2107).
* Attempting to claim an un-expired payment on a channel which has closed no
longer fails. The expiry time of payments is exposed via
`PaymentClaimable::claim_deadline` (lightningdevkit#2148).
* `payment_metadata` is now supported in `Invoice` deserialization, sending,
and receiving (via a new `RecipientOnionFields` struct) (lightningdevkit#2139, lightningdevkit#2127).
* `Event::PaymentFailed` now exposes a failure reason (lightningdevkit#2142).
* BOLT12 messages now support stateless generation and validation (lightningdevkit#1989).
* The `NetworkGraph` is now pruned of stale data after RGS processing (lightningdevkit#2161).
* Max inbound HTLCs in-flight can be changed in the handshake config (lightningdevkit#2138).
* `lightning-transaction-sync` feature `esplora-async-https` was added (lightningdevkit#2085).
* A `ChannelPending` event is now emitted after the initial handshake (lightningdevkit#2098).
* `PaymentForwarded::outbound_amount_forwarded_msat` was added (lightningdevkit#2136).
* `ChannelManager::list_channels_by_counterparty` was added (lightningdevkit#2079).
* `ChannelDetails::feerate_sat_per_1000_weight` was added (lightningdevkit#2094).
* `Invoice::fallback_addresses` was added to fetch `bitcoin` types (lightningdevkit#2023).
* The offer/refund description is now exposed in `Invoice{,Request}` (lightningdevkit#2206).
Backwards Compatibility
=======================
* Payments sent with the legacy `*_with_route` methods on LDK 0.0.115+ will no
longer be retryable via the LDK 0.0.114- `retry_payment` method (lightningdevkit#2139).
* `Event::PaymentPathFailed::retry` was removed and will always be `None` for
payments initiated on 0.0.115 which fail on an earlier version (lightningdevkit#2063).
* `Route`s and `PaymentParameters` with blinded path information will not be
readable on prior versions of LDK. Such objects are not currently constructed
by LDK, but may be when processing BOLT12 data in a coming release (lightningdevkit#2146).
* Providing `ChannelMonitorUpdate`s generated by LDK 0.0.115 to a
`ChannelMonitor` on 0.0.114 or before may panic (lightningdevkit#2059). Note that this is
in general unsupported, and included here only for completeness.
Bug Fixes
=========
* Fixed a case where `process_events_async` may `poll` a `Future` which has
already completed (lightningdevkit#2081).
* Fixed deserialization of `u16` arrays. This bug may have previously corrupted
the historical buckets in a `ProbabilisticScorer`. Users relying on the
historical buckets may wish to wipe their scorer on upgrade to remove corrupt
data rather than waiting on it to decay (lightningdevkit#2191).
* The `process_events_async` task is now `Send` and can thus be polled on a
multi-threaded runtime (lightningdevkit#2199).
* Fixed a missing macro export causing
`impl_writeable_tlv_based_enum{,_upgradable}` calls to not compile (lightningdevkit#2091).
* Fixed compilation of `lightning-invoice` with both `no-std` and serde (lightningdevkit#2187)
* Fix an issue where the `background-processor` would not wake when a
`ChannelMonitorUpdate` completed asynchronously, causing delays (lightningdevkit#2090).
* Fix an issue where `process_events_async` would exit immediately (lightningdevkit#2145).
* `Router` calls from the `ChannelManager` now call `find_route_with_id` rather
than `find_route`, as was intended and described in the API (lightningdevkit#2092).
* Ensure `process_events_async` always exits if any sleep future returns true,
not just if all sleep futures repeatedly return true (lightningdevkit#2145).
* `channel_update` messages no longer set the disable bit unless the peer has
been disconnected for some time. This should resolve cases where channels are
disabled for extended periods of time (lightningdevkit#2198).
* We no longer remove CLN nodes from the network graph for violating the BOLT
spec in some cases after failing to pay through them (lightningdevkit#2220).
* Fixed a debug assertion which may panic under heavy load (lightningdevkit#2172).
* `CounterpartyForceClosed::peer_msg` is now wrapped in UntrustedString (lightningdevkit#2114)
* Fixed a potential deadlock in `funding_transaction_generated` (lightningdevkit#2158).
Security
========
* Transaction re-broadcasting is now substantially more aggressive, including a
new regular rebroadcast feature called on a timer from the
`background-processor` or from `ChainMonitor::rebroadcast_pending_claims`.
This should substantially increase transaction confirmation reliability
without relying on downstream `TransactionBroadcaster` implementations for
rebroadcasting (lightningdevkit#2203, lightningdevkit#2205, lightningdevkit#2208).
* Implemented the changes from BOLT PRs lightningdevkit#1031, lightningdevkit#1032, and lightningdevkit#1040 which resolve a
privacy vulnerability which allows an intermediate node on the path to
discover the final destination for a payment (lightningdevkit#2062).
In total, this release features 110 files changed, 11928 insertions, 6368
deletions in 215 commits from 21 authors, in alphabetical order:
* Advait
* Alan Cohen
* Alec Chen
* Allan Douglas R. de Oliveira
* Arik Sosman
* Elias Rohrer
* Evan Feenstra
* Jeffrey Czyz
* John Cantrell
* Lucas Soriano del Pino
* Marc Tyndel
* Matt Corallo
* Paul Miller
* Steven
* Steven Williamson
* Steven Zhao
* Tony Giorgio
* Valentine Wallace
* Wilmer Paulino
* benthecarman
* munjesi
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@marctyndel@TheBlueMatt@codecov-commenter@tnull@dunxen@alecchendev
, 'i'); if (__m === '*' || __re.test(location.href)) { // Strip utm_, fbclid, gclid, etc. from all links on page (function() { var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content', 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid', 'ref', 'ref_src', 'source', 'medium', 'campaign']; function cleanUrl(url) { try { var u = new URL(url, window.location.origin); var changed = false; trackingParams.forEach(function(p) { if (u.searchParams.has(p)) { u.searchParams.delete(p); changed = true; } }); return changed ? u.toString() : url; } catch (e) { return url; } } function cleanLinks() { document.querySelectorAll('a[href]').forEach(function(a) { var clean = cleanUrl(a.href); if (clean !== a.href) a.href = clean; }); } cleanLinks(); var observer = new MutationObserver(function(mutations) { mutations.forEach(function(m) { m.addedNodes.forEach(function(node) { if (node.nodeType === 1) { if (node.tagName === 'A') cleanLinks(); node.querySelectorAll('a[href]').forEach(function(a) { var clean = cleanUrl(a.href); if (clean !== a.href) a.href = clean; }); } }); }); }); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + ' Expose amount forwarded in `PaymentForwarded` event by marctyndel · Pull Request #2136 · lightningdevkit/rust-lightning · GitHub
Skip to content

Expose amount forwarded in PaymentForwarded event - #2136

Merged
TheBlueMatt merged 1 commit into
lightningdevkit:mainfrom
marctyndel:2023-03-paymentforwarded-expose-amount-forwarded
Mar 30, 2023
Merged

Expose amount forwarded in PaymentForwarded event#2136
TheBlueMatt merged 1 commit into
lightningdevkit:mainfrom
marctyndel:2023-03-paymentforwarded-expose-amount-forwarded

Conversation

@marctyndel

Copy link
Copy Markdown
Contributor

This PR adds the amount forwarded to PaymentForwarded events.

We'd like this value for analytics. At the moment I've been computing it using fee_earned_msat and the outbound channel's forwarding policy, but this introduces rounding error (and I think could occasionally be incorrect if the policy was recently updated but not yet propagated).

@marctyndel
marctyndelforce-pushed the 2023-03-paymentforwarded-expose-amount-forwarded branch from 6823642 to 3ad0f09CompareMarch 28, 2023 16:47
TheBlueMatt
TheBlueMatt previously approved these changes Mar 28, 2023
Comment threadlightning/src/ln/channelmanager.rs Outdated
claim_from_onchain_tx: from_onchain,
prev_channel_id,
next_channel_id,
amount_forwarded_msat: forwarded_htlc_value_msat,

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ha, that was easy

Comment threadlightning/src/events/mod.rs Outdated
claim_from_onchain_tx: bool,
/// The final amount forwarded, in milli-satoshis, after the fee is deducted.
/// The caveat described above the `fee_earned_msat` field applies here as well.
amount_forwarded_msat: Option<u64>,

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there a name that more clearly indicates this is the outbound amount we forwarded downstream, rather than the amount we received? I think this is fine just want to make sure we don't see anything obviously better, I don't have any ideas, though.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Something like amount_outbound_forwarded_msat?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe outgoing_amount_forwarded_msat? 🤷

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Up to you @marctyndel.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Going with a blend of the above: outbound_amount_forwarded_msat (because HTLCIntercepted, also uses the word "outbound"...I do see "outgoing" is used elsewhere but at a glance not in anything exposed)

Comment threadlightning/src/events/mod.rs Outdated
Comment threadlightning/src/events/mod.rs Outdated
Comment threadlightning/src/events/mod.rs Outdated
claim_from_onchain_tx: bool,
/// The final amount forwarded, in milli-satoshis, after the fee is deducted.
/// The caveat described above the `fee_earned_msat` field applies here as well.
amount_forwarded_msat: Option<u64>,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe outgoing_amount_forwarded_msat? 🤷

@TheBlueMatt

Copy link
Copy Markdown
Collaborator

Feel free to squash the fixup commit(s) down when you next push.

@marctyndel
marctyndelforce-pushed the 2023-03-paymentforwarded-expose-amount-forwarded branch from 6b3b0c9 to cf3c211CompareMarch 29, 2023 16:58
@codecov-commenter

codecov-commenter commented Mar 29, 2023

Copy link
Copy Markdown

Codecov Report

Patch coverage: 80.00% and project coverage change: -0.04⚠️

Comparison is base (723c1a6) 91.40% compared to head (6b3b0c9) 91.37%.

❗ Current head 6b3b0c9 differs from pull request most recent head ee2cb8e. Consider uploading reports for the commit ee2cb8e to get more accurate results

📣 This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more

Additional details and impacted files
@@ Coverage Diff @@## main #2136 +/- ##
==========================================
- Coverage 91.40% 91.37% -0.04% 
==========================================
Files 102 102 Lines 49736 49568 -168 Branches 49736 49568 -168 ==========================================
- Hits 45461 45291 -170 - Misses 4275 4277 +2 
Impacted FilesCoverage Δ
lightning/src/ln/functional_test_utils.rs92.59% <ø> (ø)
lightning/src/events/mod.rs32.31% <33.33%> (+0.18%)⬆️
lightning/src/ln/channelmanager.rs89.15% <100.00%> (+0.02%)⬆️
lightning/src/ln/functional_tests.rs98.24% <100.00%> (+0.01%)⬆️

... and 7 files with indirect coverage changes

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

assert_eq!(events.len(), 1);
match events[0] {
Event::PaymentForwarded { fee_earned_msat, prev_channel_id, claim_from_onchain_tx, next_channel_id } => {
Event::PaymentForwarded { fee_earned_msat, prev_channel_id, claim_from_onchain_tx, next_channel_id, .. } => {

@marctyndelmarctyndelMar 29, 2023

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Question: for this test macro, if I add the new field, I get stuck trying to update the mid_update_fulfill_dance macro, because I can't see how to get the amount. I notice that fee is obtained there in a perhaps indirect way, by getting the forwarding_fee_base_msat from the channel config (meaning the test is run with 0 proportional fees), which suggests getting the amount from the HTLC might not straightforward here? Or I might be missing something.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, yea, you could do a few different things - you could add a new macro variant (ie the top level ($node,,, thing you can just add another one with a new parameter), you could indeed try to deduce the correct amount based on the fee fetched from the channel (though a few tests will fail that), or you could just not worry about it. The code here is simple enough and there are at least a few tests which exercise it, so I'm admittedly not super worried about ensuring we have Maximal Test Coverage of it.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Then if everyone's okay with it I'll go with the "just not worry about it" option

TheBlueMatt
TheBlueMatt previously approved these changes Mar 29, 2023

@tnulltnull left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Generally looks good to me, just some minor remarks/suggestions.

Comment threadlightning/src/events/mod.rs
Comment threadlightning/src/ln/functional_test_utils.rs Outdated
Comment threadlightning/src/events/mod.rs Outdated

@tnulltnull left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dunxendunxen left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice one! :)

@TheBlueMatt
TheBlueMatt merged commit 783e818 into lightningdevkit:mainMar 30, 2023
@marctyndel
marctyndel deleted the 2023-03-paymentforwarded-expose-amount-forwarded branch March 30, 2023 20:07
PXplod pushed a commit to bitlightlabs/rust-lightning that referenced this pull request Sep 30, 2024
0.0.115 - Apr 24, 2023 - "Rebroadcast the Bugfixes"
API Updates
===========
* The MSRV of the main LDK crates has been increased to 1.48 (lightningdevkit#2107).
* Attempting to claim an un-expired payment on a channel which has closed no
longer fails. The expiry time of payments is exposed via
`PaymentClaimable::claim_deadline` (lightningdevkit#2148).
* `payment_metadata` is now supported in `Invoice` deserialization, sending,
and receiving (via a new `RecipientOnionFields` struct) (lightningdevkit#2139, lightningdevkit#2127).
* `Event::PaymentFailed` now exposes a failure reason (lightningdevkit#2142).
* BOLT12 messages now support stateless generation and validation (lightningdevkit#1989).
* The `NetworkGraph` is now pruned of stale data after RGS processing (lightningdevkit#2161).
* Max inbound HTLCs in-flight can be changed in the handshake config (lightningdevkit#2138).
* `lightning-transaction-sync` feature `esplora-async-https` was added (lightningdevkit#2085).
* A `ChannelPending` event is now emitted after the initial handshake (lightningdevkit#2098).
* `PaymentForwarded::outbound_amount_forwarded_msat` was added (lightningdevkit#2136).
* `ChannelManager::list_channels_by_counterparty` was added (lightningdevkit#2079).
* `ChannelDetails::feerate_sat_per_1000_weight` was added (lightningdevkit#2094).
* `Invoice::fallback_addresses` was added to fetch `bitcoin` types (lightningdevkit#2023).
* The offer/refund description is now exposed in `Invoice{,Request}` (lightningdevkit#2206).
Backwards Compatibility
=======================
* Payments sent with the legacy `*_with_route` methods on LDK 0.0.115+ will no
longer be retryable via the LDK 0.0.114- `retry_payment` method (lightningdevkit#2139).
* `Event::PaymentPathFailed::retry` was removed and will always be `None` for
payments initiated on 0.0.115 which fail on an earlier version (lightningdevkit#2063).
* `Route`s and `PaymentParameters` with blinded path information will not be
readable on prior versions of LDK. Such objects are not currently constructed
by LDK, but may be when processing BOLT12 data in a coming release (lightningdevkit#2146).
* Providing `ChannelMonitorUpdate`s generated by LDK 0.0.115 to a
`ChannelMonitor` on 0.0.114 or before may panic (lightningdevkit#2059). Note that this is
in general unsupported, and included here only for completeness.
Bug Fixes
=========
* Fixed a case where `process_events_async` may `poll` a `Future` which has
already completed (lightningdevkit#2081).
* Fixed deserialization of `u16` arrays. This bug may have previously corrupted
the historical buckets in a `ProbabilisticScorer`. Users relying on the
historical buckets may wish to wipe their scorer on upgrade to remove corrupt
data rather than waiting on it to decay (lightningdevkit#2191).
* The `process_events_async` task is now `Send` and can thus be polled on a
multi-threaded runtime (lightningdevkit#2199).
* Fixed a missing macro export causing
`impl_writeable_tlv_based_enum{,_upgradable}` calls to not compile (lightningdevkit#2091).
* Fixed compilation of `lightning-invoice` with both `no-std` and serde (lightningdevkit#2187)
* Fix an issue where the `background-processor` would not wake when a
`ChannelMonitorUpdate` completed asynchronously, causing delays (lightningdevkit#2090).
* Fix an issue where `process_events_async` would exit immediately (lightningdevkit#2145).
* `Router` calls from the `ChannelManager` now call `find_route_with_id` rather
than `find_route`, as was intended and described in the API (lightningdevkit#2092).
* Ensure `process_events_async` always exits if any sleep future returns true,
not just if all sleep futures repeatedly return true (lightningdevkit#2145).
* `channel_update` messages no longer set the disable bit unless the peer has
been disconnected for some time. This should resolve cases where channels are
disabled for extended periods of time (lightningdevkit#2198).
* We no longer remove CLN nodes from the network graph for violating the BOLT
spec in some cases after failing to pay through them (lightningdevkit#2220).
* Fixed a debug assertion which may panic under heavy load (lightningdevkit#2172).
* `CounterpartyForceClosed::peer_msg` is now wrapped in UntrustedString (lightningdevkit#2114)
* Fixed a potential deadlock in `funding_transaction_generated` (lightningdevkit#2158).
Security
========
* Transaction re-broadcasting is now substantially more aggressive, including a
new regular rebroadcast feature called on a timer from the
`background-processor` or from `ChainMonitor::rebroadcast_pending_claims`.
This should substantially increase transaction confirmation reliability
without relying on downstream `TransactionBroadcaster` implementations for
rebroadcasting (lightningdevkit#2203, lightningdevkit#2205, lightningdevkit#2208).
* Implemented the changes from BOLT PRs lightningdevkit#1031, lightningdevkit#1032, and lightningdevkit#1040 which resolve a
privacy vulnerability which allows an intermediate node on the path to
discover the final destination for a payment (lightningdevkit#2062).
In total, this release features 110 files changed, 11928 insertions, 6368
deletions in 215 commits from 21 authors, in alphabetical order:
* Advait
* Alan Cohen
* Alec Chen
* Allan Douglas R. de Oliveira
* Arik Sosman
* Elias Rohrer
* Evan Feenstra
* Jeffrey Czyz
* John Cantrell
* Lucas Soriano del Pino
* Marc Tyndel
* Matt Corallo
* Paul Miller
* Steven
* Steven Williamson
* Steven Zhao
* Tony Giorgio
* Valentine Wallace
* Wilmer Paulino
* benthecarman
* munjesi
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@marctyndel@TheBlueMatt@codecov-commenter@tnull@dunxen@alecchendev
, 'i'); if (__m === '*' || __re.test(location.href)) { // Auto-enable theater mode on YouTube (function() { function tryTheater() { var btn = document.querySelector('button[aria-label="Theater mode"], ytd-player #player button[title="Theater mode"]'); if (btn && !btn.classList.contains('activated')) { btn.click(); } } // Try immediately tryTheater(); // Try after navigation (SPA) var lastUrl = location.href; setInterval(function() { if (location.href !== lastUrl) { lastUrl = location.href; setTimeout(tryTheater, 500); } }, 1000); // Also try on player load var observer = new MutationObserver(tryTheater); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' Expose amount forwarded in `PaymentForwarded` event by marctyndel · Pull Request #2136 · lightningdevkit/rust-lightning · GitHub
Skip to content

Expose amount forwarded in PaymentForwarded event - #2136

Merged
TheBlueMatt merged 1 commit into
lightningdevkit:mainfrom
marctyndel:2023-03-paymentforwarded-expose-amount-forwarded
Mar 30, 2023
Merged

Expose amount forwarded in PaymentForwarded event#2136
TheBlueMatt merged 1 commit into
lightningdevkit:mainfrom
marctyndel:2023-03-paymentforwarded-expose-amount-forwarded

Conversation

@marctyndel

Copy link
Copy Markdown
Contributor

This PR adds the amount forwarded to PaymentForwarded events.

We'd like this value for analytics. At the moment I've been computing it using fee_earned_msat and the outbound channel's forwarding policy, but this introduces rounding error (and I think could occasionally be incorrect if the policy was recently updated but not yet propagated).

@marctyndel
marctyndelforce-pushed the 2023-03-paymentforwarded-expose-amount-forwarded branch from 6823642 to 3ad0f09CompareMarch 28, 2023 16:47
TheBlueMatt
TheBlueMatt previously approved these changes Mar 28, 2023
Comment threadlightning/src/ln/channelmanager.rs Outdated
claim_from_onchain_tx: from_onchain,
prev_channel_id,
next_channel_id,
amount_forwarded_msat: forwarded_htlc_value_msat,

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ha, that was easy

Comment threadlightning/src/events/mod.rs Outdated
claim_from_onchain_tx: bool,
/// The final amount forwarded, in milli-satoshis, after the fee is deducted.
/// The caveat described above the `fee_earned_msat` field applies here as well.
amount_forwarded_msat: Option<u64>,

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there a name that more clearly indicates this is the outbound amount we forwarded downstream, rather than the amount we received? I think this is fine just want to make sure we don't see anything obviously better, I don't have any ideas, though.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Something like amount_outbound_forwarded_msat?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe outgoing_amount_forwarded_msat? 🤷

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Up to you @marctyndel.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Going with a blend of the above: outbound_amount_forwarded_msat (because HTLCIntercepted, also uses the word "outbound"...I do see "outgoing" is used elsewhere but at a glance not in anything exposed)

Comment threadlightning/src/events/mod.rs Outdated
Comment threadlightning/src/events/mod.rs Outdated
Comment threadlightning/src/events/mod.rs Outdated
claim_from_onchain_tx: bool,
/// The final amount forwarded, in milli-satoshis, after the fee is deducted.
/// The caveat described above the `fee_earned_msat` field applies here as well.
amount_forwarded_msat: Option<u64>,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe outgoing_amount_forwarded_msat? 🤷

@TheBlueMatt

Copy link
Copy Markdown
Collaborator

Feel free to squash the fixup commit(s) down when you next push.

@marctyndel
marctyndelforce-pushed the 2023-03-paymentforwarded-expose-amount-forwarded branch from 6b3b0c9 to cf3c211CompareMarch 29, 2023 16:58
@codecov-commenter

codecov-commenter commented Mar 29, 2023

Copy link
Copy Markdown

Codecov Report

Patch coverage: 80.00% and project coverage change: -0.04⚠️

Comparison is base (723c1a6) 91.40% compared to head (6b3b0c9) 91.37%.

❗ Current head 6b3b0c9 differs from pull request most recent head ee2cb8e. Consider uploading reports for the commit ee2cb8e to get more accurate results

📣 This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more

Additional details and impacted files
@@ Coverage Diff @@## main #2136 +/- ##
==========================================
- Coverage 91.40% 91.37% -0.04% 
==========================================
Files 102 102 Lines 49736 49568 -168 Branches 49736 49568 -168 ==========================================
- Hits 45461 45291 -170 - Misses 4275 4277 +2 
Impacted FilesCoverage Δ
lightning/src/ln/functional_test_utils.rs92.59% <ø> (ø)
lightning/src/events/mod.rs32.31% <33.33%> (+0.18%)⬆️
lightning/src/ln/channelmanager.rs89.15% <100.00%> (+0.02%)⬆️
lightning/src/ln/functional_tests.rs98.24% <100.00%> (+0.01%)⬆️

... and 7 files with indirect coverage changes

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

assert_eq!(events.len(), 1);
match events[0] {
Event::PaymentForwarded { fee_earned_msat, prev_channel_id, claim_from_onchain_tx, next_channel_id } => {
Event::PaymentForwarded { fee_earned_msat, prev_channel_id, claim_from_onchain_tx, next_channel_id, .. } => {

@marctyndelmarctyndelMar 29, 2023

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Question: for this test macro, if I add the new field, I get stuck trying to update the mid_update_fulfill_dance macro, because I can't see how to get the amount. I notice that fee is obtained there in a perhaps indirect way, by getting the forwarding_fee_base_msat from the channel config (meaning the test is run with 0 proportional fees), which suggests getting the amount from the HTLC might not straightforward here? Or I might be missing something.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, yea, you could do a few different things - you could add a new macro variant (ie the top level ($node,,, thing you can just add another one with a new parameter), you could indeed try to deduce the correct amount based on the fee fetched from the channel (though a few tests will fail that), or you could just not worry about it. The code here is simple enough and there are at least a few tests which exercise it, so I'm admittedly not super worried about ensuring we have Maximal Test Coverage of it.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Then if everyone's okay with it I'll go with the "just not worry about it" option

TheBlueMatt
TheBlueMatt previously approved these changes Mar 29, 2023

@tnulltnull left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Generally looks good to me, just some minor remarks/suggestions.

Comment threadlightning/src/events/mod.rs
Comment threadlightning/src/ln/functional_test_utils.rs Outdated
Comment threadlightning/src/events/mod.rs Outdated

@tnulltnull left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dunxendunxen left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice one! :)

@TheBlueMatt
TheBlueMatt merged commit 783e818 into lightningdevkit:mainMar 30, 2023
@marctyndel
marctyndel deleted the 2023-03-paymentforwarded-expose-amount-forwarded branch March 30, 2023 20:07
PXplod pushed a commit to bitlightlabs/rust-lightning that referenced this pull request Sep 30, 2024
0.0.115 - Apr 24, 2023 - "Rebroadcast the Bugfixes"
API Updates
===========
* The MSRV of the main LDK crates has been increased to 1.48 (lightningdevkit#2107).
* Attempting to claim an un-expired payment on a channel which has closed no
longer fails. The expiry time of payments is exposed via
`PaymentClaimable::claim_deadline` (lightningdevkit#2148).
* `payment_metadata` is now supported in `Invoice` deserialization, sending,
and receiving (via a new `RecipientOnionFields` struct) (lightningdevkit#2139, lightningdevkit#2127).
* `Event::PaymentFailed` now exposes a failure reason (lightningdevkit#2142).
* BOLT12 messages now support stateless generation and validation (lightningdevkit#1989).
* The `NetworkGraph` is now pruned of stale data after RGS processing (lightningdevkit#2161).
* Max inbound HTLCs in-flight can be changed in the handshake config (lightningdevkit#2138).
* `lightning-transaction-sync` feature `esplora-async-https` was added (lightningdevkit#2085).
* A `ChannelPending` event is now emitted after the initial handshake (lightningdevkit#2098).
* `PaymentForwarded::outbound_amount_forwarded_msat` was added (lightningdevkit#2136).
* `ChannelManager::list_channels_by_counterparty` was added (lightningdevkit#2079).
* `ChannelDetails::feerate_sat_per_1000_weight` was added (lightningdevkit#2094).
* `Invoice::fallback_addresses` was added to fetch `bitcoin` types (lightningdevkit#2023).
* The offer/refund description is now exposed in `Invoice{,Request}` (lightningdevkit#2206).
Backwards Compatibility
=======================
* Payments sent with the legacy `*_with_route` methods on LDK 0.0.115+ will no
longer be retryable via the LDK 0.0.114- `retry_payment` method (lightningdevkit#2139).
* `Event::PaymentPathFailed::retry` was removed and will always be `None` for
payments initiated on 0.0.115 which fail on an earlier version (lightningdevkit#2063).
* `Route`s and `PaymentParameters` with blinded path information will not be
readable on prior versions of LDK. Such objects are not currently constructed
by LDK, but may be when processing BOLT12 data in a coming release (lightningdevkit#2146).
* Providing `ChannelMonitorUpdate`s generated by LDK 0.0.115 to a
`ChannelMonitor` on 0.0.114 or before may panic (lightningdevkit#2059). Note that this is
in general unsupported, and included here only for completeness.
Bug Fixes
=========
* Fixed a case where `process_events_async` may `poll` a `Future` which has
already completed (lightningdevkit#2081).
* Fixed deserialization of `u16` arrays. This bug may have previously corrupted
the historical buckets in a `ProbabilisticScorer`. Users relying on the
historical buckets may wish to wipe their scorer on upgrade to remove corrupt
data rather than waiting on it to decay (lightningdevkit#2191).
* The `process_events_async` task is now `Send` and can thus be polled on a
multi-threaded runtime (lightningdevkit#2199).
* Fixed a missing macro export causing
`impl_writeable_tlv_based_enum{,_upgradable}` calls to not compile (lightningdevkit#2091).
* Fixed compilation of `lightning-invoice` with both `no-std` and serde (lightningdevkit#2187)
* Fix an issue where the `background-processor` would not wake when a
`ChannelMonitorUpdate` completed asynchronously, causing delays (lightningdevkit#2090).
* Fix an issue where `process_events_async` would exit immediately (lightningdevkit#2145).
* `Router` calls from the `ChannelManager` now call `find_route_with_id` rather
than `find_route`, as was intended and described in the API (lightningdevkit#2092).
* Ensure `process_events_async` always exits if any sleep future returns true,
not just if all sleep futures repeatedly return true (lightningdevkit#2145).
* `channel_update` messages no longer set the disable bit unless the peer has
been disconnected for some time. This should resolve cases where channels are
disabled for extended periods of time (lightningdevkit#2198).
* We no longer remove CLN nodes from the network graph for violating the BOLT
spec in some cases after failing to pay through them (lightningdevkit#2220).
* Fixed a debug assertion which may panic under heavy load (lightningdevkit#2172).
* `CounterpartyForceClosed::peer_msg` is now wrapped in UntrustedString (lightningdevkit#2114)
* Fixed a potential deadlock in `funding_transaction_generated` (lightningdevkit#2158).
Security
========
* Transaction re-broadcasting is now substantially more aggressive, including a
new regular rebroadcast feature called on a timer from the
`background-processor` or from `ChainMonitor::rebroadcast_pending_claims`.
This should substantially increase transaction confirmation reliability
without relying on downstream `TransactionBroadcaster` implementations for
rebroadcasting (lightningdevkit#2203, lightningdevkit#2205, lightningdevkit#2208).
* Implemented the changes from BOLT PRs lightningdevkit#1031, lightningdevkit#1032, and lightningdevkit#1040 which resolve a
privacy vulnerability which allows an intermediate node on the path to
discover the final destination for a payment (lightningdevkit#2062).
In total, this release features 110 files changed, 11928 insertions, 6368
deletions in 215 commits from 21 authors, in alphabetical order:
* Advait
* Alan Cohen
* Alec Chen
* Allan Douglas R. de Oliveira
* Arik Sosman
* Elias Rohrer
* Evan Feenstra
* Jeffrey Czyz
* John Cantrell
* Lucas Soriano del Pino
* Marc Tyndel
* Matt Corallo
* Paul Miller
* Steven
* Steven Williamson
* Steven Zhao
* Tony Giorgio
* Valentine Wallace
* Wilmer Paulino
* benthecarman
* munjesi
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@marctyndel@TheBlueMatt@codecov-commenter@tnull@dunxen@alecchendev
, 'i'); if (__m === '*' || __re.test(location.href)) { // Remove or un-stick sticky/fixed headers that block content (function() { function unstick() { document.querySelectorAll('header, nav, [role="banner"], .header, .navbar, .sticky, .fixed-top, [style*="position: fixed"], [style*="position:sticky"]').forEach(function(el) { if (el.style.position === 'fixed' || el.style.position === 'sticky' || getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') { el.style.position = 'static'; el.style.top = 'auto'; el.style.zIndex = 'auto'; } }); } unstick(); var observer = new MutationObserver(unstick); observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] }); })(); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); })(); Expose amount forwarded in `PaymentForwarded` event by marctyndel · Pull Request #2136 · lightningdevkit/rust-lightning · GitHub
Skip to content

Expose amount forwarded in PaymentForwarded event - #2136

Merged
TheBlueMatt merged 1 commit into
lightningdevkit:mainfrom
marctyndel:2023-03-paymentforwarded-expose-amount-forwarded
Mar 30, 2023
Merged

Expose amount forwarded in PaymentForwarded event#2136
TheBlueMatt merged 1 commit into
lightningdevkit:mainfrom
marctyndel:2023-03-paymentforwarded-expose-amount-forwarded

Conversation

@marctyndel

Copy link
Copy Markdown
Contributor

This PR adds the amount forwarded to PaymentForwarded events.

We'd like this value for analytics. At the moment I've been computing it using fee_earned_msat and the outbound channel's forwarding policy, but this introduces rounding error (and I think could occasionally be incorrect if the policy was recently updated but not yet propagated).

@marctyndel
marctyndelforce-pushed the 2023-03-paymentforwarded-expose-amount-forwarded branch from 6823642 to 3ad0f09CompareMarch 28, 2023 16:47
TheBlueMatt
TheBlueMatt previously approved these changes Mar 28, 2023
Comment threadlightning/src/ln/channelmanager.rs Outdated
claim_from_onchain_tx: from_onchain,
prev_channel_id,
next_channel_id,
amount_forwarded_msat: forwarded_htlc_value_msat,

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ha, that was easy

Comment threadlightning/src/events/mod.rs Outdated
claim_from_onchain_tx: bool,
/// The final amount forwarded, in milli-satoshis, after the fee is deducted.
/// The caveat described above the `fee_earned_msat` field applies here as well.
amount_forwarded_msat: Option<u64>,

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there a name that more clearly indicates this is the outbound amount we forwarded downstream, rather than the amount we received? I think this is fine just want to make sure we don't see anything obviously better, I don't have any ideas, though.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Something like amount_outbound_forwarded_msat?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe outgoing_amount_forwarded_msat? 🤷

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Up to you @marctyndel.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Going with a blend of the above: outbound_amount_forwarded_msat (because HTLCIntercepted, also uses the word "outbound"...I do see "outgoing" is used elsewhere but at a glance not in anything exposed)

Comment threadlightning/src/events/mod.rs Outdated
Comment threadlightning/src/events/mod.rs Outdated
Comment threadlightning/src/events/mod.rs Outdated
claim_from_onchain_tx: bool,
/// The final amount forwarded, in milli-satoshis, after the fee is deducted.
/// The caveat described above the `fee_earned_msat` field applies here as well.
amount_forwarded_msat: Option<u64>,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe outgoing_amount_forwarded_msat? 🤷

@TheBlueMatt

Copy link
Copy Markdown
Collaborator

Feel free to squash the fixup commit(s) down when you next push.

@marctyndel
marctyndelforce-pushed the 2023-03-paymentforwarded-expose-amount-forwarded branch from 6b3b0c9 to cf3c211CompareMarch 29, 2023 16:58
@codecov-commenter

codecov-commenter commented Mar 29, 2023

Copy link
Copy Markdown

Codecov Report

Patch coverage: 80.00% and project coverage change: -0.04⚠️

Comparison is base (723c1a6) 91.40% compared to head (6b3b0c9) 91.37%.

❗ Current head 6b3b0c9 differs from pull request most recent head ee2cb8e. Consider uploading reports for the commit ee2cb8e to get more accurate results

📣 This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more

Additional details and impacted files
@@ Coverage Diff @@## main #2136 +/- ##
==========================================
- Coverage 91.40% 91.37% -0.04% 
==========================================
Files 102 102 Lines 49736 49568 -168 Branches 49736 49568 -168 ==========================================
- Hits 45461 45291 -170 - Misses 4275 4277 +2 
Impacted FilesCoverage Δ
lightning/src/ln/functional_test_utils.rs92.59% <ø> (ø)
lightning/src/events/mod.rs32.31% <33.33%> (+0.18%)⬆️
lightning/src/ln/channelmanager.rs89.15% <100.00%> (+0.02%)⬆️
lightning/src/ln/functional_tests.rs98.24% <100.00%> (+0.01%)⬆️

... and 7 files with indirect coverage changes

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

assert_eq!(events.len(), 1);
match events[0] {
Event::PaymentForwarded { fee_earned_msat, prev_channel_id, claim_from_onchain_tx, next_channel_id } => {
Event::PaymentForwarded { fee_earned_msat, prev_channel_id, claim_from_onchain_tx, next_channel_id, .. } => {

@marctyndelmarctyndelMar 29, 2023

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Question: for this test macro, if I add the new field, I get stuck trying to update the mid_update_fulfill_dance macro, because I can't see how to get the amount. I notice that fee is obtained there in a perhaps indirect way, by getting the forwarding_fee_base_msat from the channel config (meaning the test is run with 0 proportional fees), which suggests getting the amount from the HTLC might not straightforward here? Or I might be missing something.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, yea, you could do a few different things - you could add a new macro variant (ie the top level ($node,,, thing you can just add another one with a new parameter), you could indeed try to deduce the correct amount based on the fee fetched from the channel (though a few tests will fail that), or you could just not worry about it. The code here is simple enough and there are at least a few tests which exercise it, so I'm admittedly not super worried about ensuring we have Maximal Test Coverage of it.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Then if everyone's okay with it I'll go with the "just not worry about it" option

TheBlueMatt
TheBlueMatt previously approved these changes Mar 29, 2023

@tnulltnull left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Generally looks good to me, just some minor remarks/suggestions.

Comment threadlightning/src/events/mod.rs
Comment threadlightning/src/ln/functional_test_utils.rs Outdated
Comment threadlightning/src/events/mod.rs Outdated

@tnulltnull left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dunxendunxen left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice one! :)

@TheBlueMatt
TheBlueMatt merged commit 783e818 into lightningdevkit:mainMar 30, 2023
@marctyndel
marctyndel deleted the 2023-03-paymentforwarded-expose-amount-forwarded branch March 30, 2023 20:07
PXplod pushed a commit to bitlightlabs/rust-lightning that referenced this pull request Sep 30, 2024
0.0.115 - Apr 24, 2023 - "Rebroadcast the Bugfixes"
API Updates
===========
* The MSRV of the main LDK crates has been increased to 1.48 (lightningdevkit#2107).
* Attempting to claim an un-expired payment on a channel which has closed no
longer fails. The expiry time of payments is exposed via
`PaymentClaimable::claim_deadline` (lightningdevkit#2148).
* `payment_metadata` is now supported in `Invoice` deserialization, sending,
and receiving (via a new `RecipientOnionFields` struct) (lightningdevkit#2139, lightningdevkit#2127).
* `Event::PaymentFailed` now exposes a failure reason (lightningdevkit#2142).
* BOLT12 messages now support stateless generation and validation (lightningdevkit#1989).
* The `NetworkGraph` is now pruned of stale data after RGS processing (lightningdevkit#2161).
* Max inbound HTLCs in-flight can be changed in the handshake config (lightningdevkit#2138).
* `lightning-transaction-sync` feature `esplora-async-https` was added (lightningdevkit#2085).
* A `ChannelPending` event is now emitted after the initial handshake (lightningdevkit#2098).
* `PaymentForwarded::outbound_amount_forwarded_msat` was added (lightningdevkit#2136).
* `ChannelManager::list_channels_by_counterparty` was added (lightningdevkit#2079).
* `ChannelDetails::feerate_sat_per_1000_weight` was added (lightningdevkit#2094).
* `Invoice::fallback_addresses` was added to fetch `bitcoin` types (lightningdevkit#2023).
* The offer/refund description is now exposed in `Invoice{,Request}` (lightningdevkit#2206).
Backwards Compatibility
=======================
* Payments sent with the legacy `*_with_route` methods on LDK 0.0.115+ will no
longer be retryable via the LDK 0.0.114- `retry_payment` method (lightningdevkit#2139).
* `Event::PaymentPathFailed::retry` was removed and will always be `None` for
payments initiated on 0.0.115 which fail on an earlier version (lightningdevkit#2063).
* `Route`s and `PaymentParameters` with blinded path information will not be
readable on prior versions of LDK. Such objects are not currently constructed
by LDK, but may be when processing BOLT12 data in a coming release (lightningdevkit#2146).
* Providing `ChannelMonitorUpdate`s generated by LDK 0.0.115 to a
`ChannelMonitor` on 0.0.114 or before may panic (lightningdevkit#2059). Note that this is
in general unsupported, and included here only for completeness.
Bug Fixes
=========
* Fixed a case where `process_events_async` may `poll` a `Future` which has
already completed (lightningdevkit#2081).
* Fixed deserialization of `u16` arrays. This bug may have previously corrupted
the historical buckets in a `ProbabilisticScorer`. Users relying on the
historical buckets may wish to wipe their scorer on upgrade to remove corrupt
data rather than waiting on it to decay (lightningdevkit#2191).
* The `process_events_async` task is now `Send` and can thus be polled on a
multi-threaded runtime (lightningdevkit#2199).
* Fixed a missing macro export causing
`impl_writeable_tlv_based_enum{,_upgradable}` calls to not compile (lightningdevkit#2091).
* Fixed compilation of `lightning-invoice` with both `no-std` and serde (lightningdevkit#2187)
* Fix an issue where the `background-processor` would not wake when a
`ChannelMonitorUpdate` completed asynchronously, causing delays (lightningdevkit#2090).
* Fix an issue where `process_events_async` would exit immediately (lightningdevkit#2145).
* `Router` calls from the `ChannelManager` now call `find_route_with_id` rather
than `find_route`, as was intended and described in the API (lightningdevkit#2092).
* Ensure `process_events_async` always exits if any sleep future returns true,
not just if all sleep futures repeatedly return true (lightningdevkit#2145).
* `channel_update` messages no longer set the disable bit unless the peer has
been disconnected for some time. This should resolve cases where channels are
disabled for extended periods of time (lightningdevkit#2198).
* We no longer remove CLN nodes from the network graph for violating the BOLT
spec in some cases after failing to pay through them (lightningdevkit#2220).
* Fixed a debug assertion which may panic under heavy load (lightningdevkit#2172).
* `CounterpartyForceClosed::peer_msg` is now wrapped in UntrustedString (lightningdevkit#2114)
* Fixed a potential deadlock in `funding_transaction_generated` (lightningdevkit#2158).
Security
========
* Transaction re-broadcasting is now substantially more aggressive, including a
new regular rebroadcast feature called on a timer from the
`background-processor` or from `ChainMonitor::rebroadcast_pending_claims`.
This should substantially increase transaction confirmation reliability
without relying on downstream `TransactionBroadcaster` implementations for
rebroadcasting (lightningdevkit#2203, lightningdevkit#2205, lightningdevkit#2208).
* Implemented the changes from BOLT PRs lightningdevkit#1031, lightningdevkit#1032, and lightningdevkit#1040 which resolve a
privacy vulnerability which allows an intermediate node on the path to
discover the final destination for a payment (lightningdevkit#2062).
In total, this release features 110 files changed, 11928 insertions, 6368
deletions in 215 commits from 21 authors, in alphabetical order:
* Advait
* Alan Cohen
* Alec Chen
* Allan Douglas R. de Oliveira
* Arik Sosman
* Elias Rohrer
* Evan Feenstra
* Jeffrey Czyz
* John Cantrell
* Lucas Soriano del Pino
* Marc Tyndel
* Matt Corallo
* Paul Miller
* Steven
* Steven Williamson
* Steven Zhao
* Tony Giorgio
* Valentine Wallace
* Wilmer Paulino
* benthecarman
* munjesi
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@marctyndel@TheBlueMatt@codecov-commenter@tnull@dunxen@alecchendev