Refactor Chapter 7 exhibit construction - #1226

Open
salexanian wants to merge 7 commits into
casact:mainfrom
salexanian:friedland-ch7-refactor
Open

Refactor Chapter 7 exhibit construction#1226
salexanian wants to merge 7 commits into
casact:mainfrom
salexanian:friedland-ch7-refactor

Conversation

@salexanian

@salexaniansalexanian commented Aug 21, 2026

Copy link
Copy Markdown
Contributor

Summary of Changes

Follow-up to the merged Chapter 7 reconciliation work.

Refactors the Chapter 7 exhibit construction, including use of cl.model_diagnostics() to reduce pandas wrangling and simplify the exhibit-building logic.

The reconciliation assertions remain in place to verify the reproduced Friedland values.

Related GitHub Issue(s)

#1189

Additional Context for Reviewers

Have rewritten Ex3Sht1 to use cl.model_diagnostics.

Checklist

  • I passed tests locally for both code (uv run pytest) and documentation changes (uv run --directory docs jb build . --builder=custom --custom-builder=doctest)

Note

Low Risk
Documentation and doctest refactors in the Friedland chapter only; no production reserving or API behavior changes.

Overview
Refactors Chapter 7 Friedland exhibit construction (follow-up to reconciliation work for #1189), centering on Exhibit I, Sheet 3 (Ex3Sht1).

development_summary-style exhibit tables are rebuilt to pull Latest, CDF, and Ultimate (and related columns) via cl.model_diagnostics() instead of hand-rolled pandas indexing, transposes, and separate Chainladder().fit calls. Rounded exhibit paths that match the textbook’s three-decimal CDF workflow should stay aligned with the prior narrative.

Reconciliation assertions against the printed Friedland figures are kept so doctests still verify reproduced values after the simplification.

Reviewed by Cursor Bugbot for commit f84014d. Bugbot is set up for automated code reviews on this repo. Configure here.

" )\n",
" )\n",
"\n",
" return (results_upper, results_lower)"

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Backup function left in notebook

Medium Severity

ex3sht1_BAK looks like a leftover backup of the pre-refactor Sheet 1 builder. It is never called; only ex3sht1 is used. Keeping both versions clutters the notebook and makes it unclear which implementation is canonical after the model_diagnostics rewrite.

Fix in CursorFix in Web

Reviewed by Cursor Bugbot for commit fc5f4f6. Configure here.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am leaving this in for now as the reviewers have not determined what version of the function should be kept at this point.

" tri: cl.Triangle,\n",
" dev_input: dict,\n",
" tail_input: dict\n",
") -> tuple:\n",

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unused tail input parameter

Low Severity

ex3sht1 still accepts tail_input, and the caller still builds and passes it, but the new body never uses that argument. The old path applied TailConstant; the refactor dropped that without cleaning the parameter or call site, leaving dead API surface.

Additional Locations (1)
Fix in CursorFix in Web

Reviewed by Cursor Bugbot for commit fc5f4f6. Configure here.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will remove this once bigger issues have been resolved.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@henrydingliu, I used cl.model_diagnostics to create a new version of ex3sht1 that displays the tables correctly and passes the asserts, but the function is actually longer than the one I had produced originally. Could you please review to ensure I implemented it the way you expected?

The issue with using cl.model_diagnostics is that it essentially requires me to take the multi-index table returned by it, convert it to a single-index table, and then reconvert it to multiindex again - this ends up taking a reasonable amount of code to do. It may be that Exhibit 3 Sheet 1 is not an ideal exhibit to use with cl.model_diagnostics, and other exhibits will work more seamlessly with it. I also don't rule out the possibility that I implemented this incorrectly.

I just found the original approach of merging individual pandas series in a dictionary to be cleaner, but I guess it is a subjective thing.

@priyam0k , I bring this to your attention as well for input.

@henrydingliu

Copy link
Copy Markdown
Member

@salexanian can you please rename this alternative solution as part_2a to circumvent the conflict? then we can run the test and look at the RTD render.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

No problem, @henrydingliu . I will do so. I'll be back home in a couple of hours

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@salexanian can you please rename this alternative solution as part_2a to circumvent the conflict? then we can run the test and look at the RTD render.

@henrydingliu - done.

@github-actions

github-actionsBot commented Aug 22, 2026

Copy link
Copy Markdown

Pyright Type Completeness

View the full pyright --verifytypes output for this commit

Project (full chainladder package, at this PR's head): 14.9% of exported symbols fully typed (202 / 1356)

KnownAmbiguousUnknownTotal
Project (head)20211110431356

Other symbols referenced but not exported by chainladder: 13

KnownAmbiguousUnknownTotal
Other (head)31913

Symbols without documentation:

  • Functions without docstring: 324
  • Functions without default param: 0
  • Classes without docstring: 10

Patch (exported symbols added or changed by this PR): no exported symbol type-completeness changes detected.

@codecov

codecovBot commented Aug 22, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 91.32%. Comparing base (fee267d) to head (f84014d).

Additional details and impacted files
@@ Coverage Diff @@## main #1226 +/- ##
=======================================
Coverage 91.32% 91.32% =======================================
Files 92 92 Lines 5438 5438 Branches 700 700 =======================================
Hits 4966 4966 Misses 336 336 Partials 136 136 
FlagCoverage Δ
unittests91.32% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@henrydingliu

Copy link
Copy Markdown
Member

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

No problem, @henrydingliu - I will adapt my existing function to obtain the values from that cl.model_diagnostic and provide you with an updated version.

It was actually good to create the function above as it gave me valuable practice with Chainladder so it was time well-spent anyway from my perspective.

@cursorcursorBot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 2 potential issues.

There are 4 total unresolved issues (including 2 from previous reviews).

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Want reviews to match your repository better? Bugbot Learning can learn team-specific rules from PR activity. A team admin can enable Learning in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit 741f4cc. Configure here.

Comment threaddocs/friedland/chapter_7_part_2a.ipynb Outdated
@salexanian
salexanian marked this pull request as ready for review August 26, 2026 13:45
@salexanian

Copy link
Copy Markdown
ContributorAuthor

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

I have refactored the functions to use model_diagnostic, @henrydingliu .

@henrydingliu

Copy link
Copy Markdown
Member

@salexanian I'm not seeing any usage of model_diagnostics in this latest version

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@salexanian I'm not seeing any usage of model_diagnostics in this latest version

@henrydingliu it is used in Ex3Sht1(), Ex3Sht10(), Ex4Sht1() and Ex4Sht6() (the other sheets were developed with your dev_exihibit function which already uses cl.model_diagnostic). My use of model_diagnostic is consistent throughout the functions - I generate diag_df (the model_diagnostics dataframe), and then obtain the columns of the tables from that dataframe. In 3 of the functions I stored the scenarios from cl.model_diagnostic separately in a dictionary and obtained the info needed for the columns from there.

@henrydingliu

Copy link
Copy Markdown
Member

this is what I see when i click into the RTD link

image

@salexanian

Copy link
Copy Markdown
ContributorAuthor

this is what I see when i click into the RTD link

image

I believe that is the function in the original notebook chapter_7_part_2.ipynb, but I put my work into the notebook chapter_7_part_2a.ipynb - I believe you asked me to store my changes in a separate notebook. The amended functions should be in that notebook.

@henrydingliu

Copy link
Copy Markdown
Member

ah, you are right. i completely forgot. my bad.

@henrydingliu

Copy link
Copy Markdown
Member

a few comments:

  • the helper functions format_col etc. are no longer necessary.
  • ibnr is already available in model_diagnostics
  • there are still places where the ultimate is being derived via col_mult, rather than using a chainladder implementation
  • ex3sht1 is handling too many scenarios at the same time. you can massively simplify if you let it just handle a single scenario for each call
  • ex3sht10, etc. should take tri.loc["Steady State"], rather than ("Steady State", tri). the string "Steady State" is also available via tri.loc["Steady State"].index

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@salexanian@henrydingliu
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all
 blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
Skip to content

Refactor Chapter 7 exhibit construction - #1226

Open
salexanian wants to merge 7 commits into
casact:mainfrom
salexanian:friedland-ch7-refactor
Open

Refactor Chapter 7 exhibit construction#1226
salexanian wants to merge 7 commits into
casact:mainfrom
salexanian:friedland-ch7-refactor

Conversation

@salexanian

@salexaniansalexanian commented Aug 21, 2026

Copy link
Copy Markdown
Contributor

Summary of Changes

Follow-up to the merged Chapter 7 reconciliation work.

Refactors the Chapter 7 exhibit construction, including use of cl.model_diagnostics() to reduce pandas wrangling and simplify the exhibit-building logic.

The reconciliation assertions remain in place to verify the reproduced Friedland values.

Related GitHub Issue(s)

#1189

Additional Context for Reviewers

Have rewritten Ex3Sht1 to use cl.model_diagnostics.

Checklist

  • I passed tests locally for both code (uv run pytest) and documentation changes (uv run --directory docs jb build . --builder=custom --custom-builder=doctest)

Note

Low Risk
Documentation and doctest refactors in the Friedland chapter only; no production reserving or API behavior changes.

Overview
Refactors Chapter 7 Friedland exhibit construction (follow-up to reconciliation work for #1189), centering on Exhibit I, Sheet 3 (Ex3Sht1).

development_summary-style exhibit tables are rebuilt to pull Latest, CDF, and Ultimate (and related columns) via cl.model_diagnostics() instead of hand-rolled pandas indexing, transposes, and separate Chainladder().fit calls. Rounded exhibit paths that match the textbook’s three-decimal CDF workflow should stay aligned with the prior narrative.

Reconciliation assertions against the printed Friedland figures are kept so doctests still verify reproduced values after the simplification.

Reviewed by Cursor Bugbot for commit f84014d. Bugbot is set up for automated code reviews on this repo. Configure here.

" )\n",
" )\n",
"\n",
" return (results_upper, results_lower)"

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Backup function left in notebook

Medium Severity

ex3sht1_BAK looks like a leftover backup of the pre-refactor Sheet 1 builder. It is never called; only ex3sht1 is used. Keeping both versions clutters the notebook and makes it unclear which implementation is canonical after the model_diagnostics rewrite.

Fix in CursorFix in Web

Reviewed by Cursor Bugbot for commit fc5f4f6. Configure here.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am leaving this in for now as the reviewers have not determined what version of the function should be kept at this point.

" tri: cl.Triangle,\n",
" dev_input: dict,\n",
" tail_input: dict\n",
") -> tuple:\n",

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unused tail input parameter

Low Severity

ex3sht1 still accepts tail_input, and the caller still builds and passes it, but the new body never uses that argument. The old path applied TailConstant; the refactor dropped that without cleaning the parameter or call site, leaving dead API surface.

Additional Locations (1)
Fix in CursorFix in Web

Reviewed by Cursor Bugbot for commit fc5f4f6. Configure here.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will remove this once bigger issues have been resolved.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@henrydingliu, I used cl.model_diagnostics to create a new version of ex3sht1 that displays the tables correctly and passes the asserts, but the function is actually longer than the one I had produced originally. Could you please review to ensure I implemented it the way you expected?

The issue with using cl.model_diagnostics is that it essentially requires me to take the multi-index table returned by it, convert it to a single-index table, and then reconvert it to multiindex again - this ends up taking a reasonable amount of code to do. It may be that Exhibit 3 Sheet 1 is not an ideal exhibit to use with cl.model_diagnostics, and other exhibits will work more seamlessly with it. I also don't rule out the possibility that I implemented this incorrectly.

I just found the original approach of merging individual pandas series in a dictionary to be cleaner, but I guess it is a subjective thing.

@priyam0k , I bring this to your attention as well for input.

@henrydingliu

Copy link
Copy Markdown
Member

@salexanian can you please rename this alternative solution as part_2a to circumvent the conflict? then we can run the test and look at the RTD render.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

No problem, @henrydingliu . I will do so. I'll be back home in a couple of hours

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@salexanian can you please rename this alternative solution as part_2a to circumvent the conflict? then we can run the test and look at the RTD render.

@henrydingliu - done.

@github-actions

github-actionsBot commented Aug 22, 2026

Copy link
Copy Markdown

Pyright Type Completeness

View the full pyright --verifytypes output for this commit

Project (full chainladder package, at this PR's head): 14.9% of exported symbols fully typed (202 / 1356)

KnownAmbiguousUnknownTotal
Project (head)20211110431356

Other symbols referenced but not exported by chainladder: 13

KnownAmbiguousUnknownTotal
Other (head)31913

Symbols without documentation:

  • Functions without docstring: 324
  • Functions without default param: 0
  • Classes without docstring: 10

Patch (exported symbols added or changed by this PR): no exported symbol type-completeness changes detected.

@codecov

codecovBot commented Aug 22, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 91.32%. Comparing base (fee267d) to head (f84014d).

Additional details and impacted files
@@ Coverage Diff @@## main #1226 +/- ##
=======================================
Coverage 91.32% 91.32% =======================================
Files 92 92 Lines 5438 5438 Branches 700 700 =======================================
Hits 4966 4966 Misses 336 336 Partials 136 136 
FlagCoverage Δ
unittests91.32% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@henrydingliu

Copy link
Copy Markdown
Member

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

No problem, @henrydingliu - I will adapt my existing function to obtain the values from that cl.model_diagnostic and provide you with an updated version.

It was actually good to create the function above as it gave me valuable practice with Chainladder so it was time well-spent anyway from my perspective.

@cursorcursorBot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 2 potential issues.

There are 4 total unresolved issues (including 2 from previous reviews).

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Want reviews to match your repository better? Bugbot Learning can learn team-specific rules from PR activity. A team admin can enable Learning in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit 741f4cc. Configure here.

Comment threaddocs/friedland/chapter_7_part_2a.ipynb Outdated
@salexanian
salexanian marked this pull request as ready for review August 26, 2026 13:45
@salexanian

Copy link
Copy Markdown
ContributorAuthor

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

I have refactored the functions to use model_diagnostic, @henrydingliu .

@henrydingliu

Copy link
Copy Markdown
Member

@salexanian I'm not seeing any usage of model_diagnostics in this latest version

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@salexanian I'm not seeing any usage of model_diagnostics in this latest version

@henrydingliu it is used in Ex3Sht1(), Ex3Sht10(), Ex4Sht1() and Ex4Sht6() (the other sheets were developed with your dev_exihibit function which already uses cl.model_diagnostic). My use of model_diagnostic is consistent throughout the functions - I generate diag_df (the model_diagnostics dataframe), and then obtain the columns of the tables from that dataframe. In 3 of the functions I stored the scenarios from cl.model_diagnostic separately in a dictionary and obtained the info needed for the columns from there.

@henrydingliu

Copy link
Copy Markdown
Member

this is what I see when i click into the RTD link

image

@salexanian

Copy link
Copy Markdown
ContributorAuthor

this is what I see when i click into the RTD link

image

I believe that is the function in the original notebook chapter_7_part_2.ipynb, but I put my work into the notebook chapter_7_part_2a.ipynb - I believe you asked me to store my changes in a separate notebook. The amended functions should be in that notebook.

@henrydingliu

Copy link
Copy Markdown
Member

ah, you are right. i completely forgot. my bad.

@henrydingliu

Copy link
Copy Markdown
Member

a few comments:

  • the helper functions format_col etc. are no longer necessary.
  • ibnr is already available in model_diagnostics
  • there are still places where the ultimate is being derived via col_mult, rather than using a chainladder implementation
  • ex3sht1 is handling too many scenarios at the same time. you can massively simplify if you let it just handle a single scenario for each call
  • ex3sht10, etc. should take tri.loc["Steady State"], rather than ("Steady State", tri). the string "Steady State" is also available via tri.loc["Steady State"].index

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@salexanian@henrydingliu
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix"); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Refactor Chapter 7 exhibit construction - #1226

Open
salexanian wants to merge 7 commits into
casact:mainfrom
salexanian:friedland-ch7-refactor
Open

Refactor Chapter 7 exhibit construction#1226
salexanian wants to merge 7 commits into
casact:mainfrom
salexanian:friedland-ch7-refactor

Conversation

@salexanian

@salexaniansalexanian commented Aug 21, 2026

Copy link
Copy Markdown
Contributor

Summary of Changes

Follow-up to the merged Chapter 7 reconciliation work.

Refactors the Chapter 7 exhibit construction, including use of cl.model_diagnostics() to reduce pandas wrangling and simplify the exhibit-building logic.

The reconciliation assertions remain in place to verify the reproduced Friedland values.

Related GitHub Issue(s)

#1189

Additional Context for Reviewers

Have rewritten Ex3Sht1 to use cl.model_diagnostics.

Checklist

  • I passed tests locally for both code (uv run pytest) and documentation changes (uv run --directory docs jb build . --builder=custom --custom-builder=doctest)

Note

Low Risk
Documentation and doctest refactors in the Friedland chapter only; no production reserving or API behavior changes.

Overview
Refactors Chapter 7 Friedland exhibit construction (follow-up to reconciliation work for #1189), centering on Exhibit I, Sheet 3 (Ex3Sht1).

development_summary-style exhibit tables are rebuilt to pull Latest, CDF, and Ultimate (and related columns) via cl.model_diagnostics() instead of hand-rolled pandas indexing, transposes, and separate Chainladder().fit calls. Rounded exhibit paths that match the textbook’s three-decimal CDF workflow should stay aligned with the prior narrative.

Reconciliation assertions against the printed Friedland figures are kept so doctests still verify reproduced values after the simplification.

Reviewed by Cursor Bugbot for commit f84014d. Bugbot is set up for automated code reviews on this repo. Configure here.

" )\n",
" )\n",
"\n",
" return (results_upper, results_lower)"

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Backup function left in notebook

Medium Severity

ex3sht1_BAK looks like a leftover backup of the pre-refactor Sheet 1 builder. It is never called; only ex3sht1 is used. Keeping both versions clutters the notebook and makes it unclear which implementation is canonical after the model_diagnostics rewrite.

Fix in CursorFix in Web

Reviewed by Cursor Bugbot for commit fc5f4f6. Configure here.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am leaving this in for now as the reviewers have not determined what version of the function should be kept at this point.

" tri: cl.Triangle,\n",
" dev_input: dict,\n",
" tail_input: dict\n",
") -> tuple:\n",

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unused tail input parameter

Low Severity

ex3sht1 still accepts tail_input, and the caller still builds and passes it, but the new body never uses that argument. The old path applied TailConstant; the refactor dropped that without cleaning the parameter or call site, leaving dead API surface.

Additional Locations (1)
Fix in CursorFix in Web

Reviewed by Cursor Bugbot for commit fc5f4f6. Configure here.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will remove this once bigger issues have been resolved.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@henrydingliu, I used cl.model_diagnostics to create a new version of ex3sht1 that displays the tables correctly and passes the asserts, but the function is actually longer than the one I had produced originally. Could you please review to ensure I implemented it the way you expected?

The issue with using cl.model_diagnostics is that it essentially requires me to take the multi-index table returned by it, convert it to a single-index table, and then reconvert it to multiindex again - this ends up taking a reasonable amount of code to do. It may be that Exhibit 3 Sheet 1 is not an ideal exhibit to use with cl.model_diagnostics, and other exhibits will work more seamlessly with it. I also don't rule out the possibility that I implemented this incorrectly.

I just found the original approach of merging individual pandas series in a dictionary to be cleaner, but I guess it is a subjective thing.

@priyam0k , I bring this to your attention as well for input.

@henrydingliu

Copy link
Copy Markdown
Member

@salexanian can you please rename this alternative solution as part_2a to circumvent the conflict? then we can run the test and look at the RTD render.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

No problem, @henrydingliu . I will do so. I'll be back home in a couple of hours

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@salexanian can you please rename this alternative solution as part_2a to circumvent the conflict? then we can run the test and look at the RTD render.

@henrydingliu - done.

@github-actions

github-actionsBot commented Aug 22, 2026

Copy link
Copy Markdown

Pyright Type Completeness

View the full pyright --verifytypes output for this commit

Project (full chainladder package, at this PR's head): 14.9% of exported symbols fully typed (202 / 1356)

KnownAmbiguousUnknownTotal
Project (head)20211110431356

Other symbols referenced but not exported by chainladder: 13

KnownAmbiguousUnknownTotal
Other (head)31913

Symbols without documentation:

  • Functions without docstring: 324
  • Functions without default param: 0
  • Classes without docstring: 10

Patch (exported symbols added or changed by this PR): no exported symbol type-completeness changes detected.

@codecov

codecovBot commented Aug 22, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 91.32%. Comparing base (fee267d) to head (f84014d).

Additional details and impacted files
@@ Coverage Diff @@## main #1226 +/- ##
=======================================
Coverage 91.32% 91.32% =======================================
Files 92 92 Lines 5438 5438 Branches 700 700 =======================================
Hits 4966 4966 Misses 336 336 Partials 136 136 
FlagCoverage Δ
unittests91.32% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@henrydingliu

Copy link
Copy Markdown
Member

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

No problem, @henrydingliu - I will adapt my existing function to obtain the values from that cl.model_diagnostic and provide you with an updated version.

It was actually good to create the function above as it gave me valuable practice with Chainladder so it was time well-spent anyway from my perspective.

@cursorcursorBot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 2 potential issues.

There are 4 total unresolved issues (including 2 from previous reviews).

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Want reviews to match your repository better? Bugbot Learning can learn team-specific rules from PR activity. A team admin can enable Learning in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit 741f4cc. Configure here.

Comment threaddocs/friedland/chapter_7_part_2a.ipynb Outdated
@salexanian
salexanian marked this pull request as ready for review August 26, 2026 13:45
@salexanian

Copy link
Copy Markdown
ContributorAuthor

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

I have refactored the functions to use model_diagnostic, @henrydingliu .

@henrydingliu

Copy link
Copy Markdown
Member

@salexanian I'm not seeing any usage of model_diagnostics in this latest version

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@salexanian I'm not seeing any usage of model_diagnostics in this latest version

@henrydingliu it is used in Ex3Sht1(), Ex3Sht10(), Ex4Sht1() and Ex4Sht6() (the other sheets were developed with your dev_exihibit function which already uses cl.model_diagnostic). My use of model_diagnostic is consistent throughout the functions - I generate diag_df (the model_diagnostics dataframe), and then obtain the columns of the tables from that dataframe. In 3 of the functions I stored the scenarios from cl.model_diagnostic separately in a dictionary and obtained the info needed for the columns from there.

@henrydingliu

Copy link
Copy Markdown
Member

this is what I see when i click into the RTD link

image

@salexanian

Copy link
Copy Markdown
ContributorAuthor

this is what I see when i click into the RTD link

image

I believe that is the function in the original notebook chapter_7_part_2.ipynb, but I put my work into the notebook chapter_7_part_2a.ipynb - I believe you asked me to store my changes in a separate notebook. The amended functions should be in that notebook.

@henrydingliu

Copy link
Copy Markdown
Member

ah, you are right. i completely forgot. my bad.

@henrydingliu

Copy link
Copy Markdown
Member

a few comments:

  • the helper functions format_col etc. are no longer necessary.
  • ibnr is already available in model_diagnostics
  • there are still places where the ultimate is being derived via col_mult, rather than using a chainladder implementation
  • ex3sht1 is handling too many scenarios at the same time. you can massively simplify if you let it just handle a single scenario for each call
  • ex3sht10, etc. should take tri.loc["Steady State"], rather than ("Steady State", tri). the string "Steady State" is also available via tri.loc["Steady State"].index

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@salexanian@henrydingliu
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms"); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Refactor Chapter 7 exhibit construction - #1226

Open
salexanian wants to merge 7 commits into
casact:mainfrom
salexanian:friedland-ch7-refactor
Open

Refactor Chapter 7 exhibit construction#1226
salexanian wants to merge 7 commits into
casact:mainfrom
salexanian:friedland-ch7-refactor

Conversation

@salexanian

@salexaniansalexanian commented Aug 21, 2026

Copy link
Copy Markdown
Contributor

Summary of Changes

Follow-up to the merged Chapter 7 reconciliation work.

Refactors the Chapter 7 exhibit construction, including use of cl.model_diagnostics() to reduce pandas wrangling and simplify the exhibit-building logic.

The reconciliation assertions remain in place to verify the reproduced Friedland values.

Related GitHub Issue(s)

#1189

Additional Context for Reviewers

Have rewritten Ex3Sht1 to use cl.model_diagnostics.

Checklist

  • I passed tests locally for both code (uv run pytest) and documentation changes (uv run --directory docs jb build . --builder=custom --custom-builder=doctest)

Note

Low Risk
Documentation and doctest refactors in the Friedland chapter only; no production reserving or API behavior changes.

Overview
Refactors Chapter 7 Friedland exhibit construction (follow-up to reconciliation work for #1189), centering on Exhibit I, Sheet 3 (Ex3Sht1).

development_summary-style exhibit tables are rebuilt to pull Latest, CDF, and Ultimate (and related columns) via cl.model_diagnostics() instead of hand-rolled pandas indexing, transposes, and separate Chainladder().fit calls. Rounded exhibit paths that match the textbook’s three-decimal CDF workflow should stay aligned with the prior narrative.

Reconciliation assertions against the printed Friedland figures are kept so doctests still verify reproduced values after the simplification.

Reviewed by Cursor Bugbot for commit f84014d. Bugbot is set up for automated code reviews on this repo. Configure here.

" )\n",
" )\n",
"\n",
" return (results_upper, results_lower)"

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Backup function left in notebook

Medium Severity

ex3sht1_BAK looks like a leftover backup of the pre-refactor Sheet 1 builder. It is never called; only ex3sht1 is used. Keeping both versions clutters the notebook and makes it unclear which implementation is canonical after the model_diagnostics rewrite.

Fix in CursorFix in Web

Reviewed by Cursor Bugbot for commit fc5f4f6. Configure here.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am leaving this in for now as the reviewers have not determined what version of the function should be kept at this point.

" tri: cl.Triangle,\n",
" dev_input: dict,\n",
" tail_input: dict\n",
") -> tuple:\n",

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unused tail input parameter

Low Severity

ex3sht1 still accepts tail_input, and the caller still builds and passes it, but the new body never uses that argument. The old path applied TailConstant; the refactor dropped that without cleaning the parameter or call site, leaving dead API surface.

Additional Locations (1)
Fix in CursorFix in Web

Reviewed by Cursor Bugbot for commit fc5f4f6. Configure here.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will remove this once bigger issues have been resolved.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@henrydingliu, I used cl.model_diagnostics to create a new version of ex3sht1 that displays the tables correctly and passes the asserts, but the function is actually longer than the one I had produced originally. Could you please review to ensure I implemented it the way you expected?

The issue with using cl.model_diagnostics is that it essentially requires me to take the multi-index table returned by it, convert it to a single-index table, and then reconvert it to multiindex again - this ends up taking a reasonable amount of code to do. It may be that Exhibit 3 Sheet 1 is not an ideal exhibit to use with cl.model_diagnostics, and other exhibits will work more seamlessly with it. I also don't rule out the possibility that I implemented this incorrectly.

I just found the original approach of merging individual pandas series in a dictionary to be cleaner, but I guess it is a subjective thing.

@priyam0k , I bring this to your attention as well for input.

@henrydingliu

Copy link
Copy Markdown
Member

@salexanian can you please rename this alternative solution as part_2a to circumvent the conflict? then we can run the test and look at the RTD render.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

No problem, @henrydingliu . I will do so. I'll be back home in a couple of hours

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@salexanian can you please rename this alternative solution as part_2a to circumvent the conflict? then we can run the test and look at the RTD render.

@henrydingliu - done.

@github-actions

github-actionsBot commented Aug 22, 2026

Copy link
Copy Markdown

Pyright Type Completeness

View the full pyright --verifytypes output for this commit

Project (full chainladder package, at this PR's head): 14.9% of exported symbols fully typed (202 / 1356)

KnownAmbiguousUnknownTotal
Project (head)20211110431356

Other symbols referenced but not exported by chainladder: 13

KnownAmbiguousUnknownTotal
Other (head)31913

Symbols without documentation:

  • Functions without docstring: 324
  • Functions without default param: 0
  • Classes without docstring: 10

Patch (exported symbols added or changed by this PR): no exported symbol type-completeness changes detected.

@codecov

codecovBot commented Aug 22, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 91.32%. Comparing base (fee267d) to head (f84014d).

Additional details and impacted files
@@ Coverage Diff @@## main #1226 +/- ##
=======================================
Coverage 91.32% 91.32% =======================================
Files 92 92 Lines 5438 5438 Branches 700 700 =======================================
Hits 4966 4966 Misses 336 336 Partials 136 136 
FlagCoverage Δ
unittests91.32% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@henrydingliu

Copy link
Copy Markdown
Member

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

No problem, @henrydingliu - I will adapt my existing function to obtain the values from that cl.model_diagnostic and provide you with an updated version.

It was actually good to create the function above as it gave me valuable practice with Chainladder so it was time well-spent anyway from my perspective.

@cursorcursorBot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 2 potential issues.

There are 4 total unresolved issues (including 2 from previous reviews).

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Want reviews to match your repository better? Bugbot Learning can learn team-specific rules from PR activity. A team admin can enable Learning in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit 741f4cc. Configure here.

Comment threaddocs/friedland/chapter_7_part_2a.ipynb Outdated
@salexanian
salexanian marked this pull request as ready for review August 26, 2026 13:45
@salexanian

Copy link
Copy Markdown
ContributorAuthor

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

I have refactored the functions to use model_diagnostic, @henrydingliu .

@henrydingliu

Copy link
Copy Markdown
Member

@salexanian I'm not seeing any usage of model_diagnostics in this latest version

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@salexanian I'm not seeing any usage of model_diagnostics in this latest version

@henrydingliu it is used in Ex3Sht1(), Ex3Sht10(), Ex4Sht1() and Ex4Sht6() (the other sheets were developed with your dev_exihibit function which already uses cl.model_diagnostic). My use of model_diagnostic is consistent throughout the functions - I generate diag_df (the model_diagnostics dataframe), and then obtain the columns of the tables from that dataframe. In 3 of the functions I stored the scenarios from cl.model_diagnostic separately in a dictionary and obtained the info needed for the columns from there.

@henrydingliu

Copy link
Copy Markdown
Member

this is what I see when i click into the RTD link

image

@salexanian

Copy link
Copy Markdown
ContributorAuthor

this is what I see when i click into the RTD link

image

I believe that is the function in the original notebook chapter_7_part_2.ipynb, but I put my work into the notebook chapter_7_part_2a.ipynb - I believe you asked me to store my changes in a separate notebook. The amended functions should be in that notebook.

@henrydingliu

Copy link
Copy Markdown
Member

ah, you are right. i completely forgot. my bad.

@henrydingliu

Copy link
Copy Markdown
Member

a few comments:

  • the helper functions format_col etc. are no longer necessary.
  • ibnr is already available in model_diagnostics
  • there are still places where the ultimate is being derived via col_mult, rather than using a chainladder implementation
  • ex3sht1 is handling too many scenarios at the same time. you can massively simplify if you let it just handle a single scenario for each call
  • ex3sht10, etc. should take tri.loc["Steady State"], rather than ("Steady State", tri). the string "Steady State" is also available via tri.loc["Steady State"].index

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@salexanian@henrydingliu
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links"); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + '
Skip to content

Refactor Chapter 7 exhibit construction - #1226

Open
salexanian wants to merge 7 commits into
casact:mainfrom
salexanian:friedland-ch7-refactor
Open

Refactor Chapter 7 exhibit construction#1226
salexanian wants to merge 7 commits into
casact:mainfrom
salexanian:friedland-ch7-refactor

Conversation

@salexanian

@salexaniansalexanian commented Aug 21, 2026

Copy link
Copy Markdown
Contributor

Summary of Changes

Follow-up to the merged Chapter 7 reconciliation work.

Refactors the Chapter 7 exhibit construction, including use of cl.model_diagnostics() to reduce pandas wrangling and simplify the exhibit-building logic.

The reconciliation assertions remain in place to verify the reproduced Friedland values.

Related GitHub Issue(s)

#1189

Additional Context for Reviewers

Have rewritten Ex3Sht1 to use cl.model_diagnostics.

Checklist

  • I passed tests locally for both code (uv run pytest) and documentation changes (uv run --directory docs jb build . --builder=custom --custom-builder=doctest)

Note

Low Risk
Documentation and doctest refactors in the Friedland chapter only; no production reserving or API behavior changes.

Overview
Refactors Chapter 7 Friedland exhibit construction (follow-up to reconciliation work for #1189), centering on Exhibit I, Sheet 3 (Ex3Sht1).

development_summary-style exhibit tables are rebuilt to pull Latest, CDF, and Ultimate (and related columns) via cl.model_diagnostics() instead of hand-rolled pandas indexing, transposes, and separate Chainladder().fit calls. Rounded exhibit paths that match the textbook’s three-decimal CDF workflow should stay aligned with the prior narrative.

Reconciliation assertions against the printed Friedland figures are kept so doctests still verify reproduced values after the simplification.

Reviewed by Cursor Bugbot for commit f84014d. Bugbot is set up for automated code reviews on this repo. Configure here.

" )\n",
" )\n",
"\n",
" return (results_upper, results_lower)"

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Backup function left in notebook

Medium Severity

ex3sht1_BAK looks like a leftover backup of the pre-refactor Sheet 1 builder. It is never called; only ex3sht1 is used. Keeping both versions clutters the notebook and makes it unclear which implementation is canonical after the model_diagnostics rewrite.

Fix in CursorFix in Web

Reviewed by Cursor Bugbot for commit fc5f4f6. Configure here.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am leaving this in for now as the reviewers have not determined what version of the function should be kept at this point.

" tri: cl.Triangle,\n",
" dev_input: dict,\n",
" tail_input: dict\n",
") -> tuple:\n",

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unused tail input parameter

Low Severity

ex3sht1 still accepts tail_input, and the caller still builds and passes it, but the new body never uses that argument. The old path applied TailConstant; the refactor dropped that without cleaning the parameter or call site, leaving dead API surface.

Additional Locations (1)
Fix in CursorFix in Web

Reviewed by Cursor Bugbot for commit fc5f4f6. Configure here.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will remove this once bigger issues have been resolved.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@henrydingliu, I used cl.model_diagnostics to create a new version of ex3sht1 that displays the tables correctly and passes the asserts, but the function is actually longer than the one I had produced originally. Could you please review to ensure I implemented it the way you expected?

The issue with using cl.model_diagnostics is that it essentially requires me to take the multi-index table returned by it, convert it to a single-index table, and then reconvert it to multiindex again - this ends up taking a reasonable amount of code to do. It may be that Exhibit 3 Sheet 1 is not an ideal exhibit to use with cl.model_diagnostics, and other exhibits will work more seamlessly with it. I also don't rule out the possibility that I implemented this incorrectly.

I just found the original approach of merging individual pandas series in a dictionary to be cleaner, but I guess it is a subjective thing.

@priyam0k , I bring this to your attention as well for input.

@henrydingliu

Copy link
Copy Markdown
Member

@salexanian can you please rename this alternative solution as part_2a to circumvent the conflict? then we can run the test and look at the RTD render.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

No problem, @henrydingliu . I will do so. I'll be back home in a couple of hours

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@salexanian can you please rename this alternative solution as part_2a to circumvent the conflict? then we can run the test and look at the RTD render.

@henrydingliu - done.

@github-actions

github-actionsBot commented Aug 22, 2026

Copy link
Copy Markdown

Pyright Type Completeness

View the full pyright --verifytypes output for this commit

Project (full chainladder package, at this PR's head): 14.9% of exported symbols fully typed (202 / 1356)

KnownAmbiguousUnknownTotal
Project (head)20211110431356

Other symbols referenced but not exported by chainladder: 13

KnownAmbiguousUnknownTotal
Other (head)31913

Symbols without documentation:

  • Functions without docstring: 324
  • Functions without default param: 0
  • Classes without docstring: 10

Patch (exported symbols added or changed by this PR): no exported symbol type-completeness changes detected.

@codecov

codecovBot commented Aug 22, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 91.32%. Comparing base (fee267d) to head (f84014d).

Additional details and impacted files
@@ Coverage Diff @@## main #1226 +/- ##
=======================================
Coverage 91.32% 91.32% =======================================
Files 92 92 Lines 5438 5438 Branches 700 700 =======================================
Hits 4966 4966 Misses 336 336 Partials 136 136 
FlagCoverage Δ
unittests91.32% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@henrydingliu

Copy link
Copy Markdown
Member

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

No problem, @henrydingliu - I will adapt my existing function to obtain the values from that cl.model_diagnostic and provide you with an updated version.

It was actually good to create the function above as it gave me valuable practice with Chainladder so it was time well-spent anyway from my perspective.

@cursorcursorBot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 2 potential issues.

There are 4 total unresolved issues (including 2 from previous reviews).

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Want reviews to match your repository better? Bugbot Learning can learn team-specific rules from PR activity. A team admin can enable Learning in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit 741f4cc. Configure here.

Comment threaddocs/friedland/chapter_7_part_2a.ipynb Outdated
@salexanian
salexanian marked this pull request as ready for review August 26, 2026 13:45
@salexanian

Copy link
Copy Markdown
ContributorAuthor

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

I have refactored the functions to use model_diagnostic, @henrydingliu .

@henrydingliu

Copy link
Copy Markdown
Member

@salexanian I'm not seeing any usage of model_diagnostics in this latest version

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@salexanian I'm not seeing any usage of model_diagnostics in this latest version

@henrydingliu it is used in Ex3Sht1(), Ex3Sht10(), Ex4Sht1() and Ex4Sht6() (the other sheets were developed with your dev_exihibit function which already uses cl.model_diagnostic). My use of model_diagnostic is consistent throughout the functions - I generate diag_df (the model_diagnostics dataframe), and then obtain the columns of the tables from that dataframe. In 3 of the functions I stored the scenarios from cl.model_diagnostic separately in a dictionary and obtained the info needed for the columns from there.

@henrydingliu

Copy link
Copy Markdown
Member

this is what I see when i click into the RTD link

image

@salexanian

Copy link
Copy Markdown
ContributorAuthor

this is what I see when i click into the RTD link

image

I believe that is the function in the original notebook chapter_7_part_2.ipynb, but I put my work into the notebook chapter_7_part_2a.ipynb - I believe you asked me to store my changes in a separate notebook. The amended functions should be in that notebook.

@henrydingliu

Copy link
Copy Markdown
Member

ah, you are right. i completely forgot. my bad.

@henrydingliu

Copy link
Copy Markdown
Member

a few comments:

  • the helper functions format_col etc. are no longer necessary.
  • ibnr is already available in model_diagnostics
  • there are still places where the ultimate is being derived via col_mult, rather than using a chainladder implementation
  • ex3sht1 is handling too many scenarios at the same time. you can massively simplify if you let it just handle a single scenario for each call
  • ex3sht10, etc. should take tri.loc["Steady State"], rather than ("Steady State", tri). the string "Steady State" is also available via tri.loc["Steady State"].index

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@salexanian@henrydingliu
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default"); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Refactor Chapter 7 exhibit construction - #1226

Open
salexanian wants to merge 7 commits into
casact:mainfrom
salexanian:friedland-ch7-refactor
Open

Refactor Chapter 7 exhibit construction#1226
salexanian wants to merge 7 commits into
casact:mainfrom
salexanian:friedland-ch7-refactor

Conversation

@salexanian

@salexaniansalexanian commented Aug 21, 2026

Copy link
Copy Markdown
Contributor

Summary of Changes

Follow-up to the merged Chapter 7 reconciliation work.

Refactors the Chapter 7 exhibit construction, including use of cl.model_diagnostics() to reduce pandas wrangling and simplify the exhibit-building logic.

The reconciliation assertions remain in place to verify the reproduced Friedland values.

Related GitHub Issue(s)

#1189

Additional Context for Reviewers

Have rewritten Ex3Sht1 to use cl.model_diagnostics.

Checklist

  • I passed tests locally for both code (uv run pytest) and documentation changes (uv run --directory docs jb build . --builder=custom --custom-builder=doctest)

Note

Low Risk
Documentation and doctest refactors in the Friedland chapter only; no production reserving or API behavior changes.

Overview
Refactors Chapter 7 Friedland exhibit construction (follow-up to reconciliation work for #1189), centering on Exhibit I, Sheet 3 (Ex3Sht1).

development_summary-style exhibit tables are rebuilt to pull Latest, CDF, and Ultimate (and related columns) via cl.model_diagnostics() instead of hand-rolled pandas indexing, transposes, and separate Chainladder().fit calls. Rounded exhibit paths that match the textbook’s three-decimal CDF workflow should stay aligned with the prior narrative.

Reconciliation assertions against the printed Friedland figures are kept so doctests still verify reproduced values after the simplification.

Reviewed by Cursor Bugbot for commit f84014d. Bugbot is set up for automated code reviews on this repo. Configure here.

" )\n",
" )\n",
"\n",
" return (results_upper, results_lower)"

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Backup function left in notebook

Medium Severity

ex3sht1_BAK looks like a leftover backup of the pre-refactor Sheet 1 builder. It is never called; only ex3sht1 is used. Keeping both versions clutters the notebook and makes it unclear which implementation is canonical after the model_diagnostics rewrite.

Fix in CursorFix in Web

Reviewed by Cursor Bugbot for commit fc5f4f6. Configure here.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am leaving this in for now as the reviewers have not determined what version of the function should be kept at this point.

" tri: cl.Triangle,\n",
" dev_input: dict,\n",
" tail_input: dict\n",
") -> tuple:\n",

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unused tail input parameter

Low Severity

ex3sht1 still accepts tail_input, and the caller still builds and passes it, but the new body never uses that argument. The old path applied TailConstant; the refactor dropped that without cleaning the parameter or call site, leaving dead API surface.

Additional Locations (1)
Fix in CursorFix in Web

Reviewed by Cursor Bugbot for commit fc5f4f6. Configure here.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will remove this once bigger issues have been resolved.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@henrydingliu, I used cl.model_diagnostics to create a new version of ex3sht1 that displays the tables correctly and passes the asserts, but the function is actually longer than the one I had produced originally. Could you please review to ensure I implemented it the way you expected?

The issue with using cl.model_diagnostics is that it essentially requires me to take the multi-index table returned by it, convert it to a single-index table, and then reconvert it to multiindex again - this ends up taking a reasonable amount of code to do. It may be that Exhibit 3 Sheet 1 is not an ideal exhibit to use with cl.model_diagnostics, and other exhibits will work more seamlessly with it. I also don't rule out the possibility that I implemented this incorrectly.

I just found the original approach of merging individual pandas series in a dictionary to be cleaner, but I guess it is a subjective thing.

@priyam0k , I bring this to your attention as well for input.

@henrydingliu

Copy link
Copy Markdown
Member

@salexanian can you please rename this alternative solution as part_2a to circumvent the conflict? then we can run the test and look at the RTD render.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

No problem, @henrydingliu . I will do so. I'll be back home in a couple of hours

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@salexanian can you please rename this alternative solution as part_2a to circumvent the conflict? then we can run the test and look at the RTD render.

@henrydingliu - done.

@github-actions

github-actionsBot commented Aug 22, 2026

Copy link
Copy Markdown

Pyright Type Completeness

View the full pyright --verifytypes output for this commit

Project (full chainladder package, at this PR's head): 14.9% of exported symbols fully typed (202 / 1356)

KnownAmbiguousUnknownTotal
Project (head)20211110431356

Other symbols referenced but not exported by chainladder: 13

KnownAmbiguousUnknownTotal
Other (head)31913

Symbols without documentation:

  • Functions without docstring: 324
  • Functions without default param: 0
  • Classes without docstring: 10

Patch (exported symbols added or changed by this PR): no exported symbol type-completeness changes detected.

@codecov

codecovBot commented Aug 22, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 91.32%. Comparing base (fee267d) to head (f84014d).

Additional details and impacted files
@@ Coverage Diff @@## main #1226 +/- ##
=======================================
Coverage 91.32% 91.32% =======================================
Files 92 92 Lines 5438 5438 Branches 700 700 =======================================
Hits 4966 4966 Misses 336 336 Partials 136 136 
FlagCoverage Δ
unittests91.32% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@henrydingliu

Copy link
Copy Markdown
Member

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

No problem, @henrydingliu - I will adapt my existing function to obtain the values from that cl.model_diagnostic and provide you with an updated version.

It was actually good to create the function above as it gave me valuable practice with Chainladder so it was time well-spent anyway from my perspective.

@cursorcursorBot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 2 potential issues.

There are 4 total unresolved issues (including 2 from previous reviews).

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Want reviews to match your repository better? Bugbot Learning can learn team-specific rules from PR activity. A team admin can enable Learning in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit 741f4cc. Configure here.

Comment threaddocs/friedland/chapter_7_part_2a.ipynb Outdated
@salexanian
salexanian marked this pull request as ready for review August 26, 2026 13:45
@salexanian

Copy link
Copy Markdown
ContributorAuthor

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

I have refactored the functions to use model_diagnostic, @henrydingliu .

@henrydingliu

Copy link
Copy Markdown
Member

@salexanian I'm not seeing any usage of model_diagnostics in this latest version

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@salexanian I'm not seeing any usage of model_diagnostics in this latest version

@henrydingliu it is used in Ex3Sht1(), Ex3Sht10(), Ex4Sht1() and Ex4Sht6() (the other sheets were developed with your dev_exihibit function which already uses cl.model_diagnostic). My use of model_diagnostic is consistent throughout the functions - I generate diag_df (the model_diagnostics dataframe), and then obtain the columns of the tables from that dataframe. In 3 of the functions I stored the scenarios from cl.model_diagnostic separately in a dictionary and obtained the info needed for the columns from there.

@henrydingliu

Copy link
Copy Markdown
Member

this is what I see when i click into the RTD link

image

@salexanian

Copy link
Copy Markdown
ContributorAuthor

this is what I see when i click into the RTD link

image

I believe that is the function in the original notebook chapter_7_part_2.ipynb, but I put my work into the notebook chapter_7_part_2a.ipynb - I believe you asked me to store my changes in a separate notebook. The amended functions should be in that notebook.

@henrydingliu

Copy link
Copy Markdown
Member

ah, you are right. i completely forgot. my bad.

@henrydingliu

Copy link
Copy Markdown
Member

a few comments:

  • the helper functions format_col etc. are no longer necessary.
  • ibnr is already available in model_diagnostics
  • there are still places where the ultimate is being derived via col_mult, rather than using a chainladder implementation
  • ex3sht1 is handling too many scenarios at the same time. you can massively simplify if you let it just handle a single scenario for each call
  • ex3sht10, etc. should take tri.loc["Steady State"], rather than ("Steady State", tri). the string "Steady State" is also available via tri.loc["Steady State"].index

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@salexanian@henrydingliu
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers"); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Refactor Chapter 7 exhibit construction - #1226

Open
salexanian wants to merge 7 commits into
casact:mainfrom
salexanian:friedland-ch7-refactor
Open

Refactor Chapter 7 exhibit construction#1226
salexanian wants to merge 7 commits into
casact:mainfrom
salexanian:friedland-ch7-refactor

Conversation

@salexanian

@salexaniansalexanian commented Aug 21, 2026

Copy link
Copy Markdown
Contributor

Summary of Changes

Follow-up to the merged Chapter 7 reconciliation work.

Refactors the Chapter 7 exhibit construction, including use of cl.model_diagnostics() to reduce pandas wrangling and simplify the exhibit-building logic.

The reconciliation assertions remain in place to verify the reproduced Friedland values.

Related GitHub Issue(s)

#1189

Additional Context for Reviewers

Have rewritten Ex3Sht1 to use cl.model_diagnostics.

Checklist

  • I passed tests locally for both code (uv run pytest) and documentation changes (uv run --directory docs jb build . --builder=custom --custom-builder=doctest)

Note

Low Risk
Documentation and doctest refactors in the Friedland chapter only; no production reserving or API behavior changes.

Overview
Refactors Chapter 7 Friedland exhibit construction (follow-up to reconciliation work for #1189), centering on Exhibit I, Sheet 3 (Ex3Sht1).

development_summary-style exhibit tables are rebuilt to pull Latest, CDF, and Ultimate (and related columns) via cl.model_diagnostics() instead of hand-rolled pandas indexing, transposes, and separate Chainladder().fit calls. Rounded exhibit paths that match the textbook’s three-decimal CDF workflow should stay aligned with the prior narrative.

Reconciliation assertions against the printed Friedland figures are kept so doctests still verify reproduced values after the simplification.

Reviewed by Cursor Bugbot for commit f84014d. Bugbot is set up for automated code reviews on this repo. Configure here.

" )\n",
" )\n",
"\n",
" return (results_upper, results_lower)"

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Backup function left in notebook

Medium Severity

ex3sht1_BAK looks like a leftover backup of the pre-refactor Sheet 1 builder. It is never called; only ex3sht1 is used. Keeping both versions clutters the notebook and makes it unclear which implementation is canonical after the model_diagnostics rewrite.

Fix in CursorFix in Web

Reviewed by Cursor Bugbot for commit fc5f4f6. Configure here.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am leaving this in for now as the reviewers have not determined what version of the function should be kept at this point.

" tri: cl.Triangle,\n",
" dev_input: dict,\n",
" tail_input: dict\n",
") -> tuple:\n",

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unused tail input parameter

Low Severity

ex3sht1 still accepts tail_input, and the caller still builds and passes it, but the new body never uses that argument. The old path applied TailConstant; the refactor dropped that without cleaning the parameter or call site, leaving dead API surface.

Additional Locations (1)
Fix in CursorFix in Web

Reviewed by Cursor Bugbot for commit fc5f4f6. Configure here.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will remove this once bigger issues have been resolved.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@henrydingliu, I used cl.model_diagnostics to create a new version of ex3sht1 that displays the tables correctly and passes the asserts, but the function is actually longer than the one I had produced originally. Could you please review to ensure I implemented it the way you expected?

The issue with using cl.model_diagnostics is that it essentially requires me to take the multi-index table returned by it, convert it to a single-index table, and then reconvert it to multiindex again - this ends up taking a reasonable amount of code to do. It may be that Exhibit 3 Sheet 1 is not an ideal exhibit to use with cl.model_diagnostics, and other exhibits will work more seamlessly with it. I also don't rule out the possibility that I implemented this incorrectly.

I just found the original approach of merging individual pandas series in a dictionary to be cleaner, but I guess it is a subjective thing.

@priyam0k , I bring this to your attention as well for input.

@henrydingliu

Copy link
Copy Markdown
Member

@salexanian can you please rename this alternative solution as part_2a to circumvent the conflict? then we can run the test and look at the RTD render.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

No problem, @henrydingliu . I will do so. I'll be back home in a couple of hours

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@salexanian can you please rename this alternative solution as part_2a to circumvent the conflict? then we can run the test and look at the RTD render.

@henrydingliu - done.

@github-actions

github-actionsBot commented Aug 22, 2026

Copy link
Copy Markdown

Pyright Type Completeness

View the full pyright --verifytypes output for this commit

Project (full chainladder package, at this PR's head): 14.9% of exported symbols fully typed (202 / 1356)

KnownAmbiguousUnknownTotal
Project (head)20211110431356

Other symbols referenced but not exported by chainladder: 13

KnownAmbiguousUnknownTotal
Other (head)31913

Symbols without documentation:

  • Functions without docstring: 324
  • Functions without default param: 0
  • Classes without docstring: 10

Patch (exported symbols added or changed by this PR): no exported symbol type-completeness changes detected.

@codecov

codecovBot commented Aug 22, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 91.32%. Comparing base (fee267d) to head (f84014d).

Additional details and impacted files
@@ Coverage Diff @@## main #1226 +/- ##
=======================================
Coverage 91.32% 91.32% =======================================
Files 92 92 Lines 5438 5438 Branches 700 700 =======================================
Hits 4966 4966 Misses 336 336 Partials 136 136 
FlagCoverage Δ
unittests91.32% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@henrydingliu

Copy link
Copy Markdown
Member

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

No problem, @henrydingliu - I will adapt my existing function to obtain the values from that cl.model_diagnostic and provide you with an updated version.

It was actually good to create the function above as it gave me valuable practice with Chainladder so it was time well-spent anyway from my perspective.

@cursorcursorBot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 2 potential issues.

There are 4 total unresolved issues (including 2 from previous reviews).

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Want reviews to match your repository better? Bugbot Learning can learn team-specific rules from PR activity. A team admin can enable Learning in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit 741f4cc. Configure here.

Comment threaddocs/friedland/chapter_7_part_2a.ipynb Outdated
@salexanian
salexanian marked this pull request as ready for review August 26, 2026 13:45
@salexanian

Copy link
Copy Markdown
ContributorAuthor

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

I have refactored the functions to use model_diagnostic, @henrydingliu .

@henrydingliu

Copy link
Copy Markdown
Member

@salexanian I'm not seeing any usage of model_diagnostics in this latest version

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@salexanian I'm not seeing any usage of model_diagnostics in this latest version

@henrydingliu it is used in Ex3Sht1(), Ex3Sht10(), Ex4Sht1() and Ex4Sht6() (the other sheets were developed with your dev_exihibit function which already uses cl.model_diagnostic). My use of model_diagnostic is consistent throughout the functions - I generate diag_df (the model_diagnostics dataframe), and then obtain the columns of the tables from that dataframe. In 3 of the functions I stored the scenarios from cl.model_diagnostic separately in a dictionary and obtained the info needed for the columns from there.

@henrydingliu

Copy link
Copy Markdown
Member

this is what I see when i click into the RTD link

image

@salexanian

Copy link
Copy Markdown
ContributorAuthor

this is what I see when i click into the RTD link

image

I believe that is the function in the original notebook chapter_7_part_2.ipynb, but I put my work into the notebook chapter_7_part_2a.ipynb - I believe you asked me to store my changes in a separate notebook. The amended functions should be in that notebook.

@henrydingliu

Copy link
Copy Markdown
Member

ah, you are right. i completely forgot. my bad.

@henrydingliu

Copy link
Copy Markdown
Member

a few comments:

  • the helper functions format_col etc. are no longer necessary.
  • ibnr is already available in model_diagnostics
  • there are still places where the ultimate is being derived via col_mult, rather than using a chainladder implementation
  • ex3sht1 is handling too many scenarios at the same time. you can massively simplify if you let it just handle a single scenario for each call
  • ex3sht10, etc. should take tri.loc["Steady State"], rather than ("Steady State", tri). the string "Steady State" is also available via tri.loc["Steady State"].index

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@salexanian@henrydingliu
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode"); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })();
Skip to content

Refactor Chapter 7 exhibit construction - #1226

Open
salexanian wants to merge 7 commits into
casact:mainfrom
salexanian:friedland-ch7-refactor
Open

Refactor Chapter 7 exhibit construction#1226
salexanian wants to merge 7 commits into
casact:mainfrom
salexanian:friedland-ch7-refactor

Conversation

@salexanian

@salexaniansalexanian commented Aug 21, 2026

Copy link
Copy Markdown
Contributor

Summary of Changes

Follow-up to the merged Chapter 7 reconciliation work.

Refactors the Chapter 7 exhibit construction, including use of cl.model_diagnostics() to reduce pandas wrangling and simplify the exhibit-building logic.

The reconciliation assertions remain in place to verify the reproduced Friedland values.

Related GitHub Issue(s)

#1189

Additional Context for Reviewers

Have rewritten Ex3Sht1 to use cl.model_diagnostics.

Checklist

  • I passed tests locally for both code (uv run pytest) and documentation changes (uv run --directory docs jb build . --builder=custom --custom-builder=doctest)

Note

Low Risk
Documentation and doctest refactors in the Friedland chapter only; no production reserving or API behavior changes.

Overview
Refactors Chapter 7 Friedland exhibit construction (follow-up to reconciliation work for #1189), centering on Exhibit I, Sheet 3 (Ex3Sht1).

development_summary-style exhibit tables are rebuilt to pull Latest, CDF, and Ultimate (and related columns) via cl.model_diagnostics() instead of hand-rolled pandas indexing, transposes, and separate Chainladder().fit calls. Rounded exhibit paths that match the textbook’s three-decimal CDF workflow should stay aligned with the prior narrative.

Reconciliation assertions against the printed Friedland figures are kept so doctests still verify reproduced values after the simplification.

Reviewed by Cursor Bugbot for commit f84014d. Bugbot is set up for automated code reviews on this repo. Configure here.

" )\n",
" )\n",
"\n",
" return (results_upper, results_lower)"

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Backup function left in notebook

Medium Severity

ex3sht1_BAK looks like a leftover backup of the pre-refactor Sheet 1 builder. It is never called; only ex3sht1 is used. Keeping both versions clutters the notebook and makes it unclear which implementation is canonical after the model_diagnostics rewrite.

Fix in CursorFix in Web

Reviewed by Cursor Bugbot for commit fc5f4f6. Configure here.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am leaving this in for now as the reviewers have not determined what version of the function should be kept at this point.

" tri: cl.Triangle,\n",
" dev_input: dict,\n",
" tail_input: dict\n",
") -> tuple:\n",

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unused tail input parameter

Low Severity

ex3sht1 still accepts tail_input, and the caller still builds and passes it, but the new body never uses that argument. The old path applied TailConstant; the refactor dropped that without cleaning the parameter or call site, leaving dead API surface.

Additional Locations (1)
Fix in CursorFix in Web

Reviewed by Cursor Bugbot for commit fc5f4f6. Configure here.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will remove this once bigger issues have been resolved.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@henrydingliu, I used cl.model_diagnostics to create a new version of ex3sht1 that displays the tables correctly and passes the asserts, but the function is actually longer than the one I had produced originally. Could you please review to ensure I implemented it the way you expected?

The issue with using cl.model_diagnostics is that it essentially requires me to take the multi-index table returned by it, convert it to a single-index table, and then reconvert it to multiindex again - this ends up taking a reasonable amount of code to do. It may be that Exhibit 3 Sheet 1 is not an ideal exhibit to use with cl.model_diagnostics, and other exhibits will work more seamlessly with it. I also don't rule out the possibility that I implemented this incorrectly.

I just found the original approach of merging individual pandas series in a dictionary to be cleaner, but I guess it is a subjective thing.

@priyam0k , I bring this to your attention as well for input.

@henrydingliu

Copy link
Copy Markdown
Member

@salexanian can you please rename this alternative solution as part_2a to circumvent the conflict? then we can run the test and look at the RTD render.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

No problem, @henrydingliu . I will do so. I'll be back home in a couple of hours

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@salexanian can you please rename this alternative solution as part_2a to circumvent the conflict? then we can run the test and look at the RTD render.

@henrydingliu - done.

@github-actions

github-actionsBot commented Aug 22, 2026

Copy link
Copy Markdown

Pyright Type Completeness

View the full pyright --verifytypes output for this commit

Project (full chainladder package, at this PR's head): 14.9% of exported symbols fully typed (202 / 1356)

KnownAmbiguousUnknownTotal
Project (head)20211110431356

Other symbols referenced but not exported by chainladder: 13

KnownAmbiguousUnknownTotal
Other (head)31913

Symbols without documentation:

  • Functions without docstring: 324
  • Functions without default param: 0
  • Classes without docstring: 10

Patch (exported symbols added or changed by this PR): no exported symbol type-completeness changes detected.

@codecov

codecovBot commented Aug 22, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 91.32%. Comparing base (fee267d) to head (f84014d).

Additional details and impacted files
@@ Coverage Diff @@## main #1226 +/- ##
=======================================
Coverage 91.32% 91.32% =======================================
Files 92 92 Lines 5438 5438 Branches 700 700 =======================================
Hits 4966 4966 Misses 336 336 Partials 136 136 
FlagCoverage Δ
unittests91.32% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@henrydingliu

Copy link
Copy Markdown
Member

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

@salexanian

Copy link
Copy Markdown
ContributorAuthor

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

No problem, @henrydingliu - I will adapt my existing function to obtain the values from that cl.model_diagnostic and provide you with an updated version.

It was actually good to create the function above as it gave me valuable practice with Chainladder so it was time well-spent anyway from my perspective.

@cursorcursorBot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 2 potential issues.

There are 4 total unresolved issues (including 2 from previous reviews).

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Want reviews to match your repository better? Bugbot Learning can learn team-specific rules from PR activity. A team admin can enable Learning in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit 741f4cc. Configure here.

Comment threaddocs/friedland/chapter_7_part_2a.ipynb Outdated
@salexanian
salexanian marked this pull request as ready for review August 26, 2026 13:45
@salexanian

Copy link
Copy Markdown
ContributorAuthor

I'm not sure why you are implementing an entirely new pattern of pandas manipulation. take summing, the new add_totals private method is less elegant than the previous approach. but why do add_totals in the first place? things like ultimate and ibnr are also directly available in model_diagnostic.

i recommended model_diagnostic because it directly provides an output in pandas for further manipulation, shortcuttinf all the col1, col2, etc construction in the previous ex3sht1. apologies if it sounded like I wanted you to rewrite the whole method.

I have refactored the functions to use model_diagnostic, @henrydingliu .

@henrydingliu

Copy link
Copy Markdown
Member

@salexanian I'm not seeing any usage of model_diagnostics in this latest version

@salexanian

Copy link
Copy Markdown
ContributorAuthor

@salexanian I'm not seeing any usage of model_diagnostics in this latest version

@henrydingliu it is used in Ex3Sht1(), Ex3Sht10(), Ex4Sht1() and Ex4Sht6() (the other sheets were developed with your dev_exihibit function which already uses cl.model_diagnostic). My use of model_diagnostic is consistent throughout the functions - I generate diag_df (the model_diagnostics dataframe), and then obtain the columns of the tables from that dataframe. In 3 of the functions I stored the scenarios from cl.model_diagnostic separately in a dictionary and obtained the info needed for the columns from there.

@henrydingliu

Copy link
Copy Markdown
Member

this is what I see when i click into the RTD link

image

@salexanian

Copy link
Copy Markdown
ContributorAuthor

this is what I see when i click into the RTD link

image

I believe that is the function in the original notebook chapter_7_part_2.ipynb, but I put my work into the notebook chapter_7_part_2a.ipynb - I believe you asked me to store my changes in a separate notebook. The amended functions should be in that notebook.

@henrydingliu

Copy link
Copy Markdown
Member

ah, you are right. i completely forgot. my bad.

@henrydingliu

Copy link
Copy Markdown
Member

a few comments:

  • the helper functions format_col etc. are no longer necessary.
  • ibnr is already available in model_diagnostics
  • there are still places where the ultimate is being derived via col_mult, rather than using a chainladder implementation
  • ex3sht1 is handling too many scenarios at the same time. you can massively simplify if you let it just handle a single scenario for each call
  • ex3sht10, etc. should take tri.loc["Steady State"], rather than ("Steady State", tri). the string "Steady State" is also available via tri.loc["Steady State"].index

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@salexanian@henrydingliu