Skip to content

Scale tabular row orchestration exports - #1145

Merged
Paul Lizer (paullizer) merged 38 commits into
Developmentfrom
fix/1031-tabular-row-orchestration-scale
Aug 4, 2026
Merged

Scale tabular row orchestration exports#1145
Paul Lizer (paullizer) merged 38 commits into
Developmentfrom
fix/1031-tabular-row-orchestration-scale

Conversation

@paullizer

@paullizerPaul Lizer (paullizer) commented Aug 4, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • FixesScale per-row tabular analysis and generated CSV exports to 30,000+ rows #1031 by scaling per-row tabular analysis and generated CSV exports across paginated tabular results and large source windows.
  • Adds durable replayable source/query orchestration, ordered checkpoint validation, bounded final artifact assembly, and post-run summary handling.
  • Suppresses misleading assistant-table fallback exports while exhaustive tabular generation is queued, running, completed, or explicitly failed.
  • Removes generated migration state artifacts from the branch before PR creation.

Validation

  • git -c core.whitespace=blank-at-eol,blank-at-eof,space-before-tab,cr-at-eol diff --check origin/Development...HEAD
  • python -m py_compile for changed Python files
  • node --check for changed JavaScript files
  • python scripts/check_swagger_routes.py application/single_app/app.py application/single_app/route_backend_chats.py application/single_app/route_backend_collaboration.py application/single_app/route_backend_conversations.py application/single_app/route_backend_data_management.py
  • python functional_tests/route_tests/test_route_blueprint_policy_inventory.py
  • python functional_tests/route_tests/test_route_unauthenticated_policy_contract.py
  • python functional_tests/route_tests/test_route_policy_test_coverage.py
  • python functional_tests/test_tabular_row_orchestration_scale.py
  • python scripts/check_xss_sinks.py --base-sha origin/Development --head-sha HEAD <changed application files>
  • python scripts/check_broken_access_control.py --base-sha origin/Development --head-sha HEAD <changed Python application files>

Notes

  • Target branch: Development
  • Source branch: fix/1031-tabular-row-orchestration-scale
  • Version, docs, release notes, and functional coverage are included in the branch.

@paullizer
improved tabular analysis
e255e22
@paullizer
Add authorized mixed-source manifest contracts
aea82a4
@paullizer
Merge pull request#1064from microsoft/feature/1056-authorized-sourc…
28d4700
…e-manifest-pr
Phase 1: add authorized mixed-source manifest contracts
@paullizer
Add mixed-source chat search and migration recovery
778c10f
@paullizer
Merge pull request#1065from paullizer/feature/1057-chat-search-mixe…
81933f4
…d-source-consistency
Phase 2: honor explicit mixed-source Chat selections
@paullizer
Fix CSV artifacts for non-tabular documents
26508c0
@paullizer
Merge pull request#1067from paullizer/fix/1066-non-tabular-document…
fc6d971
…-csv-artifacts
Fix CSV artifacts for non-tabular documents
@paullizer
Add mixed-source combined Analyze
ebd7394
@paullizer
Merge pull request#1068from microsoft/feature/1059-mixed-source-ana…
f34c1e6
…lyze
Phase 3: mixed-source combined Analyze
@paullizer
Add cross-format compare orchestration
1f93bc5
@paullizer
Merge pull request#1069from paullizer/feature/1059-phase-4-cross-fo…
b504f3b
…rmat-compare
Phase 4: cross-format Compare orchestration
@paullizer
Add mixed-source conversation continuity
9178649
@paullizer
Merge pull request#1070from microsoft/feature/1060-conversation-con…
d7e04ec
…tinuity
Phase 5: preserve mixed-source context across follow-up turns
@paullizer
Harden mixed-source orchestration and CSV exports
95df035
Implement Phase 6 terminal coverage, cancellation, finalization, bounded Analyze All, telemetry, and compatibility hardening.\n\nImprove durable CSV export throughput and timeout recovery.\n\nRefs #1061\nRefs #1071
@paullizer
Merge pull request#1074from microsoft/feature/1061-mixed-source-har…
ee85a13
…dening
Harden mixed-source orchestration and CSV exports
@paullizer
Add universal CSV generation and mixed-source Analyze
a483491
Unify CSV artifact finalization across chat, document actions, and workflows; add durable schema clarification and authorized background export handling. Remove the mixed-source Analyze availability gate and update validation, documentation, and release notes.
Refs #1071
Refs #1058
@paullizer
Merge pull request#1075from paullizer/fix/1071-universal-csv-genera…
dbab53e
…tion
Add universal CSV generation across response paths
@paullizer
Add generic generated file export framework
e2133e9
Promote current-turn structured function results into a format-neutral CSV, DOCX, and PDF artifact pipeline across chat, agents, document actions, and workflows. Preserve durable CSV handling and coverage-aware tabular exports.\n\nRefs #1071
@paullizer
Expand authorized search retrieval capacity
c4653ab
Increase bounded search, metadata, directory, workflow, assigned-knowledge, and mixed-source candidate retrieval limits while preserving authorization and existing maximum constraints. Update affected functional coverage and release notes.
@paullizer
Merge pull request#1076from paullizer/fix/1071-universal-csv-genera…
2b196f5
…tion
Add generated file export framework
@paullizer
Merge origin/Development into tabular orchestration branch
d199d15
@paullizer
Merge latest Development into tabular orchestration branch
722d491
@paullizer
Restore conversation fork operation API
066eed7
@paullizer
Preserve mixed source manifest storage locators
9ad46d7
@paullizer
Merge remote-tracking branch 'origin/Development' into fix/1031-tabul…
1d7c651
…ar-row-orchestration-scale
# Conflicts:
#	application/single_app/config.py
#	docs/explanation/release_notes.md
@paullizer
Fix duplicate data management restore review route
c7b0dbb
@paullizer
Remove generated migration state artifacts
b3a7612
github-advanced-security[bot]
github-advanced-securityBot found potential problems Aug 4, 2026
View reviewed changes
Comment threadapplication/single_app/functions_assistant_table_exports.py Fixed
Comment threadapplication/single_app/functions_assistant_table_exports.py Fixed
Comment threadfunctional_tests/test_document_action_token_usage_aggregation.py Fixed
Comment threadfunctional_tests/test_document_action_token_usage_aggregation.py Fixed
Comment threadapplication/single_app/functions_tabular_generated_exports.py Dismissed
Comment threadfunctional_tests/test_mixed_source_chat_search_consistency.py Dismissed
Comment threadfunctional_tests/test_mixed_source_chat_search_consistency.py Dismissed
Comment threadfunctional_tests/test_mixed_source_chat_search_consistency.py Dismissed
Comment threadfunctional_tests/test_tabular_document_actions_workflow.py Dismissed
Comment threadfunctional_tests/test_tabular_row_orchestration_scale.py Dismissed
@paullizer

Paul Lizer (paullizer) commented Aug 4, 2026

Copy link
Copy Markdown
CollaboratorAuthor

CodeQL remediation update for alert 30 / plan item 10: removed the duplicate local \json\ import from \chat_stream_api, relying on the existing module-level import. Bumped app version to \

@paullizer

Paul Lizer (paullizer) commented Aug 4, 2026

Copy link
Copy Markdown
CollaboratorAuthor

Resolved the PR branch conflicts by merging latest \Development\ into \ ix/1031-tabular-row-orchestration-scale\ and pushed merge commit \

github-advanced-security[bot]
github-advanced-securityBot found potential problems Aug 4, 2026
View reviewed changes
Comment threadfunctional_tests/test_chat_semantic_kernel_return_contract.py Dismissed
@paullizer
Paul Lizer (paullizer) merged commit 2390e11 into DevelopmentAug 4, 2026
12 checks passed
This was referenced Aug 18, 2026
Closed
Merged
Chad Palmer (chadpalmer) pushed a commit to Xeelee33/simplechat that referenced this pull request Aug 20, 2026
@paullizer
Link release note issue references and archive pre-v0.230.001 notes
8516ae2
Release notes referenced issues as bare `microsoft#1289` or `microsoft#1145`.
Those render as plain text on the docs site, where kramdown does not autolink
them, so the references were unusable for readers.
- Linkify all 165 references inside `(Ref: ...)` blocks as absolute Markdown
links. Each number was classified against the GitHub API first, so the 11
pull request references point at `/pull/` rather than `/issues/`.
- Backfill three entries whose shipping PR named an issue the note omitted.
Four further candidates were rejected because their PR bundled two unrelated
fixes and naming its issue would have credited the wrong bullet.
- Move v0.229.063 and older into `archive_release_notes.md`, cutting the current
page from 4,781 to 3,797 lines. The move is byte-faithful and verified by
reconstructing the original file from the two halves.
- Link the archive from the bottom of the release notes and from the docs
sidebar under Deep reference.
Scoping the rewrite to `(Ref: ...)` blocks is deliberate: the notes also contain
prose such as "**Issue #1 - DOM Manipulation Error**", which is a list number
rather than a GitHub reference.
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

1 more reviewer
@github-advanced-securitygithub-advanced-security[bot]github-advanced-security[bot] left review comments
Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@paullizer@github-advanced-security