Skip to content

Fix processed data exporter + add more export options - #47

Draft
epbrenner wants to merge 2 commits into
mainfrom
data-exporter-hmmer-updates
Draft

Fix processed data exporter + add more export options#47
epbrenner wants to merge 2 commits into
mainfrom
data-exporter-hmmer-updates

Conversation

@epbrenner

Copy link
Copy Markdown
Contributor

Updated exportProcessedData() to use the new manifest JSON to fetch HMMER databases that were run and produce appropriate output tables, added dyad export functionality to exportProcessedData(), added buildDyadFeatureMap() to default runDataProcessing() workflow and added option to invoke exportProcessedData() as part of the workflow.

Updated some old, crusty function definitions throughout.

To-do:
Regenerate documentation properly
Test on other hardware for export functionality
Find ways to break it

To test:
prepareGenomes("Staphylococcus argenteus")
or your favorite bug

runDataProcessing("data/Staphylococcus_argenteus/Sar.duckdb"), export_tabular_data = TRUE, hmmer_databases = c("COG, DefenseCas"))
Check out those tables

exportProcessedData("data/Staphylococcus_argenteus/Sar.duckdb", export_formats = ("tsv", "parquet"), export_dyads = TRUE, amr_phenotype_mode = "append")
And all the other wacky variants you can dream up.

Allows exportProcessedData function to handle dynamic HMMER data using the manifest, removed old mention of domains, and added in a helper and exportProcessedData parameter to export a dyad feature table mapping all features linked to that dyad as a little bonus.
Updated stale documentation throughout, changed a parameter name (Total_proteins -> total_proteins), wired @AbhirupaGhosh's dyad exporter into `runDataProcessing()`, and added `exportProcessedData()` into `runDataProcessing()`.
@epbrennerepbrenner self-assigned this Aug 20, 2026
@epbrennerepbrenner added bug Something isn't working enhancement New feature or request labels Aug 20, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bugSomething isn't workingenhancementNew feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@epbrenner