Merge v1 Feature Branch to Main - #535

Closed
tasansal wants to merge 65 commits into
mainfrom
v1
Closed

Merge v1 Feature Branch to Main#535
tasansal wants to merge 65 commits into
mainfrom
v1

Conversation

@tasansal

@tasansaltasansal commented Apr 29, 2025

Copy link
Copy Markdown
Contributor

No description provided.

@tasansal
tasansalforce-pushed the v1 branch 7 times, most recently from d72eea6 to 4be3d15CompareApril 30, 2025 14:56
@BrianMichell

BrianMichell commented Apr 30, 2025•
edited
Loading

Copy link
Copy Markdown
Collaborator

Adding tasks for progress tracking. Will continue to update this comment as the process evolves and tasks begin work.

Private API

SEG-Y to MDIO metadata

  • Distributed Statistics
  • SEG-Y headers

User API

Constructor

Reading

  • Implementation

Structure Copy

  • Implementation

Writing

  • Implementation
  • Save factory created dataset

SEG-Y to MDIO

Templates for Seismic Data Models

  • Input Dataset schema as parameter
  • SEG-Y Schema Parameterization

MDIO to SEG-Y

  • SEG-Y Schema Parameterization
  • Xarray Compatibility

dmitriyrepinand others added 3 commits June 24, 2025 20:17
@dmitriyrepin
schema_v1-dataset_builder-add_dimension
9dd9fbc
@BrianMichell
V1 schema review (#553)
5816f83
* Update from list to discrete values for coordinate metadata
* Add docs to help users understand difference
* Update docs and fix case sensitivity.
* Linting
* Add CoordianteMetadata to docs
@dmitriyrepin
Merge remote-tracking branch 'upstream/v1' into v1
f88531e
dmitriyrepinand others added 28 commits July 9, 2025 19:10
@dmitriyrepin
PR Review: improve unit tests by extracting common functionality in v…
99fcf43
…alidate* functions
@dmitriyrepin
Remove the Dockerfile changes. They are not supposed to be a part of …
0778fdd
…this PR
@dmitriyrepin
PR Review: run ruff
7e74567
@dmitriyrepin
PR Review: fix pre-commit errors
0aaa5f6
@tasansal
remove some noqa overrides
1904dee
@dmitriyrepin@tasansal
Implement MDIO Dataset builder to create in-memory instance of schema…
90d31a1
…s.v1.dataset.Dataset (#568)
* schema_v1-dataset_builder-add_dimension
* First take on add_dimension(), add_coordinate(), add_variable()
* Finished add_dimension, add_coordinate, add_variable
* Work on build
* Generalize _to_dictionary()
* build
* Dataset Build - pass one
* Revert .container changes
* PR review: remove DEVELOPER_NOTES.md
* PR Review: add_coordinate() should accept only data_type: ScalarType
* PR review: add_variable() data_type remove default
* RE review: do not add dimension variable
* PR Review: get api version from the package version
* PR Review: remove add_dimension_coordinate
* PR Review: add_coordinate() remove data_type default value
* PR Review: improve unit tests by extracting common functionality in validate* functions
* Remove the Dockerfile changes. They are not supposed to be a part of this PR
* PR Review: run ruff
* PR Review: fix pre-commit errors
* remove some noqa overrides
---------
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
@dmitriyrepin
Writing XArray / Zarr
4c7c833
@dmitriyrepin
gitignore
4b39ffa
@dmitriyrepin
Merge remote-tracking branch 'upstream/v1' into v1
e772a4f
@dmitriyrepin
to_zarr() fix compression
cea7308
@dmitriyrepin
Fix precommit issues
850135e
@dmitriyrepin
Use only make_campos_3d_acceptance_dataset
82f1960
@dmitriyrepin
PR Review: address the review comments
b5ee31e
@dmitriyrepin
Update _get_fill_value for StructuredType
7b3ba70
@dmitriyrepin
Fix fill type issue for the Structured Types
a4ff4a9
@dmitriyrepin
Improve code coverage
81bfa76
@dmitriyrepin
Fix spelling
0447659
@dmitriyrepin
Revert "Fix spelling"
d08e2c4
This reverts commit 0447659.
@tasansal
extend per-file ignores for PLR2004 and remove noqa overrides in spec…
657d2cf
…ific tests
@tasansal
Refactor tests: clarify Zarr-related test names, fix type hints, and …
bfab1d7
…clean unused `# noqa` comments.
@tasansal
merge main into v1
9a033de
@dmitriyrepin
MDIO v1 Templates and Template Registry (#573)
5878e97
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
@tasansal
Merge branch 'main' into v1
aaf8fc6
# Conflicts:
#	docs/requirements.txt
#	pyproject.toml
#	uv.lock
@tasansal
update deps
bc35bdf
@tasansal
Merge branch 'main' into v1
3b62d8f
@tasansal
Merge branch 'main' into v1
aae5f51
@dmitriyrepin@tasansal
address issues with VS Code dev containers (see issue 559) (#576)
d21278c
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
* Dockerfile.dev
---------
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
@dmitriyrepinDmitriy Repin
@tasansal@BrianMichell
segy_to_mdio_v1 (#577)
d3a7da2
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
* Dockerfile.dev
* segy_to_mdio_v1
* Clean up
* Prototype review notes
* Add dev comment
* Add notes that will be deleted later
* segy_to_mdio_v1 pass 1
* indexing_v1 and blocked_io_v1
* Remove DEV notes
* Clean up
* Document bug location
* Work around IndexError
* Clean temporary code
* More clean up
* Remove *_1 infrastructure files
* Restore accidently removed dask.array
* Created an issue reproducer
* Make the required template properties public
* Simplify type converter
* Improve templates
* Move test_type_converter.py
* Move test_type_converter.py
* Revert to use the original grid
* Integrate segy_to_mdio_v1_customized, fix indexing
* Add dimension coordinates in tem,plates
* Write statistics to Zarr
* Delete factory_v1.py
* Complete integrationtest. Fix coordinates
* Fir pre-commit errors
* PR review: fix trace_worker docstring
* Review: address some of the issue
* Fix bug
* dding todo for sum squares calculation
* Refactor ChunkIterator
* Refactor ChunkIterator into ChunkIteratorV1
* Remove segy_to_mdio_v1_customized, dataset_serializer.to_zarr
* Add support for trace headers without using _FillValue
* Use StorageLocation in trace_worker_v1
* Fix statistics attribute name
* PR review changes
* PR Improvements: do a single write
* TODO: chunked write for non-dimensional coordinates and trace_mask
* Update StorageLocation to use fsspec
* Reformat with pre-commit
* Use domain name in get_grid_plan
* Fix non-dim coords and chunk_samples=False
* Convert test_3d_import_v1 to V1
* Fix test_meta_dataset_read
* remove whitespace
* clean up comments
* update deps in lockfile
* simplify dim and non-dim coordinate handling after scan
* remove compatibility tests
* add filtering capability to header worker
* accept subset filter to pass to workers
* make v1 grid planner awesome
* double to single underscores in test names
* fix broken test harnesses due to incorrect Sequence import
* clean up dev comment
* clean up whitespace
* use new module name
* clean up segy_to_mdio_v1
* fix whitespace and remove unnecessary list call
* these are defined as float64 in template
Previous check was passing due to an error in assignment during creation of coordinate variables
* fix missing dimension coordinate for vertical axis
* fix incorrect dtype comparison for time variable
* simplify and fix critical bugs
* rename v1 out of things and get rid of old code
* remove fixed todo
* remove more v1 from names
* rename chunk iterator
* fix dimensionality in tests due to new (missing) vertical dimension coordinate
* add todo for numpy ingestion
* fix references to non-v1 naming
* extract grid operations to its own function
* fix typo
Co-authored-by: Brian Michell <brianm314@comcast.net>
* add todo for simplifying storage location
* Remove no_fill_var_names, add domain var to Seismic3DPreStackShotTemplate
* Part 2 of the previous commit
* pre-commit formatting
* remove dev mount
---------
Co-authored-by: Dmitriy Repin <dmitriy_repin@epam.com>
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
Co-authored-by: Brian Michell <brianm314@comcast.net>
@tasansal

tasansal commented Aug 8, 2025

Copy link
Copy Markdown
ContributorAuthor

superseeded by #577

@tasansaltasansal closed this Aug 8, 2025
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@tasansaltasansal

@brian-michellbrian-michell

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@tasansal@BrianMichell@brian-michell@dmitriyrepin
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all 
 blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '

Skip to content
Merge v1 Feature Branch to Main - #535
Closed
tasansal wants to merge 65 commits into
mainfrom 
v1
Closed
Merge v1 Feature Branch to Main#535
tasansal wants to merge 65 commits into
mainfrom 
v1
Conversation
@tasansal
@tasansaltasansal
commented
Apr 29, 2025

Copy link


Copy Markdown

Contributor
 No description provided. 
@tasansal
tasansalforce-pushed
the
v1
branch
7 times, most recently
from
d72eea6 to
4be3d15CompareApril 30, 2025 14:56
@BrianMichell
BrianMichell
commented
Apr 30, 2025•

edited

Loading

Copy link


Copy Markdown

Collaborator
Adding tasks for progress tracking. Will continue to update this comment as the process evolves and tasks begin work.
Private API
SEG-Y to MDIO metadata
  •  Distributed Statistics
  •  SEG-Y headers
User API
Constructor
Reading
  •  Implementation
Structure Copy
  •  Implementation
Writing
  •  Implementation
  •  Save factory created dataset
SEG-Y to MDIO
Templates for Seismic Data Models
  •  Input Dataset schema as parameter
  •  SEG-Y Schema Parameterization
MDIO to SEG-Y
  •  SEG-Y Schema Parameterization
  •  Xarray Compatibility
dmitriyrepinand others
added 3 commits
June 24, 2025 20:17
@dmitriyrepin
schema_v1-dataset_builder-add_dimension
9dd9fbc
@BrianMichell
V1 schema review (#553)
5816f83
* Update from list to discrete values for coordinate metadata
* Add docs to help users understand difference
* Update docs and fix case sensitivity.
* Linting
* Add CoordianteMetadata to docs
@dmitriyrepin
Merge remote-tracking branch 'upstream/v1' into v1
f88531e
dmitriyrepinand others
added 28 commits
July 9, 2025 19:10
@dmitriyrepin
PR Review: improve unit tests by extracting common functionality in v…
99fcf43
…alidate* functions
@dmitriyrepin
Remove the Dockerfile changes. They are not supposed to be a part of …
0778fdd
…this PR
@dmitriyrepin
PR Review: run ruff
7e74567
@dmitriyrepin
PR Review: fix pre-commit errors
0aaa5f6
@tasansal
remove some noqa overrides
1904dee
@dmitriyrepin@tasansal
Implement MDIO Dataset builder to create in-memory instance of schema…
90d31a1
…s.v1.dataset.Dataset (#568)
* schema_v1-dataset_builder-add_dimension
* First take on add_dimension(), add_coordinate(), add_variable()
* Finished add_dimension, add_coordinate, add_variable
* Work on build
* Generalize _to_dictionary()
* build
* Dataset Build - pass one
* Revert .container changes
* PR review: remove DEVELOPER_NOTES.md
* PR Review: add_coordinate() should accept only data_type: ScalarType
* PR review: add_variable() data_type remove default
* RE review: do not add dimension variable
* PR Review: get api version from the package version
* PR Review: remove add_dimension_coordinate
* PR Review: add_coordinate() remove data_type default value
* PR Review: improve unit tests by extracting common functionality in validate* functions
* Remove the Dockerfile changes. They are not supposed to be a part of this PR
* PR Review: run ruff
* PR Review: fix pre-commit errors
* remove some noqa overrides
---------
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
@dmitriyrepin
Writing XArray / Zarr
4c7c833
@dmitriyrepin
gitignore
4b39ffa
@dmitriyrepin
Merge remote-tracking branch 'upstream/v1' into v1
e772a4f
@dmitriyrepin
to_zarr() fix compression
cea7308
@dmitriyrepin
Fix precommit issues
850135e
@dmitriyrepin
Use only make_campos_3d_acceptance_dataset
82f1960
@dmitriyrepin
PR Review: address the review comments
b5ee31e
@dmitriyrepin
Update _get_fill_value for StructuredType
7b3ba70
@dmitriyrepin
Fix fill type issue for the Structured Types
a4ff4a9
@dmitriyrepin
Improve code coverage
81bfa76
@dmitriyrepin
Fix spelling
0447659
@dmitriyrepin
Revert "Fix spelling"
d08e2c4
This reverts commit 0447659.
@tasansal
extend per-file ignores for PLR2004 and remove noqa overrides in spec…
657d2cf
…ific tests
@tasansal
Refactor tests: clarify Zarr-related test names, fix type hints, and …
bfab1d7
…clean unused `# noqa` comments.
@tasansal
merge main into v1
9a033de
@dmitriyrepin
MDIO v1 Templates and Template Registry (#573)
5878e97
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
@tasansal
Merge branch 'main' into v1
aaf8fc6
# Conflicts:
#	docs/requirements.txt
#	pyproject.toml
#	uv.lock
@tasansal
update deps
bc35bdf
@tasansal
Merge branch 'main' into v1
3b62d8f
@tasansal
Merge branch 'main' into v1
aae5f51
@dmitriyrepin@tasansal
address issues with VS Code dev containers (see issue 559) (#576)
d21278c
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
* Dockerfile.dev
---------
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
@dmitriyrepinDmitriy Repin
@tasansal@BrianMichell
segy_to_mdio_v1 (#577)
d3a7da2
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
* Dockerfile.dev
* segy_to_mdio_v1
* Clean up
* Prototype review notes
* Add dev comment
* Add notes that will be deleted later
* segy_to_mdio_v1 pass 1
* indexing_v1 and blocked_io_v1
* Remove DEV notes
* Clean up
* Document bug location
* Work around IndexError
* Clean temporary code
* More clean up
* Remove *_1 infrastructure files
* Restore accidently removed dask.array
* Created an issue reproducer
* Make the required template properties public
* Simplify type converter
* Improve templates
* Move test_type_converter.py
* Move test_type_converter.py
* Revert to use the original grid
* Integrate segy_to_mdio_v1_customized, fix indexing
* Add dimension coordinates in tem,plates
* Write statistics to Zarr
* Delete factory_v1.py
* Complete integrationtest. Fix coordinates
* Fir pre-commit errors
* PR review: fix trace_worker docstring
* Review: address some of the issue
* Fix bug
* dding todo for sum squares calculation
* Refactor ChunkIterator
* Refactor ChunkIterator into ChunkIteratorV1
* Remove segy_to_mdio_v1_customized, dataset_serializer.to_zarr
* Add support for trace headers without using _FillValue
* Use StorageLocation in trace_worker_v1
* Fix statistics attribute name
* PR review changes
* PR Improvements: do a single write
* TODO: chunked write for non-dimensional coordinates and trace_mask
* Update StorageLocation to use fsspec
* Reformat with pre-commit
* Use domain name in get_grid_plan
* Fix non-dim coords and chunk_samples=False
* Convert test_3d_import_v1 to V1
* Fix test_meta_dataset_read
* remove whitespace
* clean up comments
* update deps in lockfile
* simplify dim and non-dim coordinate handling after scan
* remove compatibility tests
* add filtering capability to header worker
* accept subset filter to pass to workers
* make v1 grid planner awesome
* double to single underscores in test names
* fix broken test harnesses due to incorrect Sequence import
* clean up dev comment
* clean up whitespace
* use new module name
* clean up segy_to_mdio_v1
* fix whitespace and remove unnecessary list call
* these are defined as float64 in template
Previous check was passing due to an error in assignment during creation of coordinate variables
* fix missing dimension coordinate for vertical axis
* fix incorrect dtype comparison for time variable
* simplify and fix critical bugs
* rename v1 out of things and get rid of old code
* remove fixed todo
* remove more v1 from names
* rename chunk iterator
* fix dimensionality in tests due to new (missing) vertical dimension coordinate
* add todo for numpy ingestion
* fix references to non-v1 naming
* extract grid operations to its own function
* fix typo
Co-authored-by: Brian Michell <brianm314@comcast.net>
* add todo for simplifying storage location
* Remove no_fill_var_names, add domain var to Seismic3DPreStackShotTemplate
* Part 2 of the previous commit
* pre-commit formatting
* remove dev mount
---------
Co-authored-by: Dmitriy Repin <dmitriy_repin@epam.com>
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
Co-authored-by: Brian Michell <brianm314@comcast.net>
@tasansal
tasansal
commented
Aug 8, 2025

Copy link


Copy Markdown

ContributorAuthor
superseeded by #577
@tasansaltasansal
closed this
Aug 8, 2025
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers


No reviews


Assignees

@tasansaltasansal
@brian-michellbrian-michell

Labels


None yet


Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

4 participants

@tasansal@BrianMichell@brian-michell@dmitriyrepin

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix");
}
} catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '

Skip to content
Merge v1 Feature Branch to Main - #535
Closed
tasansal wants to merge 65 commits into
mainfrom 
v1
Closed
Merge v1 Feature Branch to Main#535
tasansal wants to merge 65 commits into
mainfrom 
v1
Conversation
@tasansal
@tasansaltasansal
commented
Apr 29, 2025

Copy link


Copy Markdown

Contributor
 No description provided. 
@tasansal
tasansalforce-pushed
the
v1
branch
7 times, most recently
from
d72eea6 to
4be3d15CompareApril 30, 2025 14:56
@BrianMichell
BrianMichell
commented
Apr 30, 2025•

edited

Loading

Copy link


Copy Markdown

Collaborator
Adding tasks for progress tracking. Will continue to update this comment as the process evolves and tasks begin work.
Private API
SEG-Y to MDIO metadata
  •  Distributed Statistics
  •  SEG-Y headers
User API
Constructor
Reading
  •  Implementation
Structure Copy
  •  Implementation
Writing
  •  Implementation
  •  Save factory created dataset
SEG-Y to MDIO
Templates for Seismic Data Models
  •  Input Dataset schema as parameter
  •  SEG-Y Schema Parameterization
MDIO to SEG-Y
  •  SEG-Y Schema Parameterization
  •  Xarray Compatibility
dmitriyrepinand others
added 3 commits
June 24, 2025 20:17
@dmitriyrepin
schema_v1-dataset_builder-add_dimension
9dd9fbc
@BrianMichell
V1 schema review (#553)
5816f83
* Update from list to discrete values for coordinate metadata
* Add docs to help users understand difference
* Update docs and fix case sensitivity.
* Linting
* Add CoordianteMetadata to docs
@dmitriyrepin
Merge remote-tracking branch 'upstream/v1' into v1
f88531e
dmitriyrepinand others
added 28 commits
July 9, 2025 19:10
@dmitriyrepin
PR Review: improve unit tests by extracting common functionality in v…
99fcf43
…alidate* functions
@dmitriyrepin
Remove the Dockerfile changes. They are not supposed to be a part of …
0778fdd
…this PR
@dmitriyrepin
PR Review: run ruff
7e74567
@dmitriyrepin
PR Review: fix pre-commit errors
0aaa5f6
@tasansal
remove some noqa overrides
1904dee
@dmitriyrepin@tasansal
Implement MDIO Dataset builder to create in-memory instance of schema…
90d31a1
…s.v1.dataset.Dataset (#568)
* schema_v1-dataset_builder-add_dimension
* First take on add_dimension(), add_coordinate(), add_variable()
* Finished add_dimension, add_coordinate, add_variable
* Work on build
* Generalize _to_dictionary()
* build
* Dataset Build - pass one
* Revert .container changes
* PR review: remove DEVELOPER_NOTES.md
* PR Review: add_coordinate() should accept only data_type: ScalarType
* PR review: add_variable() data_type remove default
* RE review: do not add dimension variable
* PR Review: get api version from the package version
* PR Review: remove add_dimension_coordinate
* PR Review: add_coordinate() remove data_type default value
* PR Review: improve unit tests by extracting common functionality in validate* functions
* Remove the Dockerfile changes. They are not supposed to be a part of this PR
* PR Review: run ruff
* PR Review: fix pre-commit errors
* remove some noqa overrides
---------
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
@dmitriyrepin
Writing XArray / Zarr
4c7c833
@dmitriyrepin
gitignore
4b39ffa
@dmitriyrepin
Merge remote-tracking branch 'upstream/v1' into v1
e772a4f
@dmitriyrepin
to_zarr() fix compression
cea7308
@dmitriyrepin
Fix precommit issues
850135e
@dmitriyrepin
Use only make_campos_3d_acceptance_dataset
82f1960
@dmitriyrepin
PR Review: address the review comments
b5ee31e
@dmitriyrepin
Update _get_fill_value for StructuredType
7b3ba70
@dmitriyrepin
Fix fill type issue for the Structured Types
a4ff4a9
@dmitriyrepin
Improve code coverage
81bfa76
@dmitriyrepin
Fix spelling
0447659
@dmitriyrepin
Revert "Fix spelling"
d08e2c4
This reverts commit 0447659.
@tasansal
extend per-file ignores for PLR2004 and remove noqa overrides in spec…
657d2cf
…ific tests
@tasansal
Refactor tests: clarify Zarr-related test names, fix type hints, and …
bfab1d7
…clean unused `# noqa` comments.
@tasansal
merge main into v1
9a033de
@dmitriyrepin
MDIO v1 Templates and Template Registry (#573)
5878e97
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
@tasansal
Merge branch 'main' into v1
aaf8fc6
# Conflicts:
#	docs/requirements.txt
#	pyproject.toml
#	uv.lock
@tasansal
update deps
bc35bdf
@tasansal
Merge branch 'main' into v1
3b62d8f
@tasansal
Merge branch 'main' into v1
aae5f51
@dmitriyrepin@tasansal
address issues with VS Code dev containers (see issue 559) (#576)
d21278c
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
* Dockerfile.dev
---------
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
@dmitriyrepinDmitriy Repin
@tasansal@BrianMichell
segy_to_mdio_v1 (#577)
d3a7da2
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
* Dockerfile.dev
* segy_to_mdio_v1
* Clean up
* Prototype review notes
* Add dev comment
* Add notes that will be deleted later
* segy_to_mdio_v1 pass 1
* indexing_v1 and blocked_io_v1
* Remove DEV notes
* Clean up
* Document bug location
* Work around IndexError
* Clean temporary code
* More clean up
* Remove *_1 infrastructure files
* Restore accidently removed dask.array
* Created an issue reproducer
* Make the required template properties public
* Simplify type converter
* Improve templates
* Move test_type_converter.py
* Move test_type_converter.py
* Revert to use the original grid
* Integrate segy_to_mdio_v1_customized, fix indexing
* Add dimension coordinates in tem,plates
* Write statistics to Zarr
* Delete factory_v1.py
* Complete integrationtest. Fix coordinates
* Fir pre-commit errors
* PR review: fix trace_worker docstring
* Review: address some of the issue
* Fix bug
* dding todo for sum squares calculation
* Refactor ChunkIterator
* Refactor ChunkIterator into ChunkIteratorV1
* Remove segy_to_mdio_v1_customized, dataset_serializer.to_zarr
* Add support for trace headers without using _FillValue
* Use StorageLocation in trace_worker_v1
* Fix statistics attribute name
* PR review changes
* PR Improvements: do a single write
* TODO: chunked write for non-dimensional coordinates and trace_mask
* Update StorageLocation to use fsspec
* Reformat with pre-commit
* Use domain name in get_grid_plan
* Fix non-dim coords and chunk_samples=False
* Convert test_3d_import_v1 to V1
* Fix test_meta_dataset_read
* remove whitespace
* clean up comments
* update deps in lockfile
* simplify dim and non-dim coordinate handling after scan
* remove compatibility tests
* add filtering capability to header worker
* accept subset filter to pass to workers
* make v1 grid planner awesome
* double to single underscores in test names
* fix broken test harnesses due to incorrect Sequence import
* clean up dev comment
* clean up whitespace
* use new module name
* clean up segy_to_mdio_v1
* fix whitespace and remove unnecessary list call
* these are defined as float64 in template
Previous check was passing due to an error in assignment during creation of coordinate variables
* fix missing dimension coordinate for vertical axis
* fix incorrect dtype comparison for time variable
* simplify and fix critical bugs
* rename v1 out of things and get rid of old code
* remove fixed todo
* remove more v1 from names
* rename chunk iterator
* fix dimensionality in tests due to new (missing) vertical dimension coordinate
* add todo for numpy ingestion
* fix references to non-v1 naming
* extract grid operations to its own function
* fix typo
Co-authored-by: Brian Michell <brianm314@comcast.net>
* add todo for simplifying storage location
* Remove no_fill_var_names, add domain var to Seismic3DPreStackShotTemplate
* Part 2 of the previous commit
* pre-commit formatting
* remove dev mount
---------
Co-authored-by: Dmitriy Repin <dmitriy_repin@epam.com>
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
Co-authored-by: Brian Michell <brianm314@comcast.net>
@tasansal
tasansal
commented
Aug 8, 2025

Copy link


Copy Markdown

ContributorAuthor
superseeded by #577
@tasansaltasansal
closed this
Aug 8, 2025
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers


No reviews


Assignees

@tasansaltasansal
@brian-michellbrian-michell

Labels


None yet


Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

4 participants

@tasansal@BrianMichell@brian-michell@dmitriyrepin

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms");
}
} catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '

Skip to content
Merge v1 Feature Branch to Main - #535
Closed
tasansal wants to merge 65 commits into
mainfrom 
v1
Closed
Merge v1 Feature Branch to Main#535
tasansal wants to merge 65 commits into
mainfrom 
v1
Conversation
@tasansal
@tasansaltasansal
commented
Apr 29, 2025

Copy link


Copy Markdown

Contributor
 No description provided. 
@tasansal
tasansalforce-pushed
the
v1
branch
7 times, most recently
from
d72eea6 to
4be3d15CompareApril 30, 2025 14:56
@BrianMichell
BrianMichell
commented
Apr 30, 2025•

edited

Loading

Copy link


Copy Markdown

Collaborator
Adding tasks for progress tracking. Will continue to update this comment as the process evolves and tasks begin work.
Private API
SEG-Y to MDIO metadata
  •  Distributed Statistics
  •  SEG-Y headers
User API
Constructor
Reading
  •  Implementation
Structure Copy
  •  Implementation
Writing
  •  Implementation
  •  Save factory created dataset
SEG-Y to MDIO
Templates for Seismic Data Models
  •  Input Dataset schema as parameter
  •  SEG-Y Schema Parameterization
MDIO to SEG-Y
  •  SEG-Y Schema Parameterization
  •  Xarray Compatibility
dmitriyrepinand others
added 3 commits
June 24, 2025 20:17
@dmitriyrepin
schema_v1-dataset_builder-add_dimension
9dd9fbc
@BrianMichell
V1 schema review (#553)
5816f83
* Update from list to discrete values for coordinate metadata
* Add docs to help users understand difference
* Update docs and fix case sensitivity.
* Linting
* Add CoordianteMetadata to docs
@dmitriyrepin
Merge remote-tracking branch 'upstream/v1' into v1
f88531e
dmitriyrepinand others
added 28 commits
July 9, 2025 19:10
@dmitriyrepin
PR Review: improve unit tests by extracting common functionality in v…
99fcf43
…alidate* functions
@dmitriyrepin
Remove the Dockerfile changes. They are not supposed to be a part of …
0778fdd
…this PR
@dmitriyrepin
PR Review: run ruff
7e74567
@dmitriyrepin
PR Review: fix pre-commit errors
0aaa5f6
@tasansal
remove some noqa overrides
1904dee
@dmitriyrepin@tasansal
Implement MDIO Dataset builder to create in-memory instance of schema…
90d31a1
…s.v1.dataset.Dataset (#568)
* schema_v1-dataset_builder-add_dimension
* First take on add_dimension(), add_coordinate(), add_variable()
* Finished add_dimension, add_coordinate, add_variable
* Work on build
* Generalize _to_dictionary()
* build
* Dataset Build - pass one
* Revert .container changes
* PR review: remove DEVELOPER_NOTES.md
* PR Review: add_coordinate() should accept only data_type: ScalarType
* PR review: add_variable() data_type remove default
* RE review: do not add dimension variable
* PR Review: get api version from the package version
* PR Review: remove add_dimension_coordinate
* PR Review: add_coordinate() remove data_type default value
* PR Review: improve unit tests by extracting common functionality in validate* functions
* Remove the Dockerfile changes. They are not supposed to be a part of this PR
* PR Review: run ruff
* PR Review: fix pre-commit errors
* remove some noqa overrides
---------
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
@dmitriyrepin
Writing XArray / Zarr
4c7c833
@dmitriyrepin
gitignore
4b39ffa
@dmitriyrepin
Merge remote-tracking branch 'upstream/v1' into v1
e772a4f
@dmitriyrepin
to_zarr() fix compression
cea7308
@dmitriyrepin
Fix precommit issues
850135e
@dmitriyrepin
Use only make_campos_3d_acceptance_dataset
82f1960
@dmitriyrepin
PR Review: address the review comments
b5ee31e
@dmitriyrepin
Update _get_fill_value for StructuredType
7b3ba70
@dmitriyrepin
Fix fill type issue for the Structured Types
a4ff4a9
@dmitriyrepin
Improve code coverage
81bfa76
@dmitriyrepin
Fix spelling
0447659
@dmitriyrepin
Revert "Fix spelling"
d08e2c4
This reverts commit 0447659.
@tasansal
extend per-file ignores for PLR2004 and remove noqa overrides in spec…
657d2cf
…ific tests
@tasansal
Refactor tests: clarify Zarr-related test names, fix type hints, and …
bfab1d7
…clean unused `# noqa` comments.
@tasansal
merge main into v1
9a033de
@dmitriyrepin
MDIO v1 Templates and Template Registry (#573)
5878e97
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
@tasansal
Merge branch 'main' into v1
aaf8fc6
# Conflicts:
#	docs/requirements.txt
#	pyproject.toml
#	uv.lock
@tasansal
update deps
bc35bdf
@tasansal
Merge branch 'main' into v1
3b62d8f
@tasansal
Merge branch 'main' into v1
aae5f51
@dmitriyrepin@tasansal
address issues with VS Code dev containers (see issue 559) (#576)
d21278c
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
* Dockerfile.dev
---------
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
@dmitriyrepinDmitriy Repin
@tasansal@BrianMichell
segy_to_mdio_v1 (#577)
d3a7da2
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
* Dockerfile.dev
* segy_to_mdio_v1
* Clean up
* Prototype review notes
* Add dev comment
* Add notes that will be deleted later
* segy_to_mdio_v1 pass 1
* indexing_v1 and blocked_io_v1
* Remove DEV notes
* Clean up
* Document bug location
* Work around IndexError
* Clean temporary code
* More clean up
* Remove *_1 infrastructure files
* Restore accidently removed dask.array
* Created an issue reproducer
* Make the required template properties public
* Simplify type converter
* Improve templates
* Move test_type_converter.py
* Move test_type_converter.py
* Revert to use the original grid
* Integrate segy_to_mdio_v1_customized, fix indexing
* Add dimension coordinates in tem,plates
* Write statistics to Zarr
* Delete factory_v1.py
* Complete integrationtest. Fix coordinates
* Fir pre-commit errors
* PR review: fix trace_worker docstring
* Review: address some of the issue
* Fix bug
* dding todo for sum squares calculation
* Refactor ChunkIterator
* Refactor ChunkIterator into ChunkIteratorV1
* Remove segy_to_mdio_v1_customized, dataset_serializer.to_zarr
* Add support for trace headers without using _FillValue
* Use StorageLocation in trace_worker_v1
* Fix statistics attribute name
* PR review changes
* PR Improvements: do a single write
* TODO: chunked write for non-dimensional coordinates and trace_mask
* Update StorageLocation to use fsspec
* Reformat with pre-commit
* Use domain name in get_grid_plan
* Fix non-dim coords and chunk_samples=False
* Convert test_3d_import_v1 to V1
* Fix test_meta_dataset_read
* remove whitespace
* clean up comments
* update deps in lockfile
* simplify dim and non-dim coordinate handling after scan
* remove compatibility tests
* add filtering capability to header worker
* accept subset filter to pass to workers
* make v1 grid planner awesome
* double to single underscores in test names
* fix broken test harnesses due to incorrect Sequence import
* clean up dev comment
* clean up whitespace
* use new module name
* clean up segy_to_mdio_v1
* fix whitespace and remove unnecessary list call
* these are defined as float64 in template
Previous check was passing due to an error in assignment during creation of coordinate variables
* fix missing dimension coordinate for vertical axis
* fix incorrect dtype comparison for time variable
* simplify and fix critical bugs
* rename v1 out of things and get rid of old code
* remove fixed todo
* remove more v1 from names
* rename chunk iterator
* fix dimensionality in tests due to new (missing) vertical dimension coordinate
* add todo for numpy ingestion
* fix references to non-v1 naming
* extract grid operations to its own function
* fix typo
Co-authored-by: Brian Michell <brianm314@comcast.net>
* add todo for simplifying storage location
* Remove no_fill_var_names, add domain var to Seismic3DPreStackShotTemplate
* Part 2 of the previous commit
* pre-commit formatting
* remove dev mount
---------
Co-authored-by: Dmitriy Repin <dmitriy_repin@epam.com>
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
Co-authored-by: Brian Michell <brianm314@comcast.net>
@tasansal
tasansal
commented
Aug 8, 2025

Copy link


Copy Markdown

ContributorAuthor
superseeded by #577
@tasansaltasansal
closed this
Aug 8, 2025
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers


No reviews


Assignees

@tasansaltasansal
@brian-michellbrian-michell

Labels


None yet


Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

4 participants

@tasansal@BrianMichell@brian-michell@dmitriyrepin

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links");
}
} catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); }
})();
(function(){
try {
var __m = "youtube.com";
var __re = new RegExp('^' + "youtube\\.com" + '

Skip to content
Merge v1 Feature Branch to Main - #535
Closed
tasansal wants to merge 65 commits into
mainfrom 
v1
Closed
Merge v1 Feature Branch to Main#535
tasansal wants to merge 65 commits into
mainfrom 
v1
Conversation
@tasansal
@tasansaltasansal
commented
Apr 29, 2025

Copy link


Copy Markdown

Contributor
 No description provided. 
@tasansal
tasansalforce-pushed
the
v1
branch
7 times, most recently
from
d72eea6 to
4be3d15CompareApril 30, 2025 14:56
@BrianMichell
BrianMichell
commented
Apr 30, 2025•

edited

Loading

Copy link


Copy Markdown

Collaborator
Adding tasks for progress tracking. Will continue to update this comment as the process evolves and tasks begin work.
Private API
SEG-Y to MDIO metadata
  •  Distributed Statistics
  •  SEG-Y headers
User API
Constructor
Reading
  •  Implementation
Structure Copy
  •  Implementation
Writing
  •  Implementation
  •  Save factory created dataset
SEG-Y to MDIO
Templates for Seismic Data Models
  •  Input Dataset schema as parameter
  •  SEG-Y Schema Parameterization
MDIO to SEG-Y
  •  SEG-Y Schema Parameterization
  •  Xarray Compatibility
dmitriyrepinand others
added 3 commits
June 24, 2025 20:17
@dmitriyrepin
schema_v1-dataset_builder-add_dimension
9dd9fbc
@BrianMichell
V1 schema review (#553)
5816f83
* Update from list to discrete values for coordinate metadata
* Add docs to help users understand difference
* Update docs and fix case sensitivity.
* Linting
* Add CoordianteMetadata to docs
@dmitriyrepin
Merge remote-tracking branch 'upstream/v1' into v1
f88531e
dmitriyrepinand others
added 28 commits
July 9, 2025 19:10
@dmitriyrepin
PR Review: improve unit tests by extracting common functionality in v…
99fcf43
…alidate* functions
@dmitriyrepin
Remove the Dockerfile changes. They are not supposed to be a part of …
0778fdd
…this PR
@dmitriyrepin
PR Review: run ruff
7e74567
@dmitriyrepin
PR Review: fix pre-commit errors
0aaa5f6
@tasansal
remove some noqa overrides
1904dee
@dmitriyrepin@tasansal
Implement MDIO Dataset builder to create in-memory instance of schema…
90d31a1
…s.v1.dataset.Dataset (#568)
* schema_v1-dataset_builder-add_dimension
* First take on add_dimension(), add_coordinate(), add_variable()
* Finished add_dimension, add_coordinate, add_variable
* Work on build
* Generalize _to_dictionary()
* build
* Dataset Build - pass one
* Revert .container changes
* PR review: remove DEVELOPER_NOTES.md
* PR Review: add_coordinate() should accept only data_type: ScalarType
* PR review: add_variable() data_type remove default
* RE review: do not add dimension variable
* PR Review: get api version from the package version
* PR Review: remove add_dimension_coordinate
* PR Review: add_coordinate() remove data_type default value
* PR Review: improve unit tests by extracting common functionality in validate* functions
* Remove the Dockerfile changes. They are not supposed to be a part of this PR
* PR Review: run ruff
* PR Review: fix pre-commit errors
* remove some noqa overrides
---------
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
@dmitriyrepin
Writing XArray / Zarr
4c7c833
@dmitriyrepin
gitignore
4b39ffa
@dmitriyrepin
Merge remote-tracking branch 'upstream/v1' into v1
e772a4f
@dmitriyrepin
to_zarr() fix compression
cea7308
@dmitriyrepin
Fix precommit issues
850135e
@dmitriyrepin
Use only make_campos_3d_acceptance_dataset
82f1960
@dmitriyrepin
PR Review: address the review comments
b5ee31e
@dmitriyrepin
Update _get_fill_value for StructuredType
7b3ba70
@dmitriyrepin
Fix fill type issue for the Structured Types
a4ff4a9
@dmitriyrepin
Improve code coverage
81bfa76
@dmitriyrepin
Fix spelling
0447659
@dmitriyrepin
Revert "Fix spelling"
d08e2c4
This reverts commit 0447659.
@tasansal
extend per-file ignores for PLR2004 and remove noqa overrides in spec…
657d2cf
…ific tests
@tasansal
Refactor tests: clarify Zarr-related test names, fix type hints, and …
bfab1d7
…clean unused `# noqa` comments.
@tasansal
merge main into v1
9a033de
@dmitriyrepin
MDIO v1 Templates and Template Registry (#573)
5878e97
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
@tasansal
Merge branch 'main' into v1
aaf8fc6
# Conflicts:
#	docs/requirements.txt
#	pyproject.toml
#	uv.lock
@tasansal
update deps
bc35bdf
@tasansal
Merge branch 'main' into v1
3b62d8f
@tasansal
Merge branch 'main' into v1
aae5f51
@dmitriyrepin@tasansal
address issues with VS Code dev containers (see issue 559) (#576)
d21278c
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
* Dockerfile.dev
---------
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
@dmitriyrepinDmitriy Repin
@tasansal@BrianMichell
segy_to_mdio_v1 (#577)
d3a7da2
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
* Dockerfile.dev
* segy_to_mdio_v1
* Clean up
* Prototype review notes
* Add dev comment
* Add notes that will be deleted later
* segy_to_mdio_v1 pass 1
* indexing_v1 and blocked_io_v1
* Remove DEV notes
* Clean up
* Document bug location
* Work around IndexError
* Clean temporary code
* More clean up
* Remove *_1 infrastructure files
* Restore accidently removed dask.array
* Created an issue reproducer
* Make the required template properties public
* Simplify type converter
* Improve templates
* Move test_type_converter.py
* Move test_type_converter.py
* Revert to use the original grid
* Integrate segy_to_mdio_v1_customized, fix indexing
* Add dimension coordinates in tem,plates
* Write statistics to Zarr
* Delete factory_v1.py
* Complete integrationtest. Fix coordinates
* Fir pre-commit errors
* PR review: fix trace_worker docstring
* Review: address some of the issue
* Fix bug
* dding todo for sum squares calculation
* Refactor ChunkIterator
* Refactor ChunkIterator into ChunkIteratorV1
* Remove segy_to_mdio_v1_customized, dataset_serializer.to_zarr
* Add support for trace headers without using _FillValue
* Use StorageLocation in trace_worker_v1
* Fix statistics attribute name
* PR review changes
* PR Improvements: do a single write
* TODO: chunked write for non-dimensional coordinates and trace_mask
* Update StorageLocation to use fsspec
* Reformat with pre-commit
* Use domain name in get_grid_plan
* Fix non-dim coords and chunk_samples=False
* Convert test_3d_import_v1 to V1
* Fix test_meta_dataset_read
* remove whitespace
* clean up comments
* update deps in lockfile
* simplify dim and non-dim coordinate handling after scan
* remove compatibility tests
* add filtering capability to header worker
* accept subset filter to pass to workers
* make v1 grid planner awesome
* double to single underscores in test names
* fix broken test harnesses due to incorrect Sequence import
* clean up dev comment
* clean up whitespace
* use new module name
* clean up segy_to_mdio_v1
* fix whitespace and remove unnecessary list call
* these are defined as float64 in template
Previous check was passing due to an error in assignment during creation of coordinate variables
* fix missing dimension coordinate for vertical axis
* fix incorrect dtype comparison for time variable
* simplify and fix critical bugs
* rename v1 out of things and get rid of old code
* remove fixed todo
* remove more v1 from names
* rename chunk iterator
* fix dimensionality in tests due to new (missing) vertical dimension coordinate
* add todo for numpy ingestion
* fix references to non-v1 naming
* extract grid operations to its own function
* fix typo
Co-authored-by: Brian Michell <brianm314@comcast.net>
* add todo for simplifying storage location
* Remove no_fill_var_names, add domain var to Seismic3DPreStackShotTemplate
* Part 2 of the previous commit
* pre-commit formatting
* remove dev mount
---------
Co-authored-by: Dmitriy Repin <dmitriy_repin@epam.com>
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
Co-authored-by: Brian Michell <brianm314@comcast.net>
@tasansal
tasansal
commented
Aug 8, 2025

Copy link


Copy Markdown

ContributorAuthor
superseeded by #577
@tasansaltasansal
closed this
Aug 8, 2025
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers


No reviews


Assignees

@tasansaltasansal
@brian-michellbrian-michell

Labels


None yet


Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

4 participants

@tasansal@BrianMichell@brian-michell@dmitriyrepin

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default");
}
} catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '

Skip to content
Merge v1 Feature Branch to Main - #535
Closed
tasansal wants to merge 65 commits into
mainfrom 
v1
Closed
Merge v1 Feature Branch to Main#535
tasansal wants to merge 65 commits into
mainfrom 
v1
Conversation
@tasansal
@tasansaltasansal
commented
Apr 29, 2025

Copy link


Copy Markdown

Contributor
 No description provided. 
@tasansal
tasansalforce-pushed
the
v1
branch
7 times, most recently
from
d72eea6 to
4be3d15CompareApril 30, 2025 14:56
@BrianMichell
BrianMichell
commented
Apr 30, 2025•

edited

Loading

Copy link


Copy Markdown

Collaborator
Adding tasks for progress tracking. Will continue to update this comment as the process evolves and tasks begin work.
Private API
SEG-Y to MDIO metadata
  •  Distributed Statistics
  •  SEG-Y headers
User API
Constructor
Reading
  •  Implementation
Structure Copy
  •  Implementation
Writing
  •  Implementation
  •  Save factory created dataset
SEG-Y to MDIO
Templates for Seismic Data Models
  •  Input Dataset schema as parameter
  •  SEG-Y Schema Parameterization
MDIO to SEG-Y
  •  SEG-Y Schema Parameterization
  •  Xarray Compatibility
dmitriyrepinand others
added 3 commits
June 24, 2025 20:17
@dmitriyrepin
schema_v1-dataset_builder-add_dimension
9dd9fbc
@BrianMichell
V1 schema review (#553)
5816f83
* Update from list to discrete values for coordinate metadata
* Add docs to help users understand difference
* Update docs and fix case sensitivity.
* Linting
* Add CoordianteMetadata to docs
@dmitriyrepin
Merge remote-tracking branch 'upstream/v1' into v1
f88531e
dmitriyrepinand others
added 28 commits
July 9, 2025 19:10
@dmitriyrepin
PR Review: improve unit tests by extracting common functionality in v…
99fcf43
…alidate* functions
@dmitriyrepin
Remove the Dockerfile changes. They are not supposed to be a part of …
0778fdd
…this PR
@dmitriyrepin
PR Review: run ruff
7e74567
@dmitriyrepin
PR Review: fix pre-commit errors
0aaa5f6
@tasansal
remove some noqa overrides
1904dee
@dmitriyrepin@tasansal
Implement MDIO Dataset builder to create in-memory instance of schema…
90d31a1
…s.v1.dataset.Dataset (#568)
* schema_v1-dataset_builder-add_dimension
* First take on add_dimension(), add_coordinate(), add_variable()
* Finished add_dimension, add_coordinate, add_variable
* Work on build
* Generalize _to_dictionary()
* build
* Dataset Build - pass one
* Revert .container changes
* PR review: remove DEVELOPER_NOTES.md
* PR Review: add_coordinate() should accept only data_type: ScalarType
* PR review: add_variable() data_type remove default
* RE review: do not add dimension variable
* PR Review: get api version from the package version
* PR Review: remove add_dimension_coordinate
* PR Review: add_coordinate() remove data_type default value
* PR Review: improve unit tests by extracting common functionality in validate* functions
* Remove the Dockerfile changes. They are not supposed to be a part of this PR
* PR Review: run ruff
* PR Review: fix pre-commit errors
* remove some noqa overrides
---------
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
@dmitriyrepin
Writing XArray / Zarr
4c7c833
@dmitriyrepin
gitignore
4b39ffa
@dmitriyrepin
Merge remote-tracking branch 'upstream/v1' into v1
e772a4f
@dmitriyrepin
to_zarr() fix compression
cea7308
@dmitriyrepin
Fix precommit issues
850135e
@dmitriyrepin
Use only make_campos_3d_acceptance_dataset
82f1960
@dmitriyrepin
PR Review: address the review comments
b5ee31e
@dmitriyrepin
Update _get_fill_value for StructuredType
7b3ba70
@dmitriyrepin
Fix fill type issue for the Structured Types
a4ff4a9
@dmitriyrepin
Improve code coverage
81bfa76
@dmitriyrepin
Fix spelling
0447659
@dmitriyrepin
Revert "Fix spelling"
d08e2c4
This reverts commit 0447659.
@tasansal
extend per-file ignores for PLR2004 and remove noqa overrides in spec…
657d2cf
…ific tests
@tasansal
Refactor tests: clarify Zarr-related test names, fix type hints, and …
bfab1d7
…clean unused `# noqa` comments.
@tasansal
merge main into v1
9a033de
@dmitriyrepin
MDIO v1 Templates and Template Registry (#573)
5878e97
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
@tasansal
Merge branch 'main' into v1
aaf8fc6
# Conflicts:
#	docs/requirements.txt
#	pyproject.toml
#	uv.lock
@tasansal
update deps
bc35bdf
@tasansal
Merge branch 'main' into v1
3b62d8f
@tasansal
Merge branch 'main' into v1
aae5f51
@dmitriyrepin@tasansal
address issues with VS Code dev containers (see issue 559) (#576)
d21278c
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
* Dockerfile.dev
---------
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
@dmitriyrepinDmitriy Repin
@tasansal@BrianMichell
segy_to_mdio_v1 (#577)
d3a7da2
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
* Dockerfile.dev
* segy_to_mdio_v1
* Clean up
* Prototype review notes
* Add dev comment
* Add notes that will be deleted later
* segy_to_mdio_v1 pass 1
* indexing_v1 and blocked_io_v1
* Remove DEV notes
* Clean up
* Document bug location
* Work around IndexError
* Clean temporary code
* More clean up
* Remove *_1 infrastructure files
* Restore accidently removed dask.array
* Created an issue reproducer
* Make the required template properties public
* Simplify type converter
* Improve templates
* Move test_type_converter.py
* Move test_type_converter.py
* Revert to use the original grid
* Integrate segy_to_mdio_v1_customized, fix indexing
* Add dimension coordinates in tem,plates
* Write statistics to Zarr
* Delete factory_v1.py
* Complete integrationtest. Fix coordinates
* Fir pre-commit errors
* PR review: fix trace_worker docstring
* Review: address some of the issue
* Fix bug
* dding todo for sum squares calculation
* Refactor ChunkIterator
* Refactor ChunkIterator into ChunkIteratorV1
* Remove segy_to_mdio_v1_customized, dataset_serializer.to_zarr
* Add support for trace headers without using _FillValue
* Use StorageLocation in trace_worker_v1
* Fix statistics attribute name
* PR review changes
* PR Improvements: do a single write
* TODO: chunked write for non-dimensional coordinates and trace_mask
* Update StorageLocation to use fsspec
* Reformat with pre-commit
* Use domain name in get_grid_plan
* Fix non-dim coords and chunk_samples=False
* Convert test_3d_import_v1 to V1
* Fix test_meta_dataset_read
* remove whitespace
* clean up comments
* update deps in lockfile
* simplify dim and non-dim coordinate handling after scan
* remove compatibility tests
* add filtering capability to header worker
* accept subset filter to pass to workers
* make v1 grid planner awesome
* double to single underscores in test names
* fix broken test harnesses due to incorrect Sequence import
* clean up dev comment
* clean up whitespace
* use new module name
* clean up segy_to_mdio_v1
* fix whitespace and remove unnecessary list call
* these are defined as float64 in template
Previous check was passing due to an error in assignment during creation of coordinate variables
* fix missing dimension coordinate for vertical axis
* fix incorrect dtype comparison for time variable
* simplify and fix critical bugs
* rename v1 out of things and get rid of old code
* remove fixed todo
* remove more v1 from names
* rename chunk iterator
* fix dimensionality in tests due to new (missing) vertical dimension coordinate
* add todo for numpy ingestion
* fix references to non-v1 naming
* extract grid operations to its own function
* fix typo
Co-authored-by: Brian Michell <brianm314@comcast.net>
* add todo for simplifying storage location
* Remove no_fill_var_names, add domain var to Seismic3DPreStackShotTemplate
* Part 2 of the previous commit
* pre-commit formatting
* remove dev mount
---------
Co-authored-by: Dmitriy Repin <dmitriy_repin@epam.com>
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
Co-authored-by: Brian Michell <brianm314@comcast.net>
@tasansal
tasansal
commented
Aug 8, 2025

Copy link


Copy Markdown

ContributorAuthor
superseeded by #577
@tasansaltasansal
closed this
Aug 8, 2025
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers


No reviews


Assignees

@tasansaltasansal
@brian-michellbrian-michell

Labels


None yet


Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

4 participants

@tasansal@BrianMichell@brian-michell@dmitriyrepin

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers");
}
} catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '

Skip to content
Merge v1 Feature Branch to Main - #535
Closed
tasansal wants to merge 65 commits into
mainfrom 
v1
Closed
Merge v1 Feature Branch to Main#535
tasansal wants to merge 65 commits into
mainfrom 
v1
Conversation
@tasansal
@tasansaltasansal
commented
Apr 29, 2025

Copy link


Copy Markdown

Contributor
 No description provided. 
@tasansal
tasansalforce-pushed
the
v1
branch
7 times, most recently
from
d72eea6 to
4be3d15CompareApril 30, 2025 14:56
@BrianMichell
BrianMichell
commented
Apr 30, 2025•

edited

Loading

Copy link


Copy Markdown

Collaborator
Adding tasks for progress tracking. Will continue to update this comment as the process evolves and tasks begin work.
Private API
SEG-Y to MDIO metadata
  •  Distributed Statistics
  •  SEG-Y headers
User API
Constructor
Reading
  •  Implementation
Structure Copy
  •  Implementation
Writing
  •  Implementation
  •  Save factory created dataset
SEG-Y to MDIO
Templates for Seismic Data Models
  •  Input Dataset schema as parameter
  •  SEG-Y Schema Parameterization
MDIO to SEG-Y
  •  SEG-Y Schema Parameterization
  •  Xarray Compatibility
dmitriyrepinand others
added 3 commits
June 24, 2025 20:17
@dmitriyrepin
schema_v1-dataset_builder-add_dimension
9dd9fbc
@BrianMichell
V1 schema review (#553)
5816f83
* Update from list to discrete values for coordinate metadata
* Add docs to help users understand difference
* Update docs and fix case sensitivity.
* Linting
* Add CoordianteMetadata to docs
@dmitriyrepin
Merge remote-tracking branch 'upstream/v1' into v1
f88531e
dmitriyrepinand others
added 28 commits
July 9, 2025 19:10
@dmitriyrepin
PR Review: improve unit tests by extracting common functionality in v…
99fcf43
…alidate* functions
@dmitriyrepin
Remove the Dockerfile changes. They are not supposed to be a part of …
0778fdd
…this PR
@dmitriyrepin
PR Review: run ruff
7e74567
@dmitriyrepin
PR Review: fix pre-commit errors
0aaa5f6
@tasansal
remove some noqa overrides
1904dee
@dmitriyrepin@tasansal
Implement MDIO Dataset builder to create in-memory instance of schema…
90d31a1
…s.v1.dataset.Dataset (#568)
* schema_v1-dataset_builder-add_dimension
* First take on add_dimension(), add_coordinate(), add_variable()
* Finished add_dimension, add_coordinate, add_variable
* Work on build
* Generalize _to_dictionary()
* build
* Dataset Build - pass one
* Revert .container changes
* PR review: remove DEVELOPER_NOTES.md
* PR Review: add_coordinate() should accept only data_type: ScalarType
* PR review: add_variable() data_type remove default
* RE review: do not add dimension variable
* PR Review: get api version from the package version
* PR Review: remove add_dimension_coordinate
* PR Review: add_coordinate() remove data_type default value
* PR Review: improve unit tests by extracting common functionality in validate* functions
* Remove the Dockerfile changes. They are not supposed to be a part of this PR
* PR Review: run ruff
* PR Review: fix pre-commit errors
* remove some noqa overrides
---------
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
@dmitriyrepin
Writing XArray / Zarr
4c7c833
@dmitriyrepin
gitignore
4b39ffa
@dmitriyrepin
Merge remote-tracking branch 'upstream/v1' into v1
e772a4f
@dmitriyrepin
to_zarr() fix compression
cea7308
@dmitriyrepin
Fix precommit issues
850135e
@dmitriyrepin
Use only make_campos_3d_acceptance_dataset
82f1960
@dmitriyrepin
PR Review: address the review comments
b5ee31e
@dmitriyrepin
Update _get_fill_value for StructuredType
7b3ba70
@dmitriyrepin
Fix fill type issue for the Structured Types
a4ff4a9
@dmitriyrepin
Improve code coverage
81bfa76
@dmitriyrepin
Fix spelling
0447659
@dmitriyrepin
Revert "Fix spelling"
d08e2c4
This reverts commit 0447659.
@tasansal
extend per-file ignores for PLR2004 and remove noqa overrides in spec…
657d2cf
…ific tests
@tasansal
Refactor tests: clarify Zarr-related test names, fix type hints, and …
bfab1d7
…clean unused `# noqa` comments.
@tasansal
merge main into v1
9a033de
@dmitriyrepin
MDIO v1 Templates and Template Registry (#573)
5878e97
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
@tasansal
Merge branch 'main' into v1
aaf8fc6
# Conflicts:
#	docs/requirements.txt
#	pyproject.toml
#	uv.lock
@tasansal
update deps
bc35bdf
@tasansal
Merge branch 'main' into v1
3b62d8f
@tasansal
Merge branch 'main' into v1
aae5f51
@dmitriyrepin@tasansal
address issues with VS Code dev containers (see issue 559) (#576)
d21278c
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
* Dockerfile.dev
---------
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
@dmitriyrepinDmitriy Repin
@tasansal@BrianMichell
segy_to_mdio_v1 (#577)
d3a7da2
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
* Dockerfile.dev
* segy_to_mdio_v1
* Clean up
* Prototype review notes
* Add dev comment
* Add notes that will be deleted later
* segy_to_mdio_v1 pass 1
* indexing_v1 and blocked_io_v1
* Remove DEV notes
* Clean up
* Document bug location
* Work around IndexError
* Clean temporary code
* More clean up
* Remove *_1 infrastructure files
* Restore accidently removed dask.array
* Created an issue reproducer
* Make the required template properties public
* Simplify type converter
* Improve templates
* Move test_type_converter.py
* Move test_type_converter.py
* Revert to use the original grid
* Integrate segy_to_mdio_v1_customized, fix indexing
* Add dimension coordinates in tem,plates
* Write statistics to Zarr
* Delete factory_v1.py
* Complete integrationtest. Fix coordinates
* Fir pre-commit errors
* PR review: fix trace_worker docstring
* Review: address some of the issue
* Fix bug
* dding todo for sum squares calculation
* Refactor ChunkIterator
* Refactor ChunkIterator into ChunkIteratorV1
* Remove segy_to_mdio_v1_customized, dataset_serializer.to_zarr
* Add support for trace headers without using _FillValue
* Use StorageLocation in trace_worker_v1
* Fix statistics attribute name
* PR review changes
* PR Improvements: do a single write
* TODO: chunked write for non-dimensional coordinates and trace_mask
* Update StorageLocation to use fsspec
* Reformat with pre-commit
* Use domain name in get_grid_plan
* Fix non-dim coords and chunk_samples=False
* Convert test_3d_import_v1 to V1
* Fix test_meta_dataset_read
* remove whitespace
* clean up comments
* update deps in lockfile
* simplify dim and non-dim coordinate handling after scan
* remove compatibility tests
* add filtering capability to header worker
* accept subset filter to pass to workers
* make v1 grid planner awesome
* double to single underscores in test names
* fix broken test harnesses due to incorrect Sequence import
* clean up dev comment
* clean up whitespace
* use new module name
* clean up segy_to_mdio_v1
* fix whitespace and remove unnecessary list call
* these are defined as float64 in template
Previous check was passing due to an error in assignment during creation of coordinate variables
* fix missing dimension coordinate for vertical axis
* fix incorrect dtype comparison for time variable
* simplify and fix critical bugs
* rename v1 out of things and get rid of old code
* remove fixed todo
* remove more v1 from names
* rename chunk iterator
* fix dimensionality in tests due to new (missing) vertical dimension coordinate
* add todo for numpy ingestion
* fix references to non-v1 naming
* extract grid operations to its own function
* fix typo
Co-authored-by: Brian Michell <brianm314@comcast.net>
* add todo for simplifying storage location
* Remove no_fill_var_names, add domain var to Seismic3DPreStackShotTemplate
* Part 2 of the previous commit
* pre-commit formatting
* remove dev mount
---------
Co-authored-by: Dmitriy Repin <dmitriy_repin@epam.com>
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
Co-authored-by: Brian Michell <brianm314@comcast.net>
@tasansal
tasansal
commented
Aug 8, 2025

Copy link


Copy Markdown

ContributorAuthor
superseeded by #577
@tasansaltasansal
closed this
Aug 8, 2025
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers


No reviews


Assignees

@tasansaltasansal
@brian-michellbrian-michell

Labels


None yet


Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

4 participants

@tasansal@BrianMichell@brian-michell@dmitriyrepin

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode");
}
} catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); }
})();
})();

Skip to content
Merge v1 Feature Branch to Main - #535
Closed
tasansal wants to merge 65 commits into
mainfrom 
v1
Closed
Merge v1 Feature Branch to Main#535
tasansal wants to merge 65 commits into
mainfrom 
v1
Conversation
@tasansal
@tasansaltasansal
commented
Apr 29, 2025

Copy link


Copy Markdown

Contributor
 No description provided. 
@tasansal
tasansalforce-pushed
the
v1
branch
7 times, most recently
from
d72eea6 to
4be3d15CompareApril 30, 2025 14:56
@BrianMichell
BrianMichell
commented
Apr 30, 2025•

edited

Loading

Copy link


Copy Markdown

Collaborator
Adding tasks for progress tracking. Will continue to update this comment as the process evolves and tasks begin work.
Private API
SEG-Y to MDIO metadata
  •  Distributed Statistics
  •  SEG-Y headers
User API
Constructor
Reading
  •  Implementation
Structure Copy
  •  Implementation
Writing
  •  Implementation
  •  Save factory created dataset
SEG-Y to MDIO
Templates for Seismic Data Models
  •  Input Dataset schema as parameter
  •  SEG-Y Schema Parameterization
MDIO to SEG-Y
  •  SEG-Y Schema Parameterization
  •  Xarray Compatibility
dmitriyrepinand others
added 3 commits
June 24, 2025 20:17
@dmitriyrepin
schema_v1-dataset_builder-add_dimension
9dd9fbc
@BrianMichell
V1 schema review (#553)
5816f83
* Update from list to discrete values for coordinate metadata
* Add docs to help users understand difference
* Update docs and fix case sensitivity.
* Linting
* Add CoordianteMetadata to docs
@dmitriyrepin
Merge remote-tracking branch 'upstream/v1' into v1
f88531e
dmitriyrepinand others
added 28 commits
July 9, 2025 19:10
@dmitriyrepin
PR Review: improve unit tests by extracting common functionality in v…
99fcf43
…alidate* functions
@dmitriyrepin
Remove the Dockerfile changes. They are not supposed to be a part of …
0778fdd
…this PR
@dmitriyrepin
PR Review: run ruff
7e74567
@dmitriyrepin
PR Review: fix pre-commit errors
0aaa5f6
@tasansal
remove some noqa overrides
1904dee
@dmitriyrepin@tasansal
Implement MDIO Dataset builder to create in-memory instance of schema…
90d31a1
…s.v1.dataset.Dataset (#568)
* schema_v1-dataset_builder-add_dimension
* First take on add_dimension(), add_coordinate(), add_variable()
* Finished add_dimension, add_coordinate, add_variable
* Work on build
* Generalize _to_dictionary()
* build
* Dataset Build - pass one
* Revert .container changes
* PR review: remove DEVELOPER_NOTES.md
* PR Review: add_coordinate() should accept only data_type: ScalarType
* PR review: add_variable() data_type remove default
* RE review: do not add dimension variable
* PR Review: get api version from the package version
* PR Review: remove add_dimension_coordinate
* PR Review: add_coordinate() remove data_type default value
* PR Review: improve unit tests by extracting common functionality in validate* functions
* Remove the Dockerfile changes. They are not supposed to be a part of this PR
* PR Review: run ruff
* PR Review: fix pre-commit errors
* remove some noqa overrides
---------
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
@dmitriyrepin
Writing XArray / Zarr
4c7c833
@dmitriyrepin
gitignore
4b39ffa
@dmitriyrepin
Merge remote-tracking branch 'upstream/v1' into v1
e772a4f
@dmitriyrepin
to_zarr() fix compression
cea7308
@dmitriyrepin
Fix precommit issues
850135e
@dmitriyrepin
Use only make_campos_3d_acceptance_dataset
82f1960
@dmitriyrepin
PR Review: address the review comments
b5ee31e
@dmitriyrepin
Update _get_fill_value for StructuredType
7b3ba70
@dmitriyrepin
Fix fill type issue for the Structured Types
a4ff4a9
@dmitriyrepin
Improve code coverage
81bfa76
@dmitriyrepin
Fix spelling
0447659
@dmitriyrepin
Revert "Fix spelling"
d08e2c4
This reverts commit 0447659.
@tasansal
extend per-file ignores for PLR2004 and remove noqa overrides in spec…
657d2cf
…ific tests
@tasansal
Refactor tests: clarify Zarr-related test names, fix type hints, and …
bfab1d7
…clean unused `# noqa` comments.
@tasansal
merge main into v1
9a033de
@dmitriyrepin
MDIO v1 Templates and Template Registry (#573)
5878e97
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
@tasansal
Merge branch 'main' into v1
aaf8fc6
# Conflicts:
#	docs/requirements.txt
#	pyproject.toml
#	uv.lock
@tasansal
update deps
bc35bdf
@tasansal
Merge branch 'main' into v1
3b62d8f
@tasansal
Merge branch 'main' into v1
aae5f51
@dmitriyrepin@tasansal
address issues with VS Code dev containers (see issue 559) (#576)
d21278c
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
* Dockerfile.dev
---------
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
@dmitriyrepinDmitriy Repin
@tasansal@BrianMichell
segy_to_mdio_v1 (#577)
d3a7da2
* Templates and TemplateRegistry
* Fix pre-commit issues
* Rever dev container changes
* PR Review: address issues
* PR Review: register default templates at registry initialization
* Dockerfile.dev
* segy_to_mdio_v1
* Clean up
* Prototype review notes
* Add dev comment
* Add notes that will be deleted later
* segy_to_mdio_v1 pass 1
* indexing_v1 and blocked_io_v1
* Remove DEV notes
* Clean up
* Document bug location
* Work around IndexError
* Clean temporary code
* More clean up
* Remove *_1 infrastructure files
* Restore accidently removed dask.array
* Created an issue reproducer
* Make the required template properties public
* Simplify type converter
* Improve templates
* Move test_type_converter.py
* Move test_type_converter.py
* Revert to use the original grid
* Integrate segy_to_mdio_v1_customized, fix indexing
* Add dimension coordinates in tem,plates
* Write statistics to Zarr
* Delete factory_v1.py
* Complete integrationtest. Fix coordinates
* Fir pre-commit errors
* PR review: fix trace_worker docstring
* Review: address some of the issue
* Fix bug
* dding todo for sum squares calculation
* Refactor ChunkIterator
* Refactor ChunkIterator into ChunkIteratorV1
* Remove segy_to_mdio_v1_customized, dataset_serializer.to_zarr
* Add support for trace headers without using _FillValue
* Use StorageLocation in trace_worker_v1
* Fix statistics attribute name
* PR review changes
* PR Improvements: do a single write
* TODO: chunked write for non-dimensional coordinates and trace_mask
* Update StorageLocation to use fsspec
* Reformat with pre-commit
* Use domain name in get_grid_plan
* Fix non-dim coords and chunk_samples=False
* Convert test_3d_import_v1 to V1
* Fix test_meta_dataset_read
* remove whitespace
* clean up comments
* update deps in lockfile
* simplify dim and non-dim coordinate handling after scan
* remove compatibility tests
* add filtering capability to header worker
* accept subset filter to pass to workers
* make v1 grid planner awesome
* double to single underscores in test names
* fix broken test harnesses due to incorrect Sequence import
* clean up dev comment
* clean up whitespace
* use new module name
* clean up segy_to_mdio_v1
* fix whitespace and remove unnecessary list call
* these are defined as float64 in template
Previous check was passing due to an error in assignment during creation of coordinate variables
* fix missing dimension coordinate for vertical axis
* fix incorrect dtype comparison for time variable
* simplify and fix critical bugs
* rename v1 out of things and get rid of old code
* remove fixed todo
* remove more v1 from names
* rename chunk iterator
* fix dimensionality in tests due to new (missing) vertical dimension coordinate
* add todo for numpy ingestion
* fix references to non-v1 naming
* extract grid operations to its own function
* fix typo
Co-authored-by: Brian Michell <brianm314@comcast.net>
* add todo for simplifying storage location
* Remove no_fill_var_names, add domain var to Seismic3DPreStackShotTemplate
* Part 2 of the previous commit
* pre-commit formatting
* remove dev mount
---------
Co-authored-by: Dmitriy Repin <dmitriy_repin@epam.com>
Co-authored-by: Altay Sansal <tasansal@users.noreply.github.com>
Co-authored-by: Brian Michell <brianm314@comcast.net>
@tasansal
tasansal
commented
Aug 8, 2025

Copy link


Copy Markdown

ContributorAuthor
superseeded by #577
@tasansaltasansal
closed this
Aug 8, 2025
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers


No reviews


Assignees

@tasansaltasansal
@brian-michellbrian-michell

Labels


None yet


Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

4 participants

@tasansal@BrianMichell@brian-michell@dmitriyrepin