Skip to content

Getting error subsetting object created via saveHDF5SummarizedExperiment on different machine (and different R version) #69

Description

@epurdom

Hello,

I am having difficulty trying to subset a SingleCellExperiment object that was created via saveHDF5SummarizedExperiment on a different machine.

It was created from a SingleCellExperiment object on my computer server which is running R 4.5.0

HDF5Array::saveHDF5SummarizedExperiment(
sce_object,
dir = harmony_dir,
replace = TRUE,
verbose = TRUE
)

When I copied the saved folder to my laptop running R 4.6.0, I was able to load it with

loadHDF5SummarizedExperiment(file.path(results_dir, "sce_qc_harmony_h5se"))

but if I tried to subset it, I got the error message

> sce_object[1:2,1:4]
Error in validObject(.Object) : invalid class “DelayedSubset” object: the supplied seed must support extract_array()

On my compute server, however, it has no problem loading it via loadHDF5SummarizedExperiment and subsetting it.

I can do other things with the object on my laptop, however, like

assay(sce_object)[1:3,1:4]
reducedDim(sce_object,"PCA")[1:4,1:3]
colData(sce_object)

Indeed, I was able to work with it and extract information perfectly well for a good bit until I tried to subset it.

I tried to make a minimal example object on the computer server to recreate the error ( using an example from saveHDF5SummarizedExperiment ). I saved it and transferred it to my laptop, and I did not have a problem -- the subsetting works fine. So it doesn't seem directly related to the difference in R versions (or much more subtly!)

# This object can be read and subsetted on both machines
library(SingleCellExperiment)
nrow <- 200
ncol <- 6
counts <- matrix(as.integer(runif(nrow * ncol, 1, 1e4)), nrow)
colData <- DataFrame(Treatment=rep(c("ChIP", "Input"), 3),
row.names=LETTERS[1:6])
se0 <- SingleCellExperiment(assays=list(counts=counts), colData=colData)
reducedDim(se0,"FakePCA")<-matrix(rnorm(ncol*3),ncol)
## Save 'se0' as an HDF5-based SummarizedExperiment object:
dir <- "temph5/test1"
h5_se0 <- HDF5Array::saveHDF5SummarizedExperiment(
se0,
dir = dir,
replace = TRUE,
verbose = TRUE
)

So I am baffled about how to even go about diagnosing the error. I don't know if this is related to these issues on DelayedArray: Bioconductor/DelayedArray#125 or Bioconductor/DelayedArray#112?

I would appreciate any suggestions! Thanks

Here is the session info on my compute server:

# On my compute server
> sessionInfo()
R version 4.5.0 (2025-04-11)
Platform: x86_64-pc-linux-gnu
Running under: Ubuntu 24.04.4 LTS
Matrix products: default
BLAS: /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 LAPACK: /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.26.so; LAPACK version 3.12.0
locale:
[1] LC_CTYPE=en_US.UTF-8 LC_NUMERIC=C [3] LC_TIME=en_US.UTF-8 LC_COLLATE=en_US.UTF-8 [5] LC_MONETARY=en_US.UTF-8 LC_MESSAGES=en_US.UTF-8 [7] LC_PAPER=en_US.UTF-8 LC_NAME=C [9] LC_ADDRESS=C LC_TELEPHONE=C [11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C time zone: America/Los_Angeles
tzcode source: system (glibc)
attached base packages:
[1] stats4 stats graphics grDevices utils datasets methods [8] base other attached packages:
[1] SingleCellExperiment_1.32.0 SummarizedExperiment_1.40.0
[3] Biobase_2.70.0 GenomicRanges_1.62.0 [5] Seqinfo_1.0.0 HDF5Array_1.38.0 [7] h5mread_1.2.0 rhdf5_2.54.0 [9] DelayedArray_0.36.0 SparseArray_1.10.2 [11] S4Arrays_1.10.0 IRanges_2.44.0 [13] abind_1.4-8 S4Vectors_0.48.0 [15] MatrixGenerics_1.22.0 matrixStats_1.5.0 [17] BiocGenerics_0.56.0 generics_0.1.4 [19] Matrix_1.7-4 SCF_4.1.0 loaded via a namespace (and not attached):
[1] lattice_0.22-7 rhdf5filters_1.22.0 XVector_0.50.0 [4] Rhdf5lib_1.32.0 grid_4.5.0 compiler_4.5.0 [7] tools_4.5.0 > 

and here is the session Info from my laptop:

# My laptop
> sessionInfo()
R version 4.6.0 (2026-04-24)
Platform: aarch64-apple-darwin23
Running under: macOS Sonoma 14.8.4
Matrix products: default
BLAS: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRblas.0.dylib LAPACK: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRlapack.dylib; LAPACK version 3.12.1
locale:
[1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
time zone: America/Los_Angeles
tzcode source: internal
attached base packages:
[1] stats4 stats graphics grDevices utils datasets methods base other attached packages:
[1] SingleCellExperiment_1.34.0 SummarizedExperiment_1.42.0
[3] Biobase_2.72.0 GenomicRanges_1.64.0 [5] Seqinfo_1.2.0 HDF5Array_1.40.0 [7] h5mread_1.4.0 rhdf5_2.56.0 [9] DelayedArray_0.38.1 SparseArray_1.12.2 [11] S4Arrays_1.12.0 IRanges_2.46.0 [13] abind_1.4-8 S4Vectors_0.50.1 [15] MatrixGenerics_1.24.0 matrixStats_1.5.0 [17] BiocGenerics_0.58.1 generics_0.1.4 [19] Matrix_1.7-5 loaded via a namespace (and not attached):
[1] lattice_0.22-9 rhdf5filters_1.24.0 XVector_0.52.0 Rhdf5lib_2.0.0 [5] grid_4.6.0 compiler_4.6.0 tools_4.6.0 

and on my laptop, BiocManager::valid() highlights only bit64 as being out-of-date, but I can't actually update it with their command -- nothing happens because it's the most current version available for my machine.

> BiocManager::valid()
* sessionInfo()
R version 4.6.0 (2026-04-24)
Platform: aarch64-apple-darwin23
Running under: macOS Sonoma 14.8.4
Matrix products: default
BLAS: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRblas.0.dylib LAPACK: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRlapack.dylib; LAPACK version 3.12.1
locale:
[1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
time zone: America/Los_Angeles
tzcode source: internal
attached base packages:
[1] stats4 stats graphics grDevices utils datasets methods base other attached packages:
[1] SingleCellExperiment_1.34.0 SummarizedExperiment_1.42.0
[3] Biobase_2.72.0 GenomicRanges_1.64.0 [5] Seqinfo_1.2.0 HDF5Array_1.40.0 [7] h5mread_1.4.0 rhdf5_2.56.0 [9] DelayedArray_0.38.1 SparseArray_1.12.2 [11] S4Arrays_1.12.0 IRanges_2.46.0 [13] abind_1.4-8 S4Vectors_0.50.1 [15] MatrixGenerics_1.24.0 matrixStats_1.5.0 [17] BiocGenerics_0.58.1 generics_0.1.4 [19] Matrix_1.7-5 loaded via a namespace (and not attached):
[1] lattice_0.22-9 rhdf5filters_1.24.0 XVector_0.52.0 Rhdf5lib_2.0.0 [5] grid_4.6.0 compiler_4.6.0 tools_4.6.0 BiocManager_1.30.27
Bioconductor version '3.23'
* 1 packages out-of-date
* 0 packages too new
create a valid installation with
BiocManager::install("bit64", update = TRUE, ask = FALSE, force = TRUE)
more details: BiocManager::valid()$too_new, BiocManager::valid()$out_of_date
Warning message:
1 packages out-of-date; 0 packages too new 

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

    , 'i'); if (__m === '*' || __re.test(location.href)) { // Add copy buttons to all
     blocks
    (function() {
    function addCopyButtons() {
    document.querySelectorAll('pre code').forEach(function(codeBlock) {
    if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;
    codeBlock.parentElement.setAttribute('data-copy-added', 'true');
    var btn = document.createElement('button');
    btn.textContent = 'Copy';
    btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';
    btn.onmouseover = function() { this.style.opacity = '1'; };
    btn.onmouseout = function() { this.style.opacity = '0.7'; };
    btn.onclick = function() {
    navigator.clipboard.writeText(codeBlock.textContent).then(function() {
    btn.textContent = 'Copied!';
    setTimeout(function() { btn.textContent = 'Copy'; }, 1500);
    });
    };
    codeBlock.parentElement.style.position = 'relative';
    codeBlock.parentElement.appendChild(btn);
    });
    }
    addCopyButtons();
    // Re-run on dynamic content
    var observer = new MutationObserver(addCopyButtons);
    observer.observe(document.body, { childList: true, subtree: true });
    })();
    }
    } catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
    })();
    (function(){
    try {
    var __m = "github.com";
    var __re = new RegExp('^' + "github\\.com" + '
    Getting error subsetting object created via `saveHDF5SummarizedExperiment` on different machine (and different R version) · Issue #69 · Bioconductor/HDF5Array · GitHub
    Skip to content

    Getting error subsetting object created via saveHDF5SummarizedExperiment on different machine (and different R version) #69

    Description

    @epurdom

    Hello,

    I am having difficulty trying to subset a SingleCellExperiment object that was created via saveHDF5SummarizedExperiment on a different machine.

    It was created from a SingleCellExperiment object on my computer server which is running R 4.5.0

    HDF5Array::saveHDF5SummarizedExperiment(
    sce_object,
    dir = harmony_dir,
    replace = TRUE,
    verbose = TRUE
    )
    

    When I copied the saved folder to my laptop running R 4.6.0, I was able to load it with

    loadHDF5SummarizedExperiment(file.path(results_dir, "sce_qc_harmony_h5se"))
    

    but if I tried to subset it, I got the error message

    > sce_object[1:2,1:4]
    Error in validObject(.Object) : invalid class “DelayedSubset” object: the supplied seed must support extract_array()
    

    On my compute server, however, it has no problem loading it via loadHDF5SummarizedExperiment and subsetting it.

    I can do other things with the object on my laptop, however, like

    assay(sce_object)[1:3,1:4]
    reducedDim(sce_object,"PCA")[1:4,1:3]
    colData(sce_object)
    

    Indeed, I was able to work with it and extract information perfectly well for a good bit until I tried to subset it.

    I tried to make a minimal example object on the computer server to recreate the error ( using an example from saveHDF5SummarizedExperiment ). I saved it and transferred it to my laptop, and I did not have a problem -- the subsetting works fine. So it doesn't seem directly related to the difference in R versions (or much more subtly!)

    # This object can be read and subsetted on both machines
    library(SingleCellExperiment)
    nrow <- 200
    ncol <- 6
    counts <- matrix(as.integer(runif(nrow * ncol, 1, 1e4)), nrow)
    colData <- DataFrame(Treatment=rep(c("ChIP", "Input"), 3),
    row.names=LETTERS[1:6])
    se0 <- SingleCellExperiment(assays=list(counts=counts), colData=colData)
    reducedDim(se0,"FakePCA")<-matrix(rnorm(ncol*3),ncol)
    ## Save 'se0' as an HDF5-based SummarizedExperiment object:
    dir <- "temph5/test1"
    h5_se0 <- HDF5Array::saveHDF5SummarizedExperiment(
    se0,
    dir = dir,
    replace = TRUE,
    verbose = TRUE
    )
    

    So I am baffled about how to even go about diagnosing the error. I don't know if this is related to these issues on DelayedArray: Bioconductor/DelayedArray#125 or Bioconductor/DelayedArray#112?

    I would appreciate any suggestions! Thanks

    Here is the session info on my compute server:

    # On my compute server
    > sessionInfo()
    R version 4.5.0 (2025-04-11)
    Platform: x86_64-pc-linux-gnu
    Running under: Ubuntu 24.04.4 LTS
    Matrix products: default
    BLAS: /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 LAPACK: /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.26.so; LAPACK version 3.12.0
    locale:
    [1] LC_CTYPE=en_US.UTF-8 LC_NUMERIC=C [3] LC_TIME=en_US.UTF-8 LC_COLLATE=en_US.UTF-8 [5] LC_MONETARY=en_US.UTF-8 LC_MESSAGES=en_US.UTF-8 [7] LC_PAPER=en_US.UTF-8 LC_NAME=C [9] LC_ADDRESS=C LC_TELEPHONE=C [11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C time zone: America/Los_Angeles
    tzcode source: system (glibc)
    attached base packages:
    [1] stats4 stats graphics grDevices utils datasets methods [8] base other attached packages:
    [1] SingleCellExperiment_1.32.0 SummarizedExperiment_1.40.0
    [3] Biobase_2.70.0 GenomicRanges_1.62.0 [5] Seqinfo_1.0.0 HDF5Array_1.38.0 [7] h5mread_1.2.0 rhdf5_2.54.0 [9] DelayedArray_0.36.0 SparseArray_1.10.2 [11] S4Arrays_1.10.0 IRanges_2.44.0 [13] abind_1.4-8 S4Vectors_0.48.0 [15] MatrixGenerics_1.22.0 matrixStats_1.5.0 [17] BiocGenerics_0.56.0 generics_0.1.4 [19] Matrix_1.7-4 SCF_4.1.0 loaded via a namespace (and not attached):
    [1] lattice_0.22-7 rhdf5filters_1.22.0 XVector_0.50.0 [4] Rhdf5lib_1.32.0 grid_4.5.0 compiler_4.5.0 [7] tools_4.5.0 > 

    and here is the session Info from my laptop:

    # My laptop
    > sessionInfo()
    R version 4.6.0 (2026-04-24)
    Platform: aarch64-apple-darwin23
    Running under: macOS Sonoma 14.8.4
    Matrix products: default
    BLAS: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRblas.0.dylib LAPACK: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRlapack.dylib; LAPACK version 3.12.1
    locale:
    [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
    time zone: America/Los_Angeles
    tzcode source: internal
    attached base packages:
    [1] stats4 stats graphics grDevices utils datasets methods base other attached packages:
    [1] SingleCellExperiment_1.34.0 SummarizedExperiment_1.42.0
    [3] Biobase_2.72.0 GenomicRanges_1.64.0 [5] Seqinfo_1.2.0 HDF5Array_1.40.0 [7] h5mread_1.4.0 rhdf5_2.56.0 [9] DelayedArray_0.38.1 SparseArray_1.12.2 [11] S4Arrays_1.12.0 IRanges_2.46.0 [13] abind_1.4-8 S4Vectors_0.50.1 [15] MatrixGenerics_1.24.0 matrixStats_1.5.0 [17] BiocGenerics_0.58.1 generics_0.1.4 [19] Matrix_1.7-5 loaded via a namespace (and not attached):
    [1] lattice_0.22-9 rhdf5filters_1.24.0 XVector_0.52.0 Rhdf5lib_2.0.0 [5] grid_4.6.0 compiler_4.6.0 tools_4.6.0 

    and on my laptop, BiocManager::valid() highlights only bit64 as being out-of-date, but I can't actually update it with their command -- nothing happens because it's the most current version available for my machine.

    > BiocManager::valid()
    * sessionInfo()
    R version 4.6.0 (2026-04-24)
    Platform: aarch64-apple-darwin23
    Running under: macOS Sonoma 14.8.4
    Matrix products: default
    BLAS: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRblas.0.dylib LAPACK: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRlapack.dylib; LAPACK version 3.12.1
    locale:
    [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
    time zone: America/Los_Angeles
    tzcode source: internal
    attached base packages:
    [1] stats4 stats graphics grDevices utils datasets methods base other attached packages:
    [1] SingleCellExperiment_1.34.0 SummarizedExperiment_1.42.0
    [3] Biobase_2.72.0 GenomicRanges_1.64.0 [5] Seqinfo_1.2.0 HDF5Array_1.40.0 [7] h5mread_1.4.0 rhdf5_2.56.0 [9] DelayedArray_0.38.1 SparseArray_1.12.2 [11] S4Arrays_1.12.0 IRanges_2.46.0 [13] abind_1.4-8 S4Vectors_0.50.1 [15] MatrixGenerics_1.24.0 matrixStats_1.5.0 [17] BiocGenerics_0.58.1 generics_0.1.4 [19] Matrix_1.7-5 loaded via a namespace (and not attached):
    [1] lattice_0.22-9 rhdf5filters_1.24.0 XVector_0.52.0 Rhdf5lib_2.0.0 [5] grid_4.6.0 compiler_4.6.0 tools_4.6.0 BiocManager_1.30.27
    Bioconductor version '3.23'
    * 1 packages out-of-date
    * 0 packages too new
    create a valid installation with
    BiocManager::install("bit64", update = TRUE, ask = FALSE, force = TRUE)
    more details: BiocManager::valid()$too_new, BiocManager::valid()$out_of_date
    Warning message:
    1 packages out-of-date; 0 packages too new 

    Metadata

    Metadata

    Assignees

    No one assigned

      Labels

      No labels
      No labels

      Type

      No type

      Projects

      No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions

      , 'i'); if (__m === '*' || __re.test(location.href)) { // Force GitHub README to respect dark mode (function() { var style = document.createElement('style'); style.textContent = ' .markdown-body { color-scheme: dark light; } .markdown-body pre { background: #161b22 !important; } .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; } .markdown-body table th, .markdown-body table td { border-color: #30363d !important; } .markdown-body img { background: #0d1117; } .markdown-body blockquote { border-left-color: #8b949e; } .markdown-body hr { border-color: #30363d; } '; document.head.appendChild(style); })(); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' Getting error subsetting object created via `saveHDF5SummarizedExperiment` on different machine (and different R version) · Issue #69 · Bioconductor/HDF5Array · GitHub
      Skip to content

      Getting error subsetting object created via saveHDF5SummarizedExperiment on different machine (and different R version) #69

      Description

      @epurdom

      Hello,

      I am having difficulty trying to subset a SingleCellExperiment object that was created via saveHDF5SummarizedExperiment on a different machine.

      It was created from a SingleCellExperiment object on my computer server which is running R 4.5.0

      HDF5Array::saveHDF5SummarizedExperiment(
      sce_object,
      dir = harmony_dir,
      replace = TRUE,
      verbose = TRUE
      )
      

      When I copied the saved folder to my laptop running R 4.6.0, I was able to load it with

      loadHDF5SummarizedExperiment(file.path(results_dir, "sce_qc_harmony_h5se"))
      

      but if I tried to subset it, I got the error message

      > sce_object[1:2,1:4]
      Error in validObject(.Object) : invalid class “DelayedSubset” object: the supplied seed must support extract_array()
      

      On my compute server, however, it has no problem loading it via loadHDF5SummarizedExperiment and subsetting it.

      I can do other things with the object on my laptop, however, like

      assay(sce_object)[1:3,1:4]
      reducedDim(sce_object,"PCA")[1:4,1:3]
      colData(sce_object)
      

      Indeed, I was able to work with it and extract information perfectly well for a good bit until I tried to subset it.

      I tried to make a minimal example object on the computer server to recreate the error ( using an example from saveHDF5SummarizedExperiment ). I saved it and transferred it to my laptop, and I did not have a problem -- the subsetting works fine. So it doesn't seem directly related to the difference in R versions (or much more subtly!)

      # This object can be read and subsetted on both machines
      library(SingleCellExperiment)
      nrow <- 200
      ncol <- 6
      counts <- matrix(as.integer(runif(nrow * ncol, 1, 1e4)), nrow)
      colData <- DataFrame(Treatment=rep(c("ChIP", "Input"), 3),
      row.names=LETTERS[1:6])
      se0 <- SingleCellExperiment(assays=list(counts=counts), colData=colData)
      reducedDim(se0,"FakePCA")<-matrix(rnorm(ncol*3),ncol)
      ## Save 'se0' as an HDF5-based SummarizedExperiment object:
      dir <- "temph5/test1"
      h5_se0 <- HDF5Array::saveHDF5SummarizedExperiment(
      se0,
      dir = dir,
      replace = TRUE,
      verbose = TRUE
      )
      

      So I am baffled about how to even go about diagnosing the error. I don't know if this is related to these issues on DelayedArray: Bioconductor/DelayedArray#125 or Bioconductor/DelayedArray#112?

      I would appreciate any suggestions! Thanks

      Here is the session info on my compute server:

      # On my compute server
      > sessionInfo()
      R version 4.5.0 (2025-04-11)
      Platform: x86_64-pc-linux-gnu
      Running under: Ubuntu 24.04.4 LTS
      Matrix products: default
      BLAS: /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 LAPACK: /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.26.so; LAPACK version 3.12.0
      locale:
      [1] LC_CTYPE=en_US.UTF-8 LC_NUMERIC=C [3] LC_TIME=en_US.UTF-8 LC_COLLATE=en_US.UTF-8 [5] LC_MONETARY=en_US.UTF-8 LC_MESSAGES=en_US.UTF-8 [7] LC_PAPER=en_US.UTF-8 LC_NAME=C [9] LC_ADDRESS=C LC_TELEPHONE=C [11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C time zone: America/Los_Angeles
      tzcode source: system (glibc)
      attached base packages:
      [1] stats4 stats graphics grDevices utils datasets methods [8] base other attached packages:
      [1] SingleCellExperiment_1.32.0 SummarizedExperiment_1.40.0
      [3] Biobase_2.70.0 GenomicRanges_1.62.0 [5] Seqinfo_1.0.0 HDF5Array_1.38.0 [7] h5mread_1.2.0 rhdf5_2.54.0 [9] DelayedArray_0.36.0 SparseArray_1.10.2 [11] S4Arrays_1.10.0 IRanges_2.44.0 [13] abind_1.4-8 S4Vectors_0.48.0 [15] MatrixGenerics_1.22.0 matrixStats_1.5.0 [17] BiocGenerics_0.56.0 generics_0.1.4 [19] Matrix_1.7-4 SCF_4.1.0 loaded via a namespace (and not attached):
      [1] lattice_0.22-7 rhdf5filters_1.22.0 XVector_0.50.0 [4] Rhdf5lib_1.32.0 grid_4.5.0 compiler_4.5.0 [7] tools_4.5.0 > 

      and here is the session Info from my laptop:

      # My laptop
      > sessionInfo()
      R version 4.6.0 (2026-04-24)
      Platform: aarch64-apple-darwin23
      Running under: macOS Sonoma 14.8.4
      Matrix products: default
      BLAS: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRblas.0.dylib LAPACK: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRlapack.dylib; LAPACK version 3.12.1
      locale:
      [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
      time zone: America/Los_Angeles
      tzcode source: internal
      attached base packages:
      [1] stats4 stats graphics grDevices utils datasets methods base other attached packages:
      [1] SingleCellExperiment_1.34.0 SummarizedExperiment_1.42.0
      [3] Biobase_2.72.0 GenomicRanges_1.64.0 [5] Seqinfo_1.2.0 HDF5Array_1.40.0 [7] h5mread_1.4.0 rhdf5_2.56.0 [9] DelayedArray_0.38.1 SparseArray_1.12.2 [11] S4Arrays_1.12.0 IRanges_2.46.0 [13] abind_1.4-8 S4Vectors_0.50.1 [15] MatrixGenerics_1.24.0 matrixStats_1.5.0 [17] BiocGenerics_0.58.1 generics_0.1.4 [19] Matrix_1.7-5 loaded via a namespace (and not attached):
      [1] lattice_0.22-9 rhdf5filters_1.24.0 XVector_0.52.0 Rhdf5lib_2.0.0 [5] grid_4.6.0 compiler_4.6.0 tools_4.6.0 

      and on my laptop, BiocManager::valid() highlights only bit64 as being out-of-date, but I can't actually update it with their command -- nothing happens because it's the most current version available for my machine.

      > BiocManager::valid()
      * sessionInfo()
      R version 4.6.0 (2026-04-24)
      Platform: aarch64-apple-darwin23
      Running under: macOS Sonoma 14.8.4
      Matrix products: default
      BLAS: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRblas.0.dylib LAPACK: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRlapack.dylib; LAPACK version 3.12.1
      locale:
      [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
      time zone: America/Los_Angeles
      tzcode source: internal
      attached base packages:
      [1] stats4 stats graphics grDevices utils datasets methods base other attached packages:
      [1] SingleCellExperiment_1.34.0 SummarizedExperiment_1.42.0
      [3] Biobase_2.72.0 GenomicRanges_1.64.0 [5] Seqinfo_1.2.0 HDF5Array_1.40.0 [7] h5mread_1.4.0 rhdf5_2.56.0 [9] DelayedArray_0.38.1 SparseArray_1.12.2 [11] S4Arrays_1.12.0 IRanges_2.46.0 [13] abind_1.4-8 S4Vectors_0.50.1 [15] MatrixGenerics_1.24.0 matrixStats_1.5.0 [17] BiocGenerics_0.58.1 generics_0.1.4 [19] Matrix_1.7-5 loaded via a namespace (and not attached):
      [1] lattice_0.22-9 rhdf5filters_1.24.0 XVector_0.52.0 Rhdf5lib_2.0.0 [5] grid_4.6.0 compiler_4.6.0 tools_4.6.0 BiocManager_1.30.27
      Bioconductor version '3.23'
      * 1 packages out-of-date
      * 0 packages too new
      create a valid installation with
      BiocManager::install("bit64", update = TRUE, ask = FALSE, force = TRUE)
      more details: BiocManager::valid()$too_new, BiocManager::valid()$out_of_date
      Warning message:
      1 packages out-of-date; 0 packages too new 

      Metadata

      Metadata

      Assignees

      No one assigned

        Labels

        No labels
        No labels

        Type

        No type

        Projects

        No projects

        Milestone

        No milestone

        Relationships

        None yet

        Development

        No branches or pull requests

        Issue actions

        , 'i'); if (__m === '*' || __re.test(location.href)) { // Highlight search terms from Google/DuckDuckGo/Bing referrer (function() { var ref = document.referrer; var terms = []; if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) { var url = new URL(ref); var q = url.searchParams.get('q') || url.searchParams.get('p'); if (q) { terms = q.split(/\s+/).filter(function(t) { return t.length > 2; }); } } if (terms.length === 0) return; var style = document.createElement('style'); style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }'; document.head.appendChild(style); function highlight(node) { if (node.nodeType === 3) { // text node var text = node.textContent; var found = false; terms.forEach(function(term) { var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\]\\]/g, '\\') + ')', 'gi'); if (regex.test(text)) { found = true; var frag = document.createDocumentFragment(); var parts = text.split(regex); parts.forEach(function(part, i) { if (i % 2 === 0) { frag.appendChild(document.createTextNode(part)); } else { var span = document.createElement('span'); span.className = 'userscript-highlight'; span.textContent = part; frag.appendChild(span); } }); node.parentNode.replaceChild(frag, node); } }); } else if (node.nodeType === 1 && node.childNodes) { // element var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT']; if (!skipTags.includes(node.tagName)) { Array.from(node.childNodes).forEach(highlight); } } } highlight(document.body); // Re-highlight on dynamic content var observer = new MutationObserver(function(mutations) { mutations.forEach(function(m) { m.addedNodes.forEach(function(node) { if (node.nodeType === 1 || node.nodeType === 3) highlight(node); }); }); }); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' Getting error subsetting object created via `saveHDF5SummarizedExperiment` on different machine (and different R version) · Issue #69 · Bioconductor/HDF5Array · GitHub
        Skip to content

        Getting error subsetting object created via saveHDF5SummarizedExperiment on different machine (and different R version) #69

        Description

        @epurdom

        Hello,

        I am having difficulty trying to subset a SingleCellExperiment object that was created via saveHDF5SummarizedExperiment on a different machine.

        It was created from a SingleCellExperiment object on my computer server which is running R 4.5.0

        HDF5Array::saveHDF5SummarizedExperiment(
        sce_object,
        dir = harmony_dir,
        replace = TRUE,
        verbose = TRUE
        )
        

        When I copied the saved folder to my laptop running R 4.6.0, I was able to load it with

        loadHDF5SummarizedExperiment(file.path(results_dir, "sce_qc_harmony_h5se"))
        

        but if I tried to subset it, I got the error message

        > sce_object[1:2,1:4]
        Error in validObject(.Object) : invalid class “DelayedSubset” object: the supplied seed must support extract_array()
        

        On my compute server, however, it has no problem loading it via loadHDF5SummarizedExperiment and subsetting it.

        I can do other things with the object on my laptop, however, like

        assay(sce_object)[1:3,1:4]
        reducedDim(sce_object,"PCA")[1:4,1:3]
        colData(sce_object)
        

        Indeed, I was able to work with it and extract information perfectly well for a good bit until I tried to subset it.

        I tried to make a minimal example object on the computer server to recreate the error ( using an example from saveHDF5SummarizedExperiment ). I saved it and transferred it to my laptop, and I did not have a problem -- the subsetting works fine. So it doesn't seem directly related to the difference in R versions (or much more subtly!)

        # This object can be read and subsetted on both machines
        library(SingleCellExperiment)
        nrow <- 200
        ncol <- 6
        counts <- matrix(as.integer(runif(nrow * ncol, 1, 1e4)), nrow)
        colData <- DataFrame(Treatment=rep(c("ChIP", "Input"), 3),
        row.names=LETTERS[1:6])
        se0 <- SingleCellExperiment(assays=list(counts=counts), colData=colData)
        reducedDim(se0,"FakePCA")<-matrix(rnorm(ncol*3),ncol)
        ## Save 'se0' as an HDF5-based SummarizedExperiment object:
        dir <- "temph5/test1"
        h5_se0 <- HDF5Array::saveHDF5SummarizedExperiment(
        se0,
        dir = dir,
        replace = TRUE,
        verbose = TRUE
        )
        

        So I am baffled about how to even go about diagnosing the error. I don't know if this is related to these issues on DelayedArray: Bioconductor/DelayedArray#125 or Bioconductor/DelayedArray#112?

        I would appreciate any suggestions! Thanks

        Here is the session info on my compute server:

        # On my compute server
        > sessionInfo()
        R version 4.5.0 (2025-04-11)
        Platform: x86_64-pc-linux-gnu
        Running under: Ubuntu 24.04.4 LTS
        Matrix products: default
        BLAS: /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 LAPACK: /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.26.so; LAPACK version 3.12.0
        locale:
        [1] LC_CTYPE=en_US.UTF-8 LC_NUMERIC=C [3] LC_TIME=en_US.UTF-8 LC_COLLATE=en_US.UTF-8 [5] LC_MONETARY=en_US.UTF-8 LC_MESSAGES=en_US.UTF-8 [7] LC_PAPER=en_US.UTF-8 LC_NAME=C [9] LC_ADDRESS=C LC_TELEPHONE=C [11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C time zone: America/Los_Angeles
        tzcode source: system (glibc)
        attached base packages:
        [1] stats4 stats graphics grDevices utils datasets methods [8] base other attached packages:
        [1] SingleCellExperiment_1.32.0 SummarizedExperiment_1.40.0
        [3] Biobase_2.70.0 GenomicRanges_1.62.0 [5] Seqinfo_1.0.0 HDF5Array_1.38.0 [7] h5mread_1.2.0 rhdf5_2.54.0 [9] DelayedArray_0.36.0 SparseArray_1.10.2 [11] S4Arrays_1.10.0 IRanges_2.44.0 [13] abind_1.4-8 S4Vectors_0.48.0 [15] MatrixGenerics_1.22.0 matrixStats_1.5.0 [17] BiocGenerics_0.56.0 generics_0.1.4 [19] Matrix_1.7-4 SCF_4.1.0 loaded via a namespace (and not attached):
        [1] lattice_0.22-7 rhdf5filters_1.22.0 XVector_0.50.0 [4] Rhdf5lib_1.32.0 grid_4.5.0 compiler_4.5.0 [7] tools_4.5.0 > 

        and here is the session Info from my laptop:

        # My laptop
        > sessionInfo()
        R version 4.6.0 (2026-04-24)
        Platform: aarch64-apple-darwin23
        Running under: macOS Sonoma 14.8.4
        Matrix products: default
        BLAS: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRblas.0.dylib LAPACK: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRlapack.dylib; LAPACK version 3.12.1
        locale:
        [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
        time zone: America/Los_Angeles
        tzcode source: internal
        attached base packages:
        [1] stats4 stats graphics grDevices utils datasets methods base other attached packages:
        [1] SingleCellExperiment_1.34.0 SummarizedExperiment_1.42.0
        [3] Biobase_2.72.0 GenomicRanges_1.64.0 [5] Seqinfo_1.2.0 HDF5Array_1.40.0 [7] h5mread_1.4.0 rhdf5_2.56.0 [9] DelayedArray_0.38.1 SparseArray_1.12.2 [11] S4Arrays_1.12.0 IRanges_2.46.0 [13] abind_1.4-8 S4Vectors_0.50.1 [15] MatrixGenerics_1.24.0 matrixStats_1.5.0 [17] BiocGenerics_0.58.1 generics_0.1.4 [19] Matrix_1.7-5 loaded via a namespace (and not attached):
        [1] lattice_0.22-9 rhdf5filters_1.24.0 XVector_0.52.0 Rhdf5lib_2.0.0 [5] grid_4.6.0 compiler_4.6.0 tools_4.6.0 

        and on my laptop, BiocManager::valid() highlights only bit64 as being out-of-date, but I can't actually update it with their command -- nothing happens because it's the most current version available for my machine.

        > BiocManager::valid()
        * sessionInfo()
        R version 4.6.0 (2026-04-24)
        Platform: aarch64-apple-darwin23
        Running under: macOS Sonoma 14.8.4
        Matrix products: default
        BLAS: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRblas.0.dylib LAPACK: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRlapack.dylib; LAPACK version 3.12.1
        locale:
        [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
        time zone: America/Los_Angeles
        tzcode source: internal
        attached base packages:
        [1] stats4 stats graphics grDevices utils datasets methods base other attached packages:
        [1] SingleCellExperiment_1.34.0 SummarizedExperiment_1.42.0
        [3] Biobase_2.72.0 GenomicRanges_1.64.0 [5] Seqinfo_1.2.0 HDF5Array_1.40.0 [7] h5mread_1.4.0 rhdf5_2.56.0 [9] DelayedArray_0.38.1 SparseArray_1.12.2 [11] S4Arrays_1.12.0 IRanges_2.46.0 [13] abind_1.4-8 S4Vectors_0.50.1 [15] MatrixGenerics_1.24.0 matrixStats_1.5.0 [17] BiocGenerics_0.58.1 generics_0.1.4 [19] Matrix_1.7-5 loaded via a namespace (and not attached):
        [1] lattice_0.22-9 rhdf5filters_1.24.0 XVector_0.52.0 Rhdf5lib_2.0.0 [5] grid_4.6.0 compiler_4.6.0 tools_4.6.0 BiocManager_1.30.27
        Bioconductor version '3.23'
        * 1 packages out-of-date
        * 0 packages too new
        create a valid installation with
        BiocManager::install("bit64", update = TRUE, ask = FALSE, force = TRUE)
        more details: BiocManager::valid()$too_new, BiocManager::valid()$out_of_date
        Warning message:
        1 packages out-of-date; 0 packages too new 

        Metadata

        Metadata

        Assignees

        No one assigned

          Labels

          No labels
          No labels

          Type

          No type

          Projects

          No projects

          Milestone

          No milestone

          Relationships

          None yet

          Development

          No branches or pull requests

          Issue actions

          , 'i'); if (__m === '*' || __re.test(location.href)) { // Strip utm_, fbclid, gclid, etc. from all links on page (function() { var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content', 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid', 'ref', 'ref_src', 'source', 'medium', 'campaign']; function cleanUrl(url) { try { var u = new URL(url, window.location.origin); var changed = false; trackingParams.forEach(function(p) { if (u.searchParams.has(p)) { u.searchParams.delete(p); changed = true; } }); return changed ? u.toString() : url; } catch (e) { return url; } } function cleanLinks() { document.querySelectorAll('a[href]').forEach(function(a) { var clean = cleanUrl(a.href); if (clean !== a.href) a.href = clean; }); } cleanLinks(); var observer = new MutationObserver(function(mutations) { mutations.forEach(function(m) { m.addedNodes.forEach(function(node) { if (node.nodeType === 1) { if (node.tagName === 'A') cleanLinks(); node.querySelectorAll('a[href]').forEach(function(a) { var clean = cleanUrl(a.href); if (clean !== a.href) a.href = clean; }); } }); }); }); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + ' Getting error subsetting object created via `saveHDF5SummarizedExperiment` on different machine (and different R version) · Issue #69 · Bioconductor/HDF5Array · GitHub
          Skip to content

          Getting error subsetting object created via saveHDF5SummarizedExperiment on different machine (and different R version) #69

          Description

          @epurdom

          Hello,

          I am having difficulty trying to subset a SingleCellExperiment object that was created via saveHDF5SummarizedExperiment on a different machine.

          It was created from a SingleCellExperiment object on my computer server which is running R 4.5.0

          HDF5Array::saveHDF5SummarizedExperiment(
          sce_object,
          dir = harmony_dir,
          replace = TRUE,
          verbose = TRUE
          )
          

          When I copied the saved folder to my laptop running R 4.6.0, I was able to load it with

          loadHDF5SummarizedExperiment(file.path(results_dir, "sce_qc_harmony_h5se"))
          

          but if I tried to subset it, I got the error message

          > sce_object[1:2,1:4]
          Error in validObject(.Object) : invalid class “DelayedSubset” object: the supplied seed must support extract_array()
          

          On my compute server, however, it has no problem loading it via loadHDF5SummarizedExperiment and subsetting it.

          I can do other things with the object on my laptop, however, like

          assay(sce_object)[1:3,1:4]
          reducedDim(sce_object,"PCA")[1:4,1:3]
          colData(sce_object)
          

          Indeed, I was able to work with it and extract information perfectly well for a good bit until I tried to subset it.

          I tried to make a minimal example object on the computer server to recreate the error ( using an example from saveHDF5SummarizedExperiment ). I saved it and transferred it to my laptop, and I did not have a problem -- the subsetting works fine. So it doesn't seem directly related to the difference in R versions (or much more subtly!)

          # This object can be read and subsetted on both machines
          library(SingleCellExperiment)
          nrow <- 200
          ncol <- 6
          counts <- matrix(as.integer(runif(nrow * ncol, 1, 1e4)), nrow)
          colData <- DataFrame(Treatment=rep(c("ChIP", "Input"), 3),
          row.names=LETTERS[1:6])
          se0 <- SingleCellExperiment(assays=list(counts=counts), colData=colData)
          reducedDim(se0,"FakePCA")<-matrix(rnorm(ncol*3),ncol)
          ## Save 'se0' as an HDF5-based SummarizedExperiment object:
          dir <- "temph5/test1"
          h5_se0 <- HDF5Array::saveHDF5SummarizedExperiment(
          se0,
          dir = dir,
          replace = TRUE,
          verbose = TRUE
          )
          

          So I am baffled about how to even go about diagnosing the error. I don't know if this is related to these issues on DelayedArray: Bioconductor/DelayedArray#125 or Bioconductor/DelayedArray#112?

          I would appreciate any suggestions! Thanks

          Here is the session info on my compute server:

          # On my compute server
          > sessionInfo()
          R version 4.5.0 (2025-04-11)
          Platform: x86_64-pc-linux-gnu
          Running under: Ubuntu 24.04.4 LTS
          Matrix products: default
          BLAS: /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 LAPACK: /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.26.so; LAPACK version 3.12.0
          locale:
          [1] LC_CTYPE=en_US.UTF-8 LC_NUMERIC=C [3] LC_TIME=en_US.UTF-8 LC_COLLATE=en_US.UTF-8 [5] LC_MONETARY=en_US.UTF-8 LC_MESSAGES=en_US.UTF-8 [7] LC_PAPER=en_US.UTF-8 LC_NAME=C [9] LC_ADDRESS=C LC_TELEPHONE=C [11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C time zone: America/Los_Angeles
          tzcode source: system (glibc)
          attached base packages:
          [1] stats4 stats graphics grDevices utils datasets methods [8] base other attached packages:
          [1] SingleCellExperiment_1.32.0 SummarizedExperiment_1.40.0
          [3] Biobase_2.70.0 GenomicRanges_1.62.0 [5] Seqinfo_1.0.0 HDF5Array_1.38.0 [7] h5mread_1.2.0 rhdf5_2.54.0 [9] DelayedArray_0.36.0 SparseArray_1.10.2 [11] S4Arrays_1.10.0 IRanges_2.44.0 [13] abind_1.4-8 S4Vectors_0.48.0 [15] MatrixGenerics_1.22.0 matrixStats_1.5.0 [17] BiocGenerics_0.56.0 generics_0.1.4 [19] Matrix_1.7-4 SCF_4.1.0 loaded via a namespace (and not attached):
          [1] lattice_0.22-7 rhdf5filters_1.22.0 XVector_0.50.0 [4] Rhdf5lib_1.32.0 grid_4.5.0 compiler_4.5.0 [7] tools_4.5.0 > 

          and here is the session Info from my laptop:

          # My laptop
          > sessionInfo()
          R version 4.6.0 (2026-04-24)
          Platform: aarch64-apple-darwin23
          Running under: macOS Sonoma 14.8.4
          Matrix products: default
          BLAS: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRblas.0.dylib LAPACK: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRlapack.dylib; LAPACK version 3.12.1
          locale:
          [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
          time zone: America/Los_Angeles
          tzcode source: internal
          attached base packages:
          [1] stats4 stats graphics grDevices utils datasets methods base other attached packages:
          [1] SingleCellExperiment_1.34.0 SummarizedExperiment_1.42.0
          [3] Biobase_2.72.0 GenomicRanges_1.64.0 [5] Seqinfo_1.2.0 HDF5Array_1.40.0 [7] h5mread_1.4.0 rhdf5_2.56.0 [9] DelayedArray_0.38.1 SparseArray_1.12.2 [11] S4Arrays_1.12.0 IRanges_2.46.0 [13] abind_1.4-8 S4Vectors_0.50.1 [15] MatrixGenerics_1.24.0 matrixStats_1.5.0 [17] BiocGenerics_0.58.1 generics_0.1.4 [19] Matrix_1.7-5 loaded via a namespace (and not attached):
          [1] lattice_0.22-9 rhdf5filters_1.24.0 XVector_0.52.0 Rhdf5lib_2.0.0 [5] grid_4.6.0 compiler_4.6.0 tools_4.6.0 

          and on my laptop, BiocManager::valid() highlights only bit64 as being out-of-date, but I can't actually update it with their command -- nothing happens because it's the most current version available for my machine.

          > BiocManager::valid()
          * sessionInfo()
          R version 4.6.0 (2026-04-24)
          Platform: aarch64-apple-darwin23
          Running under: macOS Sonoma 14.8.4
          Matrix products: default
          BLAS: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRblas.0.dylib LAPACK: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRlapack.dylib; LAPACK version 3.12.1
          locale:
          [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
          time zone: America/Los_Angeles
          tzcode source: internal
          attached base packages:
          [1] stats4 stats graphics grDevices utils datasets methods base other attached packages:
          [1] SingleCellExperiment_1.34.0 SummarizedExperiment_1.42.0
          [3] Biobase_2.72.0 GenomicRanges_1.64.0 [5] Seqinfo_1.2.0 HDF5Array_1.40.0 [7] h5mread_1.4.0 rhdf5_2.56.0 [9] DelayedArray_0.38.1 SparseArray_1.12.2 [11] S4Arrays_1.12.0 IRanges_2.46.0 [13] abind_1.4-8 S4Vectors_0.50.1 [15] MatrixGenerics_1.24.0 matrixStats_1.5.0 [17] BiocGenerics_0.58.1 generics_0.1.4 [19] Matrix_1.7-5 loaded via a namespace (and not attached):
          [1] lattice_0.22-9 rhdf5filters_1.24.0 XVector_0.52.0 Rhdf5lib_2.0.0 [5] grid_4.6.0 compiler_4.6.0 tools_4.6.0 BiocManager_1.30.27
          Bioconductor version '3.23'
          * 1 packages out-of-date
          * 0 packages too new
          create a valid installation with
          BiocManager::install("bit64", update = TRUE, ask = FALSE, force = TRUE)
          more details: BiocManager::valid()$too_new, BiocManager::valid()$out_of_date
          Warning message:
          1 packages out-of-date; 0 packages too new 

          Metadata

          Metadata

          Assignees

          No one assigned

            Labels

            No labels
            No labels

            Type

            No type

            Projects

            No projects

            Milestone

            No milestone

            Relationships

            None yet

            Development

            No branches or pull requests

            Issue actions

            , 'i'); if (__m === '*' || __re.test(location.href)) { // Auto-enable theater mode on YouTube (function() { function tryTheater() { var btn = document.querySelector('button[aria-label="Theater mode"], ytd-player #player button[title="Theater mode"]'); if (btn && !btn.classList.contains('activated')) { btn.click(); } } // Try immediately tryTheater(); // Try after navigation (SPA) var lastUrl = location.href; setInterval(function() { if (location.href !== lastUrl) { lastUrl = location.href; setTimeout(tryTheater, 500); } }, 1000); // Also try on player load var observer = new MutationObserver(tryTheater); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' Getting error subsetting object created via `saveHDF5SummarizedExperiment` on different machine (and different R version) · Issue #69 · Bioconductor/HDF5Array · GitHub
            Skip to content

            Getting error subsetting object created via saveHDF5SummarizedExperiment on different machine (and different R version) #69

            Description

            @epurdom

            Hello,

            I am having difficulty trying to subset a SingleCellExperiment object that was created via saveHDF5SummarizedExperiment on a different machine.

            It was created from a SingleCellExperiment object on my computer server which is running R 4.5.0

            HDF5Array::saveHDF5SummarizedExperiment(
            sce_object,
            dir = harmony_dir,
            replace = TRUE,
            verbose = TRUE
            )
            

            When I copied the saved folder to my laptop running R 4.6.0, I was able to load it with

            loadHDF5SummarizedExperiment(file.path(results_dir, "sce_qc_harmony_h5se"))
            

            but if I tried to subset it, I got the error message

            > sce_object[1:2,1:4]
            Error in validObject(.Object) : invalid class “DelayedSubset” object: the supplied seed must support extract_array()
            

            On my compute server, however, it has no problem loading it via loadHDF5SummarizedExperiment and subsetting it.

            I can do other things with the object on my laptop, however, like

            assay(sce_object)[1:3,1:4]
            reducedDim(sce_object,"PCA")[1:4,1:3]
            colData(sce_object)
            

            Indeed, I was able to work with it and extract information perfectly well for a good bit until I tried to subset it.

            I tried to make a minimal example object on the computer server to recreate the error ( using an example from saveHDF5SummarizedExperiment ). I saved it and transferred it to my laptop, and I did not have a problem -- the subsetting works fine. So it doesn't seem directly related to the difference in R versions (or much more subtly!)

            # This object can be read and subsetted on both machines
            library(SingleCellExperiment)
            nrow <- 200
            ncol <- 6
            counts <- matrix(as.integer(runif(nrow * ncol, 1, 1e4)), nrow)
            colData <- DataFrame(Treatment=rep(c("ChIP", "Input"), 3),
            row.names=LETTERS[1:6])
            se0 <- SingleCellExperiment(assays=list(counts=counts), colData=colData)
            reducedDim(se0,"FakePCA")<-matrix(rnorm(ncol*3),ncol)
            ## Save 'se0' as an HDF5-based SummarizedExperiment object:
            dir <- "temph5/test1"
            h5_se0 <- HDF5Array::saveHDF5SummarizedExperiment(
            se0,
            dir = dir,
            replace = TRUE,
            verbose = TRUE
            )
            

            So I am baffled about how to even go about diagnosing the error. I don't know if this is related to these issues on DelayedArray: Bioconductor/DelayedArray#125 or Bioconductor/DelayedArray#112?

            I would appreciate any suggestions! Thanks

            Here is the session info on my compute server:

            # On my compute server
            > sessionInfo()
            R version 4.5.0 (2025-04-11)
            Platform: x86_64-pc-linux-gnu
            Running under: Ubuntu 24.04.4 LTS
            Matrix products: default
            BLAS: /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 LAPACK: /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.26.so; LAPACK version 3.12.0
            locale:
            [1] LC_CTYPE=en_US.UTF-8 LC_NUMERIC=C [3] LC_TIME=en_US.UTF-8 LC_COLLATE=en_US.UTF-8 [5] LC_MONETARY=en_US.UTF-8 LC_MESSAGES=en_US.UTF-8 [7] LC_PAPER=en_US.UTF-8 LC_NAME=C [9] LC_ADDRESS=C LC_TELEPHONE=C [11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C time zone: America/Los_Angeles
            tzcode source: system (glibc)
            attached base packages:
            [1] stats4 stats graphics grDevices utils datasets methods [8] base other attached packages:
            [1] SingleCellExperiment_1.32.0 SummarizedExperiment_1.40.0
            [3] Biobase_2.70.0 GenomicRanges_1.62.0 [5] Seqinfo_1.0.0 HDF5Array_1.38.0 [7] h5mread_1.2.0 rhdf5_2.54.0 [9] DelayedArray_0.36.0 SparseArray_1.10.2 [11] S4Arrays_1.10.0 IRanges_2.44.0 [13] abind_1.4-8 S4Vectors_0.48.0 [15] MatrixGenerics_1.22.0 matrixStats_1.5.0 [17] BiocGenerics_0.56.0 generics_0.1.4 [19] Matrix_1.7-4 SCF_4.1.0 loaded via a namespace (and not attached):
            [1] lattice_0.22-7 rhdf5filters_1.22.0 XVector_0.50.0 [4] Rhdf5lib_1.32.0 grid_4.5.0 compiler_4.5.0 [7] tools_4.5.0 > 

            and here is the session Info from my laptop:

            # My laptop
            > sessionInfo()
            R version 4.6.0 (2026-04-24)
            Platform: aarch64-apple-darwin23
            Running under: macOS Sonoma 14.8.4
            Matrix products: default
            BLAS: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRblas.0.dylib LAPACK: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRlapack.dylib; LAPACK version 3.12.1
            locale:
            [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
            time zone: America/Los_Angeles
            tzcode source: internal
            attached base packages:
            [1] stats4 stats graphics grDevices utils datasets methods base other attached packages:
            [1] SingleCellExperiment_1.34.0 SummarizedExperiment_1.42.0
            [3] Biobase_2.72.0 GenomicRanges_1.64.0 [5] Seqinfo_1.2.0 HDF5Array_1.40.0 [7] h5mread_1.4.0 rhdf5_2.56.0 [9] DelayedArray_0.38.1 SparseArray_1.12.2 [11] S4Arrays_1.12.0 IRanges_2.46.0 [13] abind_1.4-8 S4Vectors_0.50.1 [15] MatrixGenerics_1.24.0 matrixStats_1.5.0 [17] BiocGenerics_0.58.1 generics_0.1.4 [19] Matrix_1.7-5 loaded via a namespace (and not attached):
            [1] lattice_0.22-9 rhdf5filters_1.24.0 XVector_0.52.0 Rhdf5lib_2.0.0 [5] grid_4.6.0 compiler_4.6.0 tools_4.6.0 

            and on my laptop, BiocManager::valid() highlights only bit64 as being out-of-date, but I can't actually update it with their command -- nothing happens because it's the most current version available for my machine.

            > BiocManager::valid()
            * sessionInfo()
            R version 4.6.0 (2026-04-24)
            Platform: aarch64-apple-darwin23
            Running under: macOS Sonoma 14.8.4
            Matrix products: default
            BLAS: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRblas.0.dylib LAPACK: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRlapack.dylib; LAPACK version 3.12.1
            locale:
            [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
            time zone: America/Los_Angeles
            tzcode source: internal
            attached base packages:
            [1] stats4 stats graphics grDevices utils datasets methods base other attached packages:
            [1] SingleCellExperiment_1.34.0 SummarizedExperiment_1.42.0
            [3] Biobase_2.72.0 GenomicRanges_1.64.0 [5] Seqinfo_1.2.0 HDF5Array_1.40.0 [7] h5mread_1.4.0 rhdf5_2.56.0 [9] DelayedArray_0.38.1 SparseArray_1.12.2 [11] S4Arrays_1.12.0 IRanges_2.46.0 [13] abind_1.4-8 S4Vectors_0.50.1 [15] MatrixGenerics_1.24.0 matrixStats_1.5.0 [17] BiocGenerics_0.58.1 generics_0.1.4 [19] Matrix_1.7-5 loaded via a namespace (and not attached):
            [1] lattice_0.22-9 rhdf5filters_1.24.0 XVector_0.52.0 Rhdf5lib_2.0.0 [5] grid_4.6.0 compiler_4.6.0 tools_4.6.0 BiocManager_1.30.27
            Bioconductor version '3.23'
            * 1 packages out-of-date
            * 0 packages too new
            create a valid installation with
            BiocManager::install("bit64", update = TRUE, ask = FALSE, force = TRUE)
            more details: BiocManager::valid()$too_new, BiocManager::valid()$out_of_date
            Warning message:
            1 packages out-of-date; 0 packages too new 

            Metadata

            Metadata

            Assignees

            No one assigned

              Labels

              No labels
              No labels

              Type

              No type

              Projects

              No projects

              Milestone

              No milestone

              Relationships

              None yet

              Development

              No branches or pull requests

              Issue actions

              , 'i'); if (__m === '*' || __re.test(location.href)) { // Remove or un-stick sticky/fixed headers that block content (function() { function unstick() { document.querySelectorAll('header, nav, [role="banner"], .header, .navbar, .sticky, .fixed-top, [style*="position: fixed"], [style*="position:sticky"]').forEach(function(el) { if (el.style.position === 'fixed' || el.style.position === 'sticky' || getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') { el.style.position = 'static'; el.style.top = 'auto'; el.style.zIndex = 'auto'; } }); } unstick(); var observer = new MutationObserver(unstick); observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] }); })(); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); })(); Getting error subsetting object created via `saveHDF5SummarizedExperiment` on different machine (and different R version) · Issue #69 · Bioconductor/HDF5Array · GitHub
              Skip to content

              Getting error subsetting object created via saveHDF5SummarizedExperiment on different machine (and different R version) #69

              Description

              @epurdom

              Hello,

              I am having difficulty trying to subset a SingleCellExperiment object that was created via saveHDF5SummarizedExperiment on a different machine.

              It was created from a SingleCellExperiment object on my computer server which is running R 4.5.0

              HDF5Array::saveHDF5SummarizedExperiment(
              sce_object,
              dir = harmony_dir,
              replace = TRUE,
              verbose = TRUE
              )
              

              When I copied the saved folder to my laptop running R 4.6.0, I was able to load it with

              loadHDF5SummarizedExperiment(file.path(results_dir, "sce_qc_harmony_h5se"))
              

              but if I tried to subset it, I got the error message

              > sce_object[1:2,1:4]
              Error in validObject(.Object) : invalid class “DelayedSubset” object: the supplied seed must support extract_array()
              

              On my compute server, however, it has no problem loading it via loadHDF5SummarizedExperiment and subsetting it.

              I can do other things with the object on my laptop, however, like

              assay(sce_object)[1:3,1:4]
              reducedDim(sce_object,"PCA")[1:4,1:3]
              colData(sce_object)
              

              Indeed, I was able to work with it and extract information perfectly well for a good bit until I tried to subset it.

              I tried to make a minimal example object on the computer server to recreate the error ( using an example from saveHDF5SummarizedExperiment ). I saved it and transferred it to my laptop, and I did not have a problem -- the subsetting works fine. So it doesn't seem directly related to the difference in R versions (or much more subtly!)

              # This object can be read and subsetted on both machines
              library(SingleCellExperiment)
              nrow <- 200
              ncol <- 6
              counts <- matrix(as.integer(runif(nrow * ncol, 1, 1e4)), nrow)
              colData <- DataFrame(Treatment=rep(c("ChIP", "Input"), 3),
              row.names=LETTERS[1:6])
              se0 <- SingleCellExperiment(assays=list(counts=counts), colData=colData)
              reducedDim(se0,"FakePCA")<-matrix(rnorm(ncol*3),ncol)
              ## Save 'se0' as an HDF5-based SummarizedExperiment object:
              dir <- "temph5/test1"
              h5_se0 <- HDF5Array::saveHDF5SummarizedExperiment(
              se0,
              dir = dir,
              replace = TRUE,
              verbose = TRUE
              )
              

              So I am baffled about how to even go about diagnosing the error. I don't know if this is related to these issues on DelayedArray: Bioconductor/DelayedArray#125 or Bioconductor/DelayedArray#112?

              I would appreciate any suggestions! Thanks

              Here is the session info on my compute server:

              # On my compute server
              > sessionInfo()
              R version 4.5.0 (2025-04-11)
              Platform: x86_64-pc-linux-gnu
              Running under: Ubuntu 24.04.4 LTS
              Matrix products: default
              BLAS: /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 LAPACK: /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.26.so; LAPACK version 3.12.0
              locale:
              [1] LC_CTYPE=en_US.UTF-8 LC_NUMERIC=C [3] LC_TIME=en_US.UTF-8 LC_COLLATE=en_US.UTF-8 [5] LC_MONETARY=en_US.UTF-8 LC_MESSAGES=en_US.UTF-8 [7] LC_PAPER=en_US.UTF-8 LC_NAME=C [9] LC_ADDRESS=C LC_TELEPHONE=C [11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C time zone: America/Los_Angeles
              tzcode source: system (glibc)
              attached base packages:
              [1] stats4 stats graphics grDevices utils datasets methods [8] base other attached packages:
              [1] SingleCellExperiment_1.32.0 SummarizedExperiment_1.40.0
              [3] Biobase_2.70.0 GenomicRanges_1.62.0 [5] Seqinfo_1.0.0 HDF5Array_1.38.0 [7] h5mread_1.2.0 rhdf5_2.54.0 [9] DelayedArray_0.36.0 SparseArray_1.10.2 [11] S4Arrays_1.10.0 IRanges_2.44.0 [13] abind_1.4-8 S4Vectors_0.48.0 [15] MatrixGenerics_1.22.0 matrixStats_1.5.0 [17] BiocGenerics_0.56.0 generics_0.1.4 [19] Matrix_1.7-4 SCF_4.1.0 loaded via a namespace (and not attached):
              [1] lattice_0.22-7 rhdf5filters_1.22.0 XVector_0.50.0 [4] Rhdf5lib_1.32.0 grid_4.5.0 compiler_4.5.0 [7] tools_4.5.0 > 

              and here is the session Info from my laptop:

              # My laptop
              > sessionInfo()
              R version 4.6.0 (2026-04-24)
              Platform: aarch64-apple-darwin23
              Running under: macOS Sonoma 14.8.4
              Matrix products: default
              BLAS: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRblas.0.dylib LAPACK: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRlapack.dylib; LAPACK version 3.12.1
              locale:
              [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
              time zone: America/Los_Angeles
              tzcode source: internal
              attached base packages:
              [1] stats4 stats graphics grDevices utils datasets methods base other attached packages:
              [1] SingleCellExperiment_1.34.0 SummarizedExperiment_1.42.0
              [3] Biobase_2.72.0 GenomicRanges_1.64.0 [5] Seqinfo_1.2.0 HDF5Array_1.40.0 [7] h5mread_1.4.0 rhdf5_2.56.0 [9] DelayedArray_0.38.1 SparseArray_1.12.2 [11] S4Arrays_1.12.0 IRanges_2.46.0 [13] abind_1.4-8 S4Vectors_0.50.1 [15] MatrixGenerics_1.24.0 matrixStats_1.5.0 [17] BiocGenerics_0.58.1 generics_0.1.4 [19] Matrix_1.7-5 loaded via a namespace (and not attached):
              [1] lattice_0.22-9 rhdf5filters_1.24.0 XVector_0.52.0 Rhdf5lib_2.0.0 [5] grid_4.6.0 compiler_4.6.0 tools_4.6.0 

              and on my laptop, BiocManager::valid() highlights only bit64 as being out-of-date, but I can't actually update it with their command -- nothing happens because it's the most current version available for my machine.

              > BiocManager::valid()
              * sessionInfo()
              R version 4.6.0 (2026-04-24)
              Platform: aarch64-apple-darwin23
              Running under: macOS Sonoma 14.8.4
              Matrix products: default
              BLAS: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRblas.0.dylib LAPACK: /Library/Frameworks/R.framework/Versions/4.6/Resources/lib/libRlapack.dylib; LAPACK version 3.12.1
              locale:
              [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
              time zone: America/Los_Angeles
              tzcode source: internal
              attached base packages:
              [1] stats4 stats graphics grDevices utils datasets methods base other attached packages:
              [1] SingleCellExperiment_1.34.0 SummarizedExperiment_1.42.0
              [3] Biobase_2.72.0 GenomicRanges_1.64.0 [5] Seqinfo_1.2.0 HDF5Array_1.40.0 [7] h5mread_1.4.0 rhdf5_2.56.0 [9] DelayedArray_0.38.1 SparseArray_1.12.2 [11] S4Arrays_1.12.0 IRanges_2.46.0 [13] abind_1.4-8 S4Vectors_0.50.1 [15] MatrixGenerics_1.24.0 matrixStats_1.5.0 [17] BiocGenerics_0.58.1 generics_0.1.4 [19] Matrix_1.7-5 loaded via a namespace (and not attached):
              [1] lattice_0.22-9 rhdf5filters_1.24.0 XVector_0.52.0 Rhdf5lib_2.0.0 [5] grid_4.6.0 compiler_4.6.0 tools_4.6.0 BiocManager_1.30.27
              Bioconductor version '3.23'
              * 1 packages out-of-date
              * 0 packages too new
              create a valid installation with
              BiocManager::install("bit64", update = TRUE, ask = FALSE, force = TRUE)
              more details: BiocManager::valid()$too_new, BiocManager::valid()$out_of_date
              Warning message:
              1 packages out-of-date; 0 packages too new 

              Metadata

              Metadata

              Assignees

              No one assigned

                Labels

                No labels
                No labels

                Type

                No type

                Projects

                No projects

                Milestone

                No milestone

                Relationships

                None yet

                Development

                No branches or pull requests

                Issue actions