ARROW-1278: [Integration] Adding integration tests for fixed_size_list - #4309

Closed
bkietz wants to merge 3 commits into
apache:masterfrom
bkietz:1278-integration-tests-for-fixed-size-list
Closed

ARROW-1278: [Integration] Adding integration tests for fixed_size_list#4309
bkietz wants to merge 3 commits into
apache:masterfrom
bkietz:1278-integration-tests-for-fixed-size-list

Conversation

@bkietz

Copy link
Copy Markdown
Member

Adds integration tests for fixed_size_list
Also adds support for fixed_size_list to RecordBatchSerializer, which was omitted in #4278

@codecov-io

codecov-io commented May 14, 2019

Copy link
Copy Markdown

Codecov Report

Merging #4309 into master will increase coverage by 0.42%.
The diff coverage is 0%.

Impacted file tree graph

@@ Coverage Diff @@## master #4309 +/- ##
==========================================
+ Coverage 88.54% 88.97% +0.42% 
==========================================
Files 796 704 -92 Lines 103206 94725 -8481 Branches 1253 0 -1253 ==========================================
- Hits 91388 84277 -7111 + Misses 11573 10448 -1125 + Partials 245 0 -245
Impacted FilesCoverage Δ
cpp/src/arrow/ipc/writer.cc93.04% <0%> (-1.15%)⬇️
cpp/src/arrow/vendored/datetime/date.h26.35% <0%> (-4.28%)⬇️
cpp/src/plasma/thirdparty/ae/ae.c70.75% <0%> (-0.95%)⬇️
cpp/src/arrow/python/arrow_to_pandas.cc91.55% <0%> (-0.04%)⬇️
cpp/src/arrow/pretty_print.cc83.18% <0%> (ø)⬆️
cpp/src/arrow/vendored/datetime/tz.h43.47% <0%> (ø)⬆️
cpp/src/arrow/vendored/datetime/tz_private.h33.33% <0%> (ø)⬆️
cpp/src/gandiva/precompiled/epoch_time_point.h100% <0%> (ø)⬆️
cpp/src/arrow/pretty_print-test.cc100% <0%> (ø)⬆️
cpp/src/arrow/python/python-test.cc100% <0%> (ø)⬆️
... and 219 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 24c42f7...8b356f3. Read the comment docs.

@bkietz

Copy link
Copy Markdown
MemberAuthor

waiting for #4316 to be merged

@wesm

wesm commented May 16, 2019

Copy link
Copy Markdown
Member

Is it expected for the integration tests to pass (there is support in Java for reading these?)?

@bkietz

Copy link
Copy Markdown
MemberAuthor

It seems like there is support: https://github.com/apache/arrow/blob/master/java/vector/src/test/java/org/apache/arrow/vector/ipc/TestArrowFile.java#L623

I'd need to spend more time figuring out exactly which java code is exercised by integration_test.py

@wesm

wesm commented May 17, 2019

Copy link
Copy Markdown
Member

I just poked around the Java codebase. It seems it may work by accident, but it is not tested

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz what are the next steps here, do you need help with something on the Java side?

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from e287bd8 to ae45d3fCompareJune 11, 2019 13:17
@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield I have investigated the fixed size list tests. They're spare but present so I think we should merge this and add a JIRA to test fixed size list more thoroughly in Java.

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from ae45d3f to 5806637CompareJune 11, 2019 15:41
@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz sounds good, can you rebase?

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from 5806637 to e7ed001CompareJune 12, 2019 15:49
@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield rebased and green except for a coredump in test_csv (I don't think that was me)

Comment threadcpp/Dockerfile
g++ \
gcc \
git \
ninja-build \

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why this change?

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@emkornfield ninja is installed in ci/conda_env_cpp.yml so isn't this unused?

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz one small question about a change to docker file. Otherwise LGTM

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz potentially not an expert on docker stuff, so I'd prefer cleanup as a separate PR

@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield reverted and green

@emkornfield

Copy link
Copy Markdown
Contributor

+1 LGTM, please file a JIRA for the follow-up work.

@bkietz
bkietz deleted the 1278-integration-tests-for-fixed-size-list branch February 25, 2021 16:39
@codecov-commenter

Copy link
Copy Markdown

Codecov Report

Attention: Patch coverage is 0% with 7 lines in your changes missing coverage. Please review.

Project coverage is 88.97%. Comparing base (24c42f7) to head (8b356f3).

Files with missing linesPatch %Lines
cpp/src/arrow/ipc/writer.cc0.00%7 Missing ⚠️
Additional details and impacted files
@@ Coverage Diff @@## master #4309 +/- ##
==========================================
+ Coverage 88.54% 88.97% +0.42% 
==========================================
Files 796 704 -92 Lines 103206 94725 -8481 Branches 1253 0 -1253 ==========================================
- Hits 91388 84277 -7111 + Misses 11573 10448 -1125 + Partials 245 0 -245 

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

pribor pushed a commit to GlobalWebIndex/arrow that referenced this pull request Oct 24, 2025
Adds integration tests for fixed_size_list
Also adds support for fixed_size_list to RecordBatchSerializer, which was omitted in apache#4278
Author: Benjamin Kietzman <bengilgit@gmail.com>
Closesapache#4309 from bkietz/1278-integration-tests-for-fixed-size-list and squashes the following commits:
8b356f3 <Benjamin Kietzman> revert removal of ninja-build from dockerfile
e7ed001 <Benjamin Kietzman> fix flake8 error
8ab4efc <Benjamin Kietzman> Adding integration tests for fixed_size_list
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@bkietz@codecov-io@wesm@emkornfield@codecov-commenter
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all
 blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
Skip to content

ARROW-1278: [Integration] Adding integration tests for fixed_size_list - #4309

Closed
bkietz wants to merge 3 commits into
apache:masterfrom
bkietz:1278-integration-tests-for-fixed-size-list
Closed

ARROW-1278: [Integration] Adding integration tests for fixed_size_list#4309
bkietz wants to merge 3 commits into
apache:masterfrom
bkietz:1278-integration-tests-for-fixed-size-list

Conversation

@bkietz

Copy link
Copy Markdown
Member

Adds integration tests for fixed_size_list
Also adds support for fixed_size_list to RecordBatchSerializer, which was omitted in #4278

@codecov-io

codecov-io commented May 14, 2019

Copy link
Copy Markdown

Codecov Report

Merging #4309 into master will increase coverage by 0.42%.
The diff coverage is 0%.

Impacted file tree graph

@@ Coverage Diff @@## master #4309 +/- ##
==========================================
+ Coverage 88.54% 88.97% +0.42% 
==========================================
Files 796 704 -92 Lines 103206 94725 -8481 Branches 1253 0 -1253 ==========================================
- Hits 91388 84277 -7111 + Misses 11573 10448 -1125 + Partials 245 0 -245
Impacted FilesCoverage Δ
cpp/src/arrow/ipc/writer.cc93.04% <0%> (-1.15%)⬇️
cpp/src/arrow/vendored/datetime/date.h26.35% <0%> (-4.28%)⬇️
cpp/src/plasma/thirdparty/ae/ae.c70.75% <0%> (-0.95%)⬇️
cpp/src/arrow/python/arrow_to_pandas.cc91.55% <0%> (-0.04%)⬇️
cpp/src/arrow/pretty_print.cc83.18% <0%> (ø)⬆️
cpp/src/arrow/vendored/datetime/tz.h43.47% <0%> (ø)⬆️
cpp/src/arrow/vendored/datetime/tz_private.h33.33% <0%> (ø)⬆️
cpp/src/gandiva/precompiled/epoch_time_point.h100% <0%> (ø)⬆️
cpp/src/arrow/pretty_print-test.cc100% <0%> (ø)⬆️
cpp/src/arrow/python/python-test.cc100% <0%> (ø)⬆️
... and 219 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 24c42f7...8b356f3. Read the comment docs.

@bkietz

Copy link
Copy Markdown
MemberAuthor

waiting for #4316 to be merged

@wesm

wesm commented May 16, 2019

Copy link
Copy Markdown
Member

Is it expected for the integration tests to pass (there is support in Java for reading these?)?

@bkietz

Copy link
Copy Markdown
MemberAuthor

It seems like there is support: https://github.com/apache/arrow/blob/master/java/vector/src/test/java/org/apache/arrow/vector/ipc/TestArrowFile.java#L623

I'd need to spend more time figuring out exactly which java code is exercised by integration_test.py

@wesm

wesm commented May 17, 2019

Copy link
Copy Markdown
Member

I just poked around the Java codebase. It seems it may work by accident, but it is not tested

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz what are the next steps here, do you need help with something on the Java side?

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from e287bd8 to ae45d3fCompareJune 11, 2019 13:17
@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield I have investigated the fixed size list tests. They're spare but present so I think we should merge this and add a JIRA to test fixed size list more thoroughly in Java.

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from ae45d3f to 5806637CompareJune 11, 2019 15:41
@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz sounds good, can you rebase?

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from 5806637 to e7ed001CompareJune 12, 2019 15:49
@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield rebased and green except for a coredump in test_csv (I don't think that was me)

Comment threadcpp/Dockerfile
g++ \
gcc \
git \
ninja-build \

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why this change?

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@emkornfield ninja is installed in ci/conda_env_cpp.yml so isn't this unused?

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz one small question about a change to docker file. Otherwise LGTM

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz potentially not an expert on docker stuff, so I'd prefer cleanup as a separate PR

@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield reverted and green

@emkornfield

Copy link
Copy Markdown
Contributor

+1 LGTM, please file a JIRA for the follow-up work.

@bkietz
bkietz deleted the 1278-integration-tests-for-fixed-size-list branch February 25, 2021 16:39
@codecov-commenter

Copy link
Copy Markdown

Codecov Report

Attention: Patch coverage is 0% with 7 lines in your changes missing coverage. Please review.

Project coverage is 88.97%. Comparing base (24c42f7) to head (8b356f3).

Files with missing linesPatch %Lines
cpp/src/arrow/ipc/writer.cc0.00%7 Missing ⚠️
Additional details and impacted files
@@ Coverage Diff @@## master #4309 +/- ##
==========================================
+ Coverage 88.54% 88.97% +0.42% 
==========================================
Files 796 704 -92 Lines 103206 94725 -8481 Branches 1253 0 -1253 ==========================================
- Hits 91388 84277 -7111 + Misses 11573 10448 -1125 + Partials 245 0 -245 

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

pribor pushed a commit to GlobalWebIndex/arrow that referenced this pull request Oct 24, 2025
Adds integration tests for fixed_size_list
Also adds support for fixed_size_list to RecordBatchSerializer, which was omitted in apache#4278
Author: Benjamin Kietzman <bengilgit@gmail.com>
Closesapache#4309 from bkietz/1278-integration-tests-for-fixed-size-list and squashes the following commits:
8b356f3 <Benjamin Kietzman> revert removal of ninja-build from dockerfile
e7ed001 <Benjamin Kietzman> fix flake8 error
8ab4efc <Benjamin Kietzman> Adding integration tests for fixed_size_list
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@bkietz@codecov-io@wesm@emkornfield@codecov-commenter
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix"); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

ARROW-1278: [Integration] Adding integration tests for fixed_size_list - #4309

Closed
bkietz wants to merge 3 commits into
apache:masterfrom
bkietz:1278-integration-tests-for-fixed-size-list
Closed

ARROW-1278: [Integration] Adding integration tests for fixed_size_list#4309
bkietz wants to merge 3 commits into
apache:masterfrom
bkietz:1278-integration-tests-for-fixed-size-list

Conversation

@bkietz

Copy link
Copy Markdown
Member

Adds integration tests for fixed_size_list
Also adds support for fixed_size_list to RecordBatchSerializer, which was omitted in #4278

@codecov-io

codecov-io commented May 14, 2019

Copy link
Copy Markdown

Codecov Report

Merging #4309 into master will increase coverage by 0.42%.
The diff coverage is 0%.

Impacted file tree graph

@@ Coverage Diff @@## master #4309 +/- ##
==========================================
+ Coverage 88.54% 88.97% +0.42% 
==========================================
Files 796 704 -92 Lines 103206 94725 -8481 Branches 1253 0 -1253 ==========================================
- Hits 91388 84277 -7111 + Misses 11573 10448 -1125 + Partials 245 0 -245
Impacted FilesCoverage Δ
cpp/src/arrow/ipc/writer.cc93.04% <0%> (-1.15%)⬇️
cpp/src/arrow/vendored/datetime/date.h26.35% <0%> (-4.28%)⬇️
cpp/src/plasma/thirdparty/ae/ae.c70.75% <0%> (-0.95%)⬇️
cpp/src/arrow/python/arrow_to_pandas.cc91.55% <0%> (-0.04%)⬇️
cpp/src/arrow/pretty_print.cc83.18% <0%> (ø)⬆️
cpp/src/arrow/vendored/datetime/tz.h43.47% <0%> (ø)⬆️
cpp/src/arrow/vendored/datetime/tz_private.h33.33% <0%> (ø)⬆️
cpp/src/gandiva/precompiled/epoch_time_point.h100% <0%> (ø)⬆️
cpp/src/arrow/pretty_print-test.cc100% <0%> (ø)⬆️
cpp/src/arrow/python/python-test.cc100% <0%> (ø)⬆️
... and 219 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 24c42f7...8b356f3. Read the comment docs.

@bkietz

Copy link
Copy Markdown
MemberAuthor

waiting for #4316 to be merged

@wesm

wesm commented May 16, 2019

Copy link
Copy Markdown
Member

Is it expected for the integration tests to pass (there is support in Java for reading these?)?

@bkietz

Copy link
Copy Markdown
MemberAuthor

It seems like there is support: https://github.com/apache/arrow/blob/master/java/vector/src/test/java/org/apache/arrow/vector/ipc/TestArrowFile.java#L623

I'd need to spend more time figuring out exactly which java code is exercised by integration_test.py

@wesm

wesm commented May 17, 2019

Copy link
Copy Markdown
Member

I just poked around the Java codebase. It seems it may work by accident, but it is not tested

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz what are the next steps here, do you need help with something on the Java side?

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from e287bd8 to ae45d3fCompareJune 11, 2019 13:17
@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield I have investigated the fixed size list tests. They're spare but present so I think we should merge this and add a JIRA to test fixed size list more thoroughly in Java.

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from ae45d3f to 5806637CompareJune 11, 2019 15:41
@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz sounds good, can you rebase?

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from 5806637 to e7ed001CompareJune 12, 2019 15:49
@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield rebased and green except for a coredump in test_csv (I don't think that was me)

Comment threadcpp/Dockerfile
g++ \
gcc \
git \
ninja-build \

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why this change?

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@emkornfield ninja is installed in ci/conda_env_cpp.yml so isn't this unused?

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz one small question about a change to docker file. Otherwise LGTM

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz potentially not an expert on docker stuff, so I'd prefer cleanup as a separate PR

@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield reverted and green

@emkornfield

Copy link
Copy Markdown
Contributor

+1 LGTM, please file a JIRA for the follow-up work.

@bkietz
bkietz deleted the 1278-integration-tests-for-fixed-size-list branch February 25, 2021 16:39
@codecov-commenter

Copy link
Copy Markdown

Codecov Report

Attention: Patch coverage is 0% with 7 lines in your changes missing coverage. Please review.

Project coverage is 88.97%. Comparing base (24c42f7) to head (8b356f3).

Files with missing linesPatch %Lines
cpp/src/arrow/ipc/writer.cc0.00%7 Missing ⚠️
Additional details and impacted files
@@ Coverage Diff @@## master #4309 +/- ##
==========================================
+ Coverage 88.54% 88.97% +0.42% 
==========================================
Files 796 704 -92 Lines 103206 94725 -8481 Branches 1253 0 -1253 ==========================================
- Hits 91388 84277 -7111 + Misses 11573 10448 -1125 + Partials 245 0 -245 

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

pribor pushed a commit to GlobalWebIndex/arrow that referenced this pull request Oct 24, 2025
Adds integration tests for fixed_size_list
Also adds support for fixed_size_list to RecordBatchSerializer, which was omitted in apache#4278
Author: Benjamin Kietzman <bengilgit@gmail.com>
Closesapache#4309 from bkietz/1278-integration-tests-for-fixed-size-list and squashes the following commits:
8b356f3 <Benjamin Kietzman> revert removal of ninja-build from dockerfile
e7ed001 <Benjamin Kietzman> fix flake8 error
8ab4efc <Benjamin Kietzman> Adding integration tests for fixed_size_list
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@bkietz@codecov-io@wesm@emkornfield@codecov-commenter
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms"); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

ARROW-1278: [Integration] Adding integration tests for fixed_size_list - #4309

Closed
bkietz wants to merge 3 commits into
apache:masterfrom
bkietz:1278-integration-tests-for-fixed-size-list
Closed

ARROW-1278: [Integration] Adding integration tests for fixed_size_list#4309
bkietz wants to merge 3 commits into
apache:masterfrom
bkietz:1278-integration-tests-for-fixed-size-list

Conversation

@bkietz

Copy link
Copy Markdown
Member

Adds integration tests for fixed_size_list
Also adds support for fixed_size_list to RecordBatchSerializer, which was omitted in #4278

@codecov-io

codecov-io commented May 14, 2019

Copy link
Copy Markdown

Codecov Report

Merging #4309 into master will increase coverage by 0.42%.
The diff coverage is 0%.

Impacted file tree graph

@@ Coverage Diff @@## master #4309 +/- ##
==========================================
+ Coverage 88.54% 88.97% +0.42% 
==========================================
Files 796 704 -92 Lines 103206 94725 -8481 Branches 1253 0 -1253 ==========================================
- Hits 91388 84277 -7111 + Misses 11573 10448 -1125 + Partials 245 0 -245
Impacted FilesCoverage Δ
cpp/src/arrow/ipc/writer.cc93.04% <0%> (-1.15%)⬇️
cpp/src/arrow/vendored/datetime/date.h26.35% <0%> (-4.28%)⬇️
cpp/src/plasma/thirdparty/ae/ae.c70.75% <0%> (-0.95%)⬇️
cpp/src/arrow/python/arrow_to_pandas.cc91.55% <0%> (-0.04%)⬇️
cpp/src/arrow/pretty_print.cc83.18% <0%> (ø)⬆️
cpp/src/arrow/vendored/datetime/tz.h43.47% <0%> (ø)⬆️
cpp/src/arrow/vendored/datetime/tz_private.h33.33% <0%> (ø)⬆️
cpp/src/gandiva/precompiled/epoch_time_point.h100% <0%> (ø)⬆️
cpp/src/arrow/pretty_print-test.cc100% <0%> (ø)⬆️
cpp/src/arrow/python/python-test.cc100% <0%> (ø)⬆️
... and 219 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 24c42f7...8b356f3. Read the comment docs.

@bkietz

Copy link
Copy Markdown
MemberAuthor

waiting for #4316 to be merged

@wesm

wesm commented May 16, 2019

Copy link
Copy Markdown
Member

Is it expected for the integration tests to pass (there is support in Java for reading these?)?

@bkietz

Copy link
Copy Markdown
MemberAuthor

It seems like there is support: https://github.com/apache/arrow/blob/master/java/vector/src/test/java/org/apache/arrow/vector/ipc/TestArrowFile.java#L623

I'd need to spend more time figuring out exactly which java code is exercised by integration_test.py

@wesm

wesm commented May 17, 2019

Copy link
Copy Markdown
Member

I just poked around the Java codebase. It seems it may work by accident, but it is not tested

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz what are the next steps here, do you need help with something on the Java side?

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from e287bd8 to ae45d3fCompareJune 11, 2019 13:17
@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield I have investigated the fixed size list tests. They're spare but present so I think we should merge this and add a JIRA to test fixed size list more thoroughly in Java.

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from ae45d3f to 5806637CompareJune 11, 2019 15:41
@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz sounds good, can you rebase?

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from 5806637 to e7ed001CompareJune 12, 2019 15:49
@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield rebased and green except for a coredump in test_csv (I don't think that was me)

Comment threadcpp/Dockerfile
g++ \
gcc \
git \
ninja-build \

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why this change?

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@emkornfield ninja is installed in ci/conda_env_cpp.yml so isn't this unused?

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz one small question about a change to docker file. Otherwise LGTM

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz potentially not an expert on docker stuff, so I'd prefer cleanup as a separate PR

@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield reverted and green

@emkornfield

Copy link
Copy Markdown
Contributor

+1 LGTM, please file a JIRA for the follow-up work.

@bkietz
bkietz deleted the 1278-integration-tests-for-fixed-size-list branch February 25, 2021 16:39
@codecov-commenter

Copy link
Copy Markdown

Codecov Report

Attention: Patch coverage is 0% with 7 lines in your changes missing coverage. Please review.

Project coverage is 88.97%. Comparing base (24c42f7) to head (8b356f3).

Files with missing linesPatch %Lines
cpp/src/arrow/ipc/writer.cc0.00%7 Missing ⚠️
Additional details and impacted files
@@ Coverage Diff @@## master #4309 +/- ##
==========================================
+ Coverage 88.54% 88.97% +0.42% 
==========================================
Files 796 704 -92 Lines 103206 94725 -8481 Branches 1253 0 -1253 ==========================================
- Hits 91388 84277 -7111 + Misses 11573 10448 -1125 + Partials 245 0 -245 

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

pribor pushed a commit to GlobalWebIndex/arrow that referenced this pull request Oct 24, 2025
Adds integration tests for fixed_size_list
Also adds support for fixed_size_list to RecordBatchSerializer, which was omitted in apache#4278
Author: Benjamin Kietzman <bengilgit@gmail.com>
Closesapache#4309 from bkietz/1278-integration-tests-for-fixed-size-list and squashes the following commits:
8b356f3 <Benjamin Kietzman> revert removal of ninja-build from dockerfile
e7ed001 <Benjamin Kietzman> fix flake8 error
8ab4efc <Benjamin Kietzman> Adding integration tests for fixed_size_list
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@bkietz@codecov-io@wesm@emkornfield@codecov-commenter
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links"); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + '
Skip to content

ARROW-1278: [Integration] Adding integration tests for fixed_size_list - #4309

Closed
bkietz wants to merge 3 commits into
apache:masterfrom
bkietz:1278-integration-tests-for-fixed-size-list
Closed

ARROW-1278: [Integration] Adding integration tests for fixed_size_list#4309
bkietz wants to merge 3 commits into
apache:masterfrom
bkietz:1278-integration-tests-for-fixed-size-list

Conversation

@bkietz

Copy link
Copy Markdown
Member

Adds integration tests for fixed_size_list
Also adds support for fixed_size_list to RecordBatchSerializer, which was omitted in #4278

@codecov-io

codecov-io commented May 14, 2019

Copy link
Copy Markdown

Codecov Report

Merging #4309 into master will increase coverage by 0.42%.
The diff coverage is 0%.

Impacted file tree graph

@@ Coverage Diff @@## master #4309 +/- ##
==========================================
+ Coverage 88.54% 88.97% +0.42% 
==========================================
Files 796 704 -92 Lines 103206 94725 -8481 Branches 1253 0 -1253 ==========================================
- Hits 91388 84277 -7111 + Misses 11573 10448 -1125 + Partials 245 0 -245
Impacted FilesCoverage Δ
cpp/src/arrow/ipc/writer.cc93.04% <0%> (-1.15%)⬇️
cpp/src/arrow/vendored/datetime/date.h26.35% <0%> (-4.28%)⬇️
cpp/src/plasma/thirdparty/ae/ae.c70.75% <0%> (-0.95%)⬇️
cpp/src/arrow/python/arrow_to_pandas.cc91.55% <0%> (-0.04%)⬇️
cpp/src/arrow/pretty_print.cc83.18% <0%> (ø)⬆️
cpp/src/arrow/vendored/datetime/tz.h43.47% <0%> (ø)⬆️
cpp/src/arrow/vendored/datetime/tz_private.h33.33% <0%> (ø)⬆️
cpp/src/gandiva/precompiled/epoch_time_point.h100% <0%> (ø)⬆️
cpp/src/arrow/pretty_print-test.cc100% <0%> (ø)⬆️
cpp/src/arrow/python/python-test.cc100% <0%> (ø)⬆️
... and 219 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 24c42f7...8b356f3. Read the comment docs.

@bkietz

Copy link
Copy Markdown
MemberAuthor

waiting for #4316 to be merged

@wesm

wesm commented May 16, 2019

Copy link
Copy Markdown
Member

Is it expected for the integration tests to pass (there is support in Java for reading these?)?

@bkietz

Copy link
Copy Markdown
MemberAuthor

It seems like there is support: https://github.com/apache/arrow/blob/master/java/vector/src/test/java/org/apache/arrow/vector/ipc/TestArrowFile.java#L623

I'd need to spend more time figuring out exactly which java code is exercised by integration_test.py

@wesm

wesm commented May 17, 2019

Copy link
Copy Markdown
Member

I just poked around the Java codebase. It seems it may work by accident, but it is not tested

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz what are the next steps here, do you need help with something on the Java side?

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from e287bd8 to ae45d3fCompareJune 11, 2019 13:17
@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield I have investigated the fixed size list tests. They're spare but present so I think we should merge this and add a JIRA to test fixed size list more thoroughly in Java.

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from ae45d3f to 5806637CompareJune 11, 2019 15:41
@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz sounds good, can you rebase?

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from 5806637 to e7ed001CompareJune 12, 2019 15:49
@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield rebased and green except for a coredump in test_csv (I don't think that was me)

Comment threadcpp/Dockerfile
g++ \
gcc \
git \
ninja-build \

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why this change?

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@emkornfield ninja is installed in ci/conda_env_cpp.yml so isn't this unused?

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz one small question about a change to docker file. Otherwise LGTM

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz potentially not an expert on docker stuff, so I'd prefer cleanup as a separate PR

@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield reverted and green

@emkornfield

Copy link
Copy Markdown
Contributor

+1 LGTM, please file a JIRA for the follow-up work.

@bkietz
bkietz deleted the 1278-integration-tests-for-fixed-size-list branch February 25, 2021 16:39
@codecov-commenter

Copy link
Copy Markdown

Codecov Report

Attention: Patch coverage is 0% with 7 lines in your changes missing coverage. Please review.

Project coverage is 88.97%. Comparing base (24c42f7) to head (8b356f3).

Files with missing linesPatch %Lines
cpp/src/arrow/ipc/writer.cc0.00%7 Missing ⚠️
Additional details and impacted files
@@ Coverage Diff @@## master #4309 +/- ##
==========================================
+ Coverage 88.54% 88.97% +0.42% 
==========================================
Files 796 704 -92 Lines 103206 94725 -8481 Branches 1253 0 -1253 ==========================================
- Hits 91388 84277 -7111 + Misses 11573 10448 -1125 + Partials 245 0 -245 

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

pribor pushed a commit to GlobalWebIndex/arrow that referenced this pull request Oct 24, 2025
Adds integration tests for fixed_size_list
Also adds support for fixed_size_list to RecordBatchSerializer, which was omitted in apache#4278
Author: Benjamin Kietzman <bengilgit@gmail.com>
Closesapache#4309 from bkietz/1278-integration-tests-for-fixed-size-list and squashes the following commits:
8b356f3 <Benjamin Kietzman> revert removal of ninja-build from dockerfile
e7ed001 <Benjamin Kietzman> fix flake8 error
8ab4efc <Benjamin Kietzman> Adding integration tests for fixed_size_list
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@bkietz@codecov-io@wesm@emkornfield@codecov-commenter
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default"); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

ARROW-1278: [Integration] Adding integration tests for fixed_size_list - #4309

Closed
bkietz wants to merge 3 commits into
apache:masterfrom
bkietz:1278-integration-tests-for-fixed-size-list
Closed

ARROW-1278: [Integration] Adding integration tests for fixed_size_list#4309
bkietz wants to merge 3 commits into
apache:masterfrom
bkietz:1278-integration-tests-for-fixed-size-list

Conversation

@bkietz

Copy link
Copy Markdown
Member

Adds integration tests for fixed_size_list
Also adds support for fixed_size_list to RecordBatchSerializer, which was omitted in #4278

@codecov-io

codecov-io commented May 14, 2019

Copy link
Copy Markdown

Codecov Report

Merging #4309 into master will increase coverage by 0.42%.
The diff coverage is 0%.

Impacted file tree graph

@@ Coverage Diff @@## master #4309 +/- ##
==========================================
+ Coverage 88.54% 88.97% +0.42% 
==========================================
Files 796 704 -92 Lines 103206 94725 -8481 Branches 1253 0 -1253 ==========================================
- Hits 91388 84277 -7111 + Misses 11573 10448 -1125 + Partials 245 0 -245
Impacted FilesCoverage Δ
cpp/src/arrow/ipc/writer.cc93.04% <0%> (-1.15%)⬇️
cpp/src/arrow/vendored/datetime/date.h26.35% <0%> (-4.28%)⬇️
cpp/src/plasma/thirdparty/ae/ae.c70.75% <0%> (-0.95%)⬇️
cpp/src/arrow/python/arrow_to_pandas.cc91.55% <0%> (-0.04%)⬇️
cpp/src/arrow/pretty_print.cc83.18% <0%> (ø)⬆️
cpp/src/arrow/vendored/datetime/tz.h43.47% <0%> (ø)⬆️
cpp/src/arrow/vendored/datetime/tz_private.h33.33% <0%> (ø)⬆️
cpp/src/gandiva/precompiled/epoch_time_point.h100% <0%> (ø)⬆️
cpp/src/arrow/pretty_print-test.cc100% <0%> (ø)⬆️
cpp/src/arrow/python/python-test.cc100% <0%> (ø)⬆️
... and 219 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 24c42f7...8b356f3. Read the comment docs.

@bkietz

Copy link
Copy Markdown
MemberAuthor

waiting for #4316 to be merged

@wesm

wesm commented May 16, 2019

Copy link
Copy Markdown
Member

Is it expected for the integration tests to pass (there is support in Java for reading these?)?

@bkietz

Copy link
Copy Markdown
MemberAuthor

It seems like there is support: https://github.com/apache/arrow/blob/master/java/vector/src/test/java/org/apache/arrow/vector/ipc/TestArrowFile.java#L623

I'd need to spend more time figuring out exactly which java code is exercised by integration_test.py

@wesm

wesm commented May 17, 2019

Copy link
Copy Markdown
Member

I just poked around the Java codebase. It seems it may work by accident, but it is not tested

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz what are the next steps here, do you need help with something on the Java side?

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from e287bd8 to ae45d3fCompareJune 11, 2019 13:17
@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield I have investigated the fixed size list tests. They're spare but present so I think we should merge this and add a JIRA to test fixed size list more thoroughly in Java.

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from ae45d3f to 5806637CompareJune 11, 2019 15:41
@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz sounds good, can you rebase?

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from 5806637 to e7ed001CompareJune 12, 2019 15:49
@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield rebased and green except for a coredump in test_csv (I don't think that was me)

Comment threadcpp/Dockerfile
g++ \
gcc \
git \
ninja-build \

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why this change?

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@emkornfield ninja is installed in ci/conda_env_cpp.yml so isn't this unused?

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz one small question about a change to docker file. Otherwise LGTM

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz potentially not an expert on docker stuff, so I'd prefer cleanup as a separate PR

@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield reverted and green

@emkornfield

Copy link
Copy Markdown
Contributor

+1 LGTM, please file a JIRA for the follow-up work.

@bkietz
bkietz deleted the 1278-integration-tests-for-fixed-size-list branch February 25, 2021 16:39
@codecov-commenter

Copy link
Copy Markdown

Codecov Report

Attention: Patch coverage is 0% with 7 lines in your changes missing coverage. Please review.

Project coverage is 88.97%. Comparing base (24c42f7) to head (8b356f3).

Files with missing linesPatch %Lines
cpp/src/arrow/ipc/writer.cc0.00%7 Missing ⚠️
Additional details and impacted files
@@ Coverage Diff @@## master #4309 +/- ##
==========================================
+ Coverage 88.54% 88.97% +0.42% 
==========================================
Files 796 704 -92 Lines 103206 94725 -8481 Branches 1253 0 -1253 ==========================================
- Hits 91388 84277 -7111 + Misses 11573 10448 -1125 + Partials 245 0 -245 

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

pribor pushed a commit to GlobalWebIndex/arrow that referenced this pull request Oct 24, 2025
Adds integration tests for fixed_size_list
Also adds support for fixed_size_list to RecordBatchSerializer, which was omitted in apache#4278
Author: Benjamin Kietzman <bengilgit@gmail.com>
Closesapache#4309 from bkietz/1278-integration-tests-for-fixed-size-list and squashes the following commits:
8b356f3 <Benjamin Kietzman> revert removal of ninja-build from dockerfile
e7ed001 <Benjamin Kietzman> fix flake8 error
8ab4efc <Benjamin Kietzman> Adding integration tests for fixed_size_list
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@bkietz@codecov-io@wesm@emkornfield@codecov-commenter
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers"); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

ARROW-1278: [Integration] Adding integration tests for fixed_size_list - #4309

Closed
bkietz wants to merge 3 commits into
apache:masterfrom
bkietz:1278-integration-tests-for-fixed-size-list
Closed

ARROW-1278: [Integration] Adding integration tests for fixed_size_list#4309
bkietz wants to merge 3 commits into
apache:masterfrom
bkietz:1278-integration-tests-for-fixed-size-list

Conversation

@bkietz

Copy link
Copy Markdown
Member

Adds integration tests for fixed_size_list
Also adds support for fixed_size_list to RecordBatchSerializer, which was omitted in #4278

@codecov-io

codecov-io commented May 14, 2019

Copy link
Copy Markdown

Codecov Report

Merging #4309 into master will increase coverage by 0.42%.
The diff coverage is 0%.

Impacted file tree graph

@@ Coverage Diff @@## master #4309 +/- ##
==========================================
+ Coverage 88.54% 88.97% +0.42% 
==========================================
Files 796 704 -92 Lines 103206 94725 -8481 Branches 1253 0 -1253 ==========================================
- Hits 91388 84277 -7111 + Misses 11573 10448 -1125 + Partials 245 0 -245
Impacted FilesCoverage Δ
cpp/src/arrow/ipc/writer.cc93.04% <0%> (-1.15%)⬇️
cpp/src/arrow/vendored/datetime/date.h26.35% <0%> (-4.28%)⬇️
cpp/src/plasma/thirdparty/ae/ae.c70.75% <0%> (-0.95%)⬇️
cpp/src/arrow/python/arrow_to_pandas.cc91.55% <0%> (-0.04%)⬇️
cpp/src/arrow/pretty_print.cc83.18% <0%> (ø)⬆️
cpp/src/arrow/vendored/datetime/tz.h43.47% <0%> (ø)⬆️
cpp/src/arrow/vendored/datetime/tz_private.h33.33% <0%> (ø)⬆️
cpp/src/gandiva/precompiled/epoch_time_point.h100% <0%> (ø)⬆️
cpp/src/arrow/pretty_print-test.cc100% <0%> (ø)⬆️
cpp/src/arrow/python/python-test.cc100% <0%> (ø)⬆️
... and 219 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 24c42f7...8b356f3. Read the comment docs.

@bkietz

Copy link
Copy Markdown
MemberAuthor

waiting for #4316 to be merged

@wesm

wesm commented May 16, 2019

Copy link
Copy Markdown
Member

Is it expected for the integration tests to pass (there is support in Java for reading these?)?

@bkietz

Copy link
Copy Markdown
MemberAuthor

It seems like there is support: https://github.com/apache/arrow/blob/master/java/vector/src/test/java/org/apache/arrow/vector/ipc/TestArrowFile.java#L623

I'd need to spend more time figuring out exactly which java code is exercised by integration_test.py

@wesm

wesm commented May 17, 2019

Copy link
Copy Markdown
Member

I just poked around the Java codebase. It seems it may work by accident, but it is not tested

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz what are the next steps here, do you need help with something on the Java side?

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from e287bd8 to ae45d3fCompareJune 11, 2019 13:17
@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield I have investigated the fixed size list tests. They're spare but present so I think we should merge this and add a JIRA to test fixed size list more thoroughly in Java.

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from ae45d3f to 5806637CompareJune 11, 2019 15:41
@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz sounds good, can you rebase?

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from 5806637 to e7ed001CompareJune 12, 2019 15:49
@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield rebased and green except for a coredump in test_csv (I don't think that was me)

Comment threadcpp/Dockerfile
g++ \
gcc \
git \
ninja-build \

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why this change?

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@emkornfield ninja is installed in ci/conda_env_cpp.yml so isn't this unused?

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz one small question about a change to docker file. Otherwise LGTM

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz potentially not an expert on docker stuff, so I'd prefer cleanup as a separate PR

@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield reverted and green

@emkornfield

Copy link
Copy Markdown
Contributor

+1 LGTM, please file a JIRA for the follow-up work.

@bkietz
bkietz deleted the 1278-integration-tests-for-fixed-size-list branch February 25, 2021 16:39
@codecov-commenter

Copy link
Copy Markdown

Codecov Report

Attention: Patch coverage is 0% with 7 lines in your changes missing coverage. Please review.

Project coverage is 88.97%. Comparing base (24c42f7) to head (8b356f3).

Files with missing linesPatch %Lines
cpp/src/arrow/ipc/writer.cc0.00%7 Missing ⚠️
Additional details and impacted files
@@ Coverage Diff @@## master #4309 +/- ##
==========================================
+ Coverage 88.54% 88.97% +0.42% 
==========================================
Files 796 704 -92 Lines 103206 94725 -8481 Branches 1253 0 -1253 ==========================================
- Hits 91388 84277 -7111 + Misses 11573 10448 -1125 + Partials 245 0 -245 

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

pribor pushed a commit to GlobalWebIndex/arrow that referenced this pull request Oct 24, 2025
Adds integration tests for fixed_size_list
Also adds support for fixed_size_list to RecordBatchSerializer, which was omitted in apache#4278
Author: Benjamin Kietzman <bengilgit@gmail.com>
Closesapache#4309 from bkietz/1278-integration-tests-for-fixed-size-list and squashes the following commits:
8b356f3 <Benjamin Kietzman> revert removal of ninja-build from dockerfile
e7ed001 <Benjamin Kietzman> fix flake8 error
8ab4efc <Benjamin Kietzman> Adding integration tests for fixed_size_list
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@bkietz@codecov-io@wesm@emkornfield@codecov-commenter
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode"); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })();
Skip to content

ARROW-1278: [Integration] Adding integration tests for fixed_size_list - #4309

Closed
bkietz wants to merge 3 commits into
apache:masterfrom
bkietz:1278-integration-tests-for-fixed-size-list
Closed

ARROW-1278: [Integration] Adding integration tests for fixed_size_list#4309
bkietz wants to merge 3 commits into
apache:masterfrom
bkietz:1278-integration-tests-for-fixed-size-list

Conversation

@bkietz

Copy link
Copy Markdown
Member

Adds integration tests for fixed_size_list
Also adds support for fixed_size_list to RecordBatchSerializer, which was omitted in #4278

@codecov-io

codecov-io commented May 14, 2019

Copy link
Copy Markdown

Codecov Report

Merging #4309 into master will increase coverage by 0.42%.
The diff coverage is 0%.

Impacted file tree graph

@@ Coverage Diff @@## master #4309 +/- ##
==========================================
+ Coverage 88.54% 88.97% +0.42% 
==========================================
Files 796 704 -92 Lines 103206 94725 -8481 Branches 1253 0 -1253 ==========================================
- Hits 91388 84277 -7111 + Misses 11573 10448 -1125 + Partials 245 0 -245
Impacted FilesCoverage Δ
cpp/src/arrow/ipc/writer.cc93.04% <0%> (-1.15%)⬇️
cpp/src/arrow/vendored/datetime/date.h26.35% <0%> (-4.28%)⬇️
cpp/src/plasma/thirdparty/ae/ae.c70.75% <0%> (-0.95%)⬇️
cpp/src/arrow/python/arrow_to_pandas.cc91.55% <0%> (-0.04%)⬇️
cpp/src/arrow/pretty_print.cc83.18% <0%> (ø)⬆️
cpp/src/arrow/vendored/datetime/tz.h43.47% <0%> (ø)⬆️
cpp/src/arrow/vendored/datetime/tz_private.h33.33% <0%> (ø)⬆️
cpp/src/gandiva/precompiled/epoch_time_point.h100% <0%> (ø)⬆️
cpp/src/arrow/pretty_print-test.cc100% <0%> (ø)⬆️
cpp/src/arrow/python/python-test.cc100% <0%> (ø)⬆️
... and 219 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 24c42f7...8b356f3. Read the comment docs.

@bkietz

Copy link
Copy Markdown
MemberAuthor

waiting for #4316 to be merged

@wesm

wesm commented May 16, 2019

Copy link
Copy Markdown
Member

Is it expected for the integration tests to pass (there is support in Java for reading these?)?

@bkietz

Copy link
Copy Markdown
MemberAuthor

It seems like there is support: https://github.com/apache/arrow/blob/master/java/vector/src/test/java/org/apache/arrow/vector/ipc/TestArrowFile.java#L623

I'd need to spend more time figuring out exactly which java code is exercised by integration_test.py

@wesm

wesm commented May 17, 2019

Copy link
Copy Markdown
Member

I just poked around the Java codebase. It seems it may work by accident, but it is not tested

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz what are the next steps here, do you need help with something on the Java side?

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from e287bd8 to ae45d3fCompareJune 11, 2019 13:17
@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield I have investigated the fixed size list tests. They're spare but present so I think we should merge this and add a JIRA to test fixed size list more thoroughly in Java.

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from ae45d3f to 5806637CompareJune 11, 2019 15:41
@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz sounds good, can you rebase?

@bkietz
bkietzforce-pushed the 1278-integration-tests-for-fixed-size-list branch from 5806637 to e7ed001CompareJune 12, 2019 15:49
@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield rebased and green except for a coredump in test_csv (I don't think that was me)

Comment threadcpp/Dockerfile
g++ \
gcc \
git \
ninja-build \

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why this change?

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@emkornfield ninja is installed in ci/conda_env_cpp.yml so isn't this unused?

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz one small question about a change to docker file. Otherwise LGTM

@emkornfield

Copy link
Copy Markdown
Contributor

@bkietz potentially not an expert on docker stuff, so I'd prefer cleanup as a separate PR

@bkietz

Copy link
Copy Markdown
MemberAuthor

@emkornfield reverted and green

@emkornfield

Copy link
Copy Markdown
Contributor

+1 LGTM, please file a JIRA for the follow-up work.

@bkietz
bkietz deleted the 1278-integration-tests-for-fixed-size-list branch February 25, 2021 16:39
@codecov-commenter

Copy link
Copy Markdown

Codecov Report

Attention: Patch coverage is 0% with 7 lines in your changes missing coverage. Please review.

Project coverage is 88.97%. Comparing base (24c42f7) to head (8b356f3).

Files with missing linesPatch %Lines
cpp/src/arrow/ipc/writer.cc0.00%7 Missing ⚠️
Additional details and impacted files
@@ Coverage Diff @@## master #4309 +/- ##
==========================================
+ Coverage 88.54% 88.97% +0.42% 
==========================================
Files 796 704 -92 Lines 103206 94725 -8481 Branches 1253 0 -1253 ==========================================
- Hits 91388 84277 -7111 + Misses 11573 10448 -1125 + Partials 245 0 -245 

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

pribor pushed a commit to GlobalWebIndex/arrow that referenced this pull request Oct 24, 2025
Adds integration tests for fixed_size_list
Also adds support for fixed_size_list to RecordBatchSerializer, which was omitted in apache#4278
Author: Benjamin Kietzman <bengilgit@gmail.com>
Closesapache#4309 from bkietz/1278-integration-tests-for-fixed-size-list and squashes the following commits:
8b356f3 <Benjamin Kietzman> revert removal of ninja-build from dockerfile
e7ed001 <Benjamin Kietzman> fix flake8 error
8ab4efc <Benjamin Kietzman> Adding integration tests for fixed_size_list
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@bkietz@codecov-io@wesm@emkornfield@codecov-commenter