Skip to content

[SPARK-17446] [SQL] No total size for data source tables in InMemoryCatalog - #15012

Closed
wzhfy wants to merge 1 commit into
apache:masterfrom
wzhfy:noSize
Closed

[SPARK-17446] [SQL] No total size for data source tables in InMemoryCatalog#15012
wzhfy wants to merge 1 commit into
apache:masterfrom
wzhfy:noSize

Conversation

@wzhfy

@wzhfywzhfy commented Sep 8, 2016

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

For data source table in InMemoryCatalog, it's catalogTable.storage.locationUri is None, so total size can't be calculated. But we can use the path parameter in catalogTable.storage.properties to calculate size.

How was this patch tested?

fix test case

@wzhfy

wzhfy commented Sep 8, 2016

Copy link
Copy Markdown
ContributorAuthor

@wzhfywzhfy changed the title No total size for data source tables in InMemoryCatalog[SPARK-17446] [SQL] No total size for data source tables in InMemoryCatalogSep 8, 2016
@SparkQA

Copy link
Copy Markdown

Test build #65089 has finished for PR 15012 at commit 8276ab0.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@cloud-fan

Copy link
Copy Markdown
Contributor

can you hold it for a while? We are consolidating locationUri for Hive serde table and path for datasource table recently.

@wzhfy

wzhfy commented Sep 8, 2016

Copy link
Copy Markdown
ContributorAuthor

@cloud-fan OK, please let me know when it's done.

@cloud-fan

Copy link
Copy Markdown
Contributor

PR is already sent: #15024

@wzhfy

wzhfy commented Nov 8, 2016

Copy link
Copy Markdown
ContributorAuthor

The issue is resolved after merging #15024, so I'll close this pr.

@wzhfywzhfy closed this Nov 8, 2016
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@wzhfy@SparkQA@cloud-fan