Release parquet-mr 1.11.0

[asfimport]

Reporter: Nándor Kollár / @nandorKollar
Assignee: Gabor Szadovszky / @gszadovszky

Related issues:

• Upgrade parquet to 1.11.1 (blocks)
• Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one (blocks)
• Use Parquet LogicalTypes (blocks)
• Parquet support for TIMESTAMP WITH LOCAL TIME ZONE (blocks)
• Parquet support for TIMESTAMP WITHOUT TIME ZONE (blocks)
• UserDefinedPredicate throw NPE (is blocked by)
• Page row count limit causes empty pages to be written from MessageColumnIO (is blocked by)
• Implement unit test to validate column/offset indexes (is blocked by)
• Publish 1.11.0 to maven central (is duplicated by)

_{Note: This issue was originally created as PARQUET-1434. Please see the migration documentation for further details.}

[asfimport]

Yuming Wang / @wangyum:
https://github.com/apache/parquet-mr/releases/tag/apache-parquet-1.11.0

It didn't pushed to maven repository?

[asfimport]

Nándor Kollár / @nandorKollar:
@wangyum the release is not yet finished, voting is not yet closed.

[asfimport]

Ke Li:
Any updates about this?

[asfimport]

Gabor Szadovszky / @gszadovszky:
Unfortunately, we still don't have consensus about the content of this release.

[asfimport]

Junjie Chen / @chenjunjiedada:
@gszadovszky, What remaining contents are still in discussing? Could you please help to list here or put some links to the discussions?

[asfimport]

Gabor Szadovszky / @gszadovszky:
@rdblue, is it possible to create jiras about your concerns related to column indexes and link them here?

[asfimport]

Ryan Blue / @rdblue:
My concern is that it has not been reviewed well enough to be confident that the write path implements the spec correctly. So there aren't specific issues to address.

I made suggestions on an integration test Zoltan wrote, but that wasn't committed to the Parquet repository. Getting that cleaned up and committed is the only thing I can think of for now.

[asfimport]

Gabor Szadovszky / @gszadovszky:
@rdblue,
I've created PARQUET-1650 to track the latter one. Also, I have a PR for it. Could you check that out?

[asfimport]

George Haddad:
Any ETA on this?

Been waiting for https://issues.apache.org/jira/browse/PARQUET-968 for a while and we really need this ASAP.

[asfimport]

Gabor Szadovszky / @gszadovszky:
Still waiting for the community to approve the column-indexes feature.

PARQUET-968 is an early fix just after 1.10.0. So, if you need it ASAP, I would suggest creating you own build by cherry-picking the fix on the top of apache-parquet-1.10.0.

[asfimport]

George Haddad:
@gszadovszky is this stable enough: https://github.com/apache/parquet-mr/releases/tag/apache-parquet-1.11.0 ?

[asfimport]

Gabor Szadovszky / @gszadovszky:
That one is the last release candidate. I think, it is stable but until it is released the community would not give any support. That's why I've suggested to update a released version with the fix you need (e.g. 1.10.1). That would be the safest choice.