Bump Nessie to 0.8.2 + related changes

[snazy]

• Bump Nessie to 0.8.2 + replace Gradle plugin with new JUnit extension

  • Replace Gradle plugin with new JUnit extension.
    See Add JAX-RS tests and add JUnit/Jupyter extension

• Apply changes to Iceberg required by API changes in Nessie:

  • Re-introduce wrapper classes for query params of CommitLog/Entries
  • Server-side commit range filtering
  • Add hashOnRef query param to support time travel on a named ref
  • Only accept NamedRefs in REST API

• Bugfix: must send the Contents.id of the existing table
  Nessie's Contents.id is a random ID generated when the Contents.Key is first used (think:
  CREATE TABLE) and must not be changed. This change addresses a bug in the Iceberg-Nesie code
  that caused a new id for every change.

  Throw CommitStateUnknownException for renameTable as well

  Follow-up of Use CommitStatusUnknownException for Nessie #2515

• Fix race-condition & save one roundtrip to Nessie during "commit"

  When commiting a change, the Nessie-API now returns the hash of the commit for the change.
  This returned hash should then be used as the "expected hash" for the next commit.

  The previous approach was to commit the change to Nessie and then do another request to
  retrieve the new hash of HEAD.

  This old approach is prone to a race condition, namely when another commit happens after
  "this" commit but before retrieving the "new HEAD", so "this" instance would wrongly
  ignore the other commit's changes during conflict checks.

  See Let VersionStore.create()+commit() return the current hash

[nastra]

changes LGTM

[snazy]

Should worth to have projectnessie/nessie#1249 merged into Nessie first and use Nessie 0.6.1 in this PR then.

[rymurr]

Looks like this needs a rebase. @snazy do you still want to update to 0.6.1?

[snazy]

Yup, updated this PR to bump Nessie to 0.6.1.

[rymurr]

@snazy looks like the build failed for java8. Presumably its the recent chagne to nessie server to not support java8?

[snazy]

@snazy looks like the build failed for java8. Presumably its the recent chagne to nessie server to not support java8?

Oh yea, projectnessie/nessie#1245 broke the test runs. It's not that the Nessie Client in Iceberg is broken, it's "just" the server that cannot run. Reverting projectnessie/nessie#1245 doesn't make much sense, because Quarkus 2 drops support for Java 8 entirely.

I see these options here:

1. Skip the Nessie tests with "Iceberg Java 8" for now (to get this one in)
2. Change the :iceberg-nessie test setup to actually start the Nessie Server in a separate process using Java 11, preferably using the now published Nessie-Server uber-jar or, maybe easier, using test-containers.

I think, option 1 is a good workaround for now and then follow-up with option 2 within a short time. WDYT?

[rymurr]

I see no rush to get this patch in. The only deadline is the 0.12.0 release. So lets fix the tests correctly.

Lets go with the uber-jar too. I don't want to complicate the CI and introduce another build dependency.

[nastra]

LGTM, with one question

[snazy]

Tests pass locally w/ Java 11 + Java 8 against latest in-dev Nessie.

[rymurr]

I think there are two things:

1. more documentation of the individual changes - some aren't clear
2. separate into a few changes

[rymurr]

Thanks @snazy !!