TEST: adopt new rest catalog image and enable tableExists tests

[sungwy]

NOTE: the test is failing because tableExists endpoint isn't exposed on the adapter. Related fix: apache/iceberg#11678

[Fokko]

The image is published, including the fix around the tableExists, so 🤞

[Fokko]

Hmm, still an issue with the tableExists:

 @pytest.mark.integration
def test_table_v1_with_null_nested_namespace(session_catalog: Catalog, arrow_table_with_null: pa.Table) -> None:
identifier = "default.lower.table_v1_with_null_nested_namespace"
tbl = _create_table(session_catalog, identifier, {"format-version": "1"}, [arrow_table_with_null])
assert tbl.format_version == 1, f"Expected v1, got: v{tbl.format_version}"
assert session_catalog.load_table(identifier) is not None
> assert session_catalog.table_exists(identifier)
E AssertionError: assert False
E + where False = <bound method RestCatalog.table_exists of local (<class 'pyiceberg.catalog.rest.RestCatalog'>)>('default.lower.table_v1_with_null_nested_namespace')
E + where <bound method RestCatalog.table_exists of local (<class 'pyiceberg.catalog.rest.RestCatalog'>)> = local (<class 'pyiceberg.catalog.rest.RestCatalog'>).table_exists
tests/integration/test_writes/test_writes.py:1373: AssertionError
=============================== warnings summary ========================

[sungwy]

:) @Fokko I'm on my way to the office, but will take a look at this in a few minutes

[sungwy]

@Fokko - it looks like the issue is because the rest-fixture is returning a 200 response. I've put in edits to allow PyIceberg to infer a 200 response as being successful.

The proposed solution deviates from the REST Catalog Spec, but this is already the behavior of PyIceberg when handles the success codes of the other endpoints that are also meant to return 204 response:

iceberg-python/pyiceberg/catalog/rest.py

Lines 422 to 448 in df804c4

	def_handle_non_200_response(self, exc: HTTPError, error_handler: Dict[int, Type[Exception]]) ->None:
	exception: Type[Exception]
	ifexc.responseisNone:
	raiseValueError("Did not receive a response")
	code=exc.response.status_code
	ifcodeinerror_handler:
	exception=error_handler[code]
	elifcode==400:
	exception=BadRequestError
	elifcode==401:
	exception=UnauthorizedError
	elifcode==403:
	exception=ForbiddenError
	elifcode==422:
	exception=RESTError
	elifcode==419:
	exception=AuthorizationExpiredError
	elifcode==501:
	exception=NotImplementedError
	elifcode==503:
	exception=ServiceUnavailableError
	elif500<=code<600:
	exception=ServerError
	else:
	exception=RESTError

[Fokko]

Thanks for following this up @sungwy. I think it is okay to mark all 2xx responses as table exists. Polaris had a similar issue: #1363

[kevinjqliu]

woot! LGTM

[kevinjqliu]

should we upstream this to the spec?

[kevinjqliu]

#1363 (comment)

[sungwy]

Thanks for the reviews @Fokko and @kevinjqliu !