python-api-core 2.16.0 introduced timeout on pooling

[mautini]

Hello,

We are using python-api-core via python-bigquery and since we upgraded to 2.16+ version of python-api-core, we experience timeout on to_dataframe() method (in python-bigquery) for very large queries. After investigation this seems to be a regression in python-api-core with the introduction of a 900s (15min) timeout (in pooling.py).

Environment details

• OS type and version: macOS / linux
• Python version: 3.10.10
• pip version: 24.0
• google-cloud-bigquery version: 3.6.0

Steps to reproduce

• Install google api core > 2.15
• Use bigquery client to get in a dataframe data from a query that takes more than 15 minutes to run

Code example

pip install google-api-core==2.16.2
pip install google-cloud-bigquery[bqstorage,pandas]==3.6.0

from google.cloud import bigquery
client = bigquery.Client()

sql = "SELECT ..." # Long running that takes more than 15 minutes to process in bq

client.query(sql).to_dataframe()

Stack trace

 File "/usr/local/lib/python3.10/site-packages/google/cloud/bigquery/job/query.py", line 1687, in to_dataframe
 query_result = wait_for_query(self, progress_bar_type, max_results=max_results)
 File "/usr/local/lib/python3.10/site-packages/google/cloud/bigquery/_tqdm_helpers.py", line 104, in wait_for_query
 return query_job.result(max_results=max_results)
 File "/usr/local/lib/python3.10/site-packages/google/cloud/bigquery/job/query.py", line 1499, in result
 do_get_result()
 File "/usr/local/lib/python3.10/site-packages/google/api_core/retry/retry_unary.py", line 293, in retry_wrapped_func
 return retry_target(
 File "/usr/local/lib/python3.10/site-packages/google/api_core/retry/retry_unary.py", line 153, in retry_target
 _retry_error_helper(
 File "/usr/local/lib/python3.10/site-packages/google/api_core/retry/retry_base.py", line 212, in _retry_error_helper
 raise final_exc from source_exc
 File "/usr/local/lib/python3.10/site-packages/google/api_core/retry/retry_unary.py", line 144, in retry_target
 result = target()
 File "/usr/local/lib/python3.10/site-packages/google/cloud/bigquery/job/query.py", line 1489, in do_get_result
 super(QueryJob, self).result(retry=retry, timeout=timeout)
 File "/usr/local/lib/python3.10/site-packages/google/cloud/bigquery/job/base.py", line 728, in result
 return super(_AsyncJob, self).result(timeout=timeout, **kwargs)
 File "/usr/local/lib/python3.10/site-packages/google/api_core/future/polling.py", line 256, in result
 self._blocking_poll(timeout=timeout, retry=retry, polling=polling)
 File "/usr/local/lib/python3.10/site-packages/google/cloud/bigquery/job/query.py", line 1245, in _blocking_poll
 super(QueryJob, self)._blocking_poll(timeout=timeout, **kwargs)
 File "/usr/local/lib/python3.10/site-packages/google/api_core/future/polling.py", line 139, in _blocking_poll
 raise concurrent.futures.TimeoutError(
concurrent.futures._base.TimeoutError: Operation did not complete within the designated timeout of 900 seconds.

[parthea]

Hi @mautini,

#591 may be related. We have a pre-release version published (2.17.0rc0) which fixes #591 and we're planning to publish a formal release soon. Please can you try the pre-release version below and let us know if it resolves the issue?

https://pypi.org/project/google-api-core/2.17.0rc0/
https://github.com/googleapis/python-api-core/releases/tag/v2.17.0rc0

[mautini]

Sure, I will try and let you know!

[mautini]

It works like a charm with 2.17.0rc0. Thanks a lot!

Any release date for the stable version 2.17.0?

[parthea]

@mautini,
Thanks for the quick response! We've published the stable version to PyPI https://pypi.org/project/google-api-core/2.17.0/