httpx.ReadTimeout: The read operation timed out #293

ak4zh · 2022-10-23T15:35:10Z

Describe the bug
I have 375000 items in my table.
I am doing a loop to obtain all id of all items, with API limit set to 20000 items per api call.
After 200000 I always start to get httpx.ReadTimeout: The read operation timed out sometime it may reach 240000 but never go ahead.

I have tried to have different wait time after each loop.
I have tried to change api limit to 10000 as well as increase it to 30000 or 50000 make less calls but in all cases it get's stuck at around 150000 or 200000.

    existing_search_result = supabase.table('vehicles').select('ref_id', count='exact').order('id', desc=False).execute()
    existing_items = []
    range_step = len(existing_search_result.data)
    total_existing_items = existing_search_result.count
    print(total_existing_items)
    while len(existing_items) < total_existing_items:
        try:
            existing_items += (
                supabase.table(
                    'vehicles'
                ).select('ref_id')
                .order('id', desc=False)
                .range(range_start, range_start + range_step)
                .execute()
            ).data
            range_start += range_step
        except Exception as e:
            logging.exception(e)
        print(range_start, len(existing_items))
        time.sleep(0.30)

Error log

2022-10-23 21:04:14,168:ERROR - The read operation timed out
Traceback (most recent call last):
  File "/Users/ak4zh/updater/venv/lib/python3.9/site-packages/httpcore/_exceptions.py", line 8, in map_exceptions
    yield
  File "/Users/ak4zh/updater/venv/lib/python3.9/site-packages/httpcore/backends/sync.py", line 26, in read
    return self._sock.recv(max_bytes)
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/ssl.py", line 1226, in recv
    return self.read(buflen)
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/ssl.py", line 1101, in read
    return self._sslobj.read(len)
socket.timeout: The read operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/ak4zh/updater/venv/lib/python3.9/site-packages/httpx/_transports/default.py", line 60, in map_httpcore_exceptions
    yield
  File "/Users/ak4zh/updater/venv/lib/python3.9/site-packages/httpx/_transports/default.py", line 204, in handle_request
    resp = self._pool.handle_request(req)
  File "/Users/ak4zh/updater/venv/lib/python3.9/site-packages/httpcore/_sync/connection_pool.py", line 253, in handle_request
    raise exc
  File "/Users/ak4zh/updater/venv/lib/python3.9/site-packages/httpcore/_sync/connection_pool.py", line 237, in handle_request
    response = connection.handle_request(request)
  File "/Users/ak4zh/updater/venv/lib/python3.9/site-packages/httpcore/_sync/connection.py", line 90, in handle_request
    return self._connection.handle_request(request)
  File "/Users/ak4zh/updater/venv/lib/python3.9/site-packages/httpcore/_sync/http11.py", line 102, in handle_request
    raise exc
  File "/Users/ak4zh/updater/venv/lib/python3.9/site-packages/httpcore/_sync/http11.py", line 81, in handle_request
    ) = self._receive_response_headers(**kwargs)
  File "/Users/ak4zh/updater/venv/lib/python3.9/site-packages/httpcore/_sync/http11.py", line 143, in _receive_response_headers
    event = self._receive_event(timeout=timeout)
  File "/Users/ak4zh/updater/venv/lib/python3.9/site-packages/httpcore/_sync/http11.py", line 172, in _receive_event
    data = self._network_stream.read(
  File "/Users/ak4zh/updater/venv/lib/python3.9/site-packages/httpcore/backends/sync.py", line 26, in read
    return self._sock.recv(max_bytes)
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/contextlib.py", line 135, in __exit__
    self.gen.throw(type, value, traceback)
  File "/Users/ak4zh/updater/venv/lib/python3.9/site-packages/httpcore/_exceptions.py", line 12, in map_exceptions
    raise to_exc(exc)
httpcore.ReadTimeout: The read operation timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/Users/ak4zh/updater/main.py", line 278, in job
    supabase.table(
  File "/Users/ak4zh/updater/venv/lib/python3.9/site-packages/postgrest/_sync/request_builder.py", line 53, in execute
    r = self.session.request(
  File "/Users/ak4zh/updater/venv/lib/python3.9/site-packages/httpx/_client.py", line 802, in request
    return self.send(request, auth=auth, follow_redirects=follow_redirects)
  File "/Users/ak4zh/updater/venv/lib/python3.9/site-packages/httpx/_client.py", line 889, in send
    response = self._send_handling_auth(
  File "/Users/ak4zh/updater/venv/lib/python3.9/site-packages/httpx/_client.py", line 917, in _send_handling_auth
    response = self._send_handling_redirects(
  File "/Users/ak4zh/updater/venv/lib/python3.9/site-packages/httpx/_client.py", line 954, in _send_handling_redirects
    response = self._send_single_request(request)
  File "/Users/ak4zh/updater/venv/lib/python3.9/site-packages/httpx/_client.py", line 990, in _send_single_request
    response = transport.handle_request(request)
  File "/Users/ak4zh/updater/venv/lib/python3.9/site-packages/httpx/_transports/default.py", line 204, in handle_request
    resp = self._pool.handle_request(req)
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/contextlib.py", line 135, in __exit__
    self.gen.throw(type, value, traceback)
  File "/Users/ak4zh/updater/venv/lib/python3.9/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions
    raise mapped_exc(message) from exc
httpx.ReadTimeout: The read operation timed out

The text was updated successfully, but these errors were encountered:

rawandahmad698 · 2022-10-23T20:40:27Z

httpx by default uses timeout=None so there's no timeout for how long a request takes, and since this is looping, does supabase drop your connection request? Nonetheless this is interesting, would love to fix it though

What else have you tried?
Have you tried doing less items per call?

ak4zh · 2022-10-24T05:35:48Z

@rawandahmad698 As mentioned above I have tried with less items per call as well as more items. I have tried many combinations from 5000 per api call to 50000 per api call.

I have also tried different variations of wait time between loops from 0.10 seconds to 3 seconds wait time between each loop.

ak4zh · 2022-10-24T05:51:42Z

I noticed something interesting.
If I use id to paginate it works better without timeout.
The timeout issue only occurs with range feature.

This query worked in first go without any timeout

    existing_search_result = supabase.table('vehicles').select('id', 'ref_id', count='exact').order('id', desc=False).execute()
    min_id = existing_search_result.data[-1]['id']
    existing_items = existing_search_result.data
    total_existing_items = existing_search_result.count
    while len(existing_items) < total_existing_items:
        try:
            existing_items += (
                supabase.table(
                    'vehicles'
                ).select('id', 'ref_id')
                .order('id', desc=False)
                .gte('id', min_id)
                .execute()
            ).data
            min_id = existing_items[-1]['id']
        except Exception as e:
            logging.exception(e)
        time.sleep(0.30)

rawandahmad698 · 2022-10-24T20:24:20Z

I'm also running some tests with the range filter, thanks for opening this issue.

e-gons · 2022-10-27T16:37:55Z

I am also getting the httpx.ReadTimeout: The read operation timed out error. But mine happens with a relatively small table (14 records). I am upserting new data and deleting old data with a simple function:

# prepare new data
result = df.round(1).to_json(orient="records")
parsed = json.loads(result)
# pprint(parsed)

# upsert fresh data
data = client.table(table_name).upsert(parsed).execute()

# delete any rows that are not in the new data
res = client.table(table_name).select("*").execute()
df = pd.json_normalize(res.data)
ids = df[id_col].unique()
for i in ids:
    if i not in df[id_col].unique():
        client.from_(table_name).delete().match({id_col: i}).execute()

My error log looks similar to the OP's:

Traceback (most recent call last):
  File "/Users/xxx/xxx/xxx/xxx/.venv/lib/python3.10/site-packages/httpcore/_exceptions.py", line 8, in map_exceptions
    yield
  File "/Users/xxx/xxx/xxx/xxx/.venv/lib/python3.10/site-packages/httpcore/backends/sync.py", line 26, in read
    return self._sock.recv(max_bytes)
  File "/opt/homebrew/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/ssl.py", line 1259, in recv
    return self.read(buflen)
  File "/opt/homebrew/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/ssl.py", line 1132, in read
    return self._sslobj.read(len)
TimeoutError: The read operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/xxx/xxx/xxx/xxx/.venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 60, in map_httpcore_exceptions
    yield
  File "/Users/xxx/xxx/xxx/xxx/.venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 218, in handle_request
    resp = self._pool.handle_request(req)
  File "/Users/xxx/xxx/xxx/xxx/.venv/lib/python3.10/site-packages/httpcore/_sync/connection_pool.py", line 253, in handle_request
    raise exc
  File "/Users/xxx/xxx/xxx/xxx/.venv/lib/python3.10/site-packages/httpcore/_sync/connection_pool.py", line 237, in handle_request
    response = connection.handle_request(request)
  File "/Users/xxx/xxx/xxx/xxx/.venv/lib/python3.10/site-packages/httpcore/_sync/connection.py", line 90, in handle_request
    return self._connection.handle_request(request)
  File "/Users/xxx/xxx/xxx/xxx/.venv/lib/python3.10/site-packages/httpcore/_sync/http11.py", line 105, in handle_request
    raise exc
  File "/Users/xxx/xxx/xxx/xxx/.venv/lib/python3.10/site-packages/httpcore/_sync/http11.py", line 84, in handle_request
    ) = self._receive_response_headers(**kwargs)
  File "/Users/xxx/xxx/xxx/xxx/.venv/lib/python3.10/site-packages/httpcore/_sync/http11.py", line 148, in _receive_response_headers
    event = self._receive_event(timeout=timeout)
  File "/Users/xxx/xxx/xxx/xxx/.venv/lib/python3.10/site-packages/httpcore/_sync/http11.py", line 177, in _receive_event
    data = self._network_stream.read(
  File "/Users/xxx/xxx/xxx/xxx/.venv/lib/python3.10/site-packages/httpcore/backends/sync.py", line 24, in read
    with map_exceptions(exc_map):
  File "/opt/homebrew/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/contextlib.py", line 153, in __exit__
    self.gen.throw(typ, value, traceback)
  File "/Users/xxx/xxx/xxx/xxx/.venv/lib/python3.10/site-packages/httpcore/_exceptions.py", line 12, in map_exceptions
    raise to_exc(exc)
httpcore.ReadTimeout: The read operation timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/Users/xxx/xxx/xxx/xxx/store.py", line 166, in <module>
    store_port()
  File "/Users/xxx/xxx/xxx/xxx/store.py", line 48, in store_port
    sp.upsert_df_to_supabase(df=df_out, id_col="symbol", table_name="holdings")
  File "/Users/xxx/xxx/xxx/xxx/cio_data/common/supabase_model.py", line 74, in upsert_df_to_supabase
    data = client.table(table_name).upsert(parsed).execute()
  File "/Users/xxx/xxx/xxx/xxx/.venv/lib/python3.10/site-packages/postgrest/_sync/request_builder.py", line 53, in execute
    r = self.session.request(
  File "/Users/xxx/xxx/xxx/xxx/.venv/lib/python3.10/site-packages/httpx/_client.py", line 815, in request
    return self.send(request, auth=auth, follow_redirects=follow_redirects)
  File "/Users/xxx/xxx/xxx/xxx/.venv/lib/python3.10/site-packages/httpx/_client.py", line 902, in send
    response = self._send_handling_auth(
  File "/Users/xxx/xxx/xxx/xxx/.venv/lib/python3.10/site-packages/httpx/_client.py", line 930, in _send_handling_auth
    response = self._send_handling_redirects(
  File "/Users/xxx/xxx/xxx/xxx/.venv/lib/python3.10/site-packages/httpx/_client.py", line 967, in _send_handling_redirects
    response = self._send_single_request(request)
  File "/Users/xxx/xxx/xxx/xxx/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1003, in _send_single_request
    response = transport.handle_request(request)
  File "/Users/xxx/xxx/xxx/xxx/.venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 217, in handle_request
    with map_httpcore_exceptions():
  File "/opt/homebrew/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/contextlib.py", line 153, in __exit__
    self.gen.throw(typ, value, traceback)
  File "/Users/xxx/xxx/xxx/xxx/.venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions
    raise mapped_exc(message) from exc
httpx.ReadTimeout: The read operation timed out

EDIT:

Restarting the project no longer works to prevent this error.

e-gons · 2022-10-28T02:29:48Z

@rawandahmad698 are you sure the timeout setting is None? It looks like it is set to 5.

In supabase-py/client.py:

        timeout: Union[int, float, Timeout] = DEFAULT_POSTGREST_CLIENT_TIMEOUT,

From postgrest-py/constants.py:

DEFAULT_POSTGREST_CLIENT_TIMEOUT = 5

ximo1984 · 2022-11-22T07:19:28Z

I increased timeout to fix it:

from supabase import create_client, Client
from supabase.lib.client_options import ClientOptions

supabase_url = os.environ.get('SUPABASE_URL')
supabase_key = os.environ.get('SUPABASE_KEY')

client_options = ClientOptions(timeout=60)
supabase: Client = create_client(supabase_url, supabase_key, options=client_options)

Maybe it could help you.

starascendin · 2023-02-02T19:42:33Z

Need to add timeout=options.timeout to this line:

https://github.com/supabase-community/supabase-py/blob/develop/supabase/client.py#L91

dschnabel · 2023-02-10T11:06:42Z

As @starascendin pointed out, the timeout option is currently being ignored in the client. Please add the timeout parameter when calling _init_postgrest_client().

J0 · 2023-02-11T02:43:56Z

Hey team,

Thanks for flagging this! I've added the timeout option and will test it when a slot frees up - in the meantime, if anyone is readily set up to do this could I trouble you to see if configuring the timeout fixes the issue?

Thanks!
Jo

dschnabel · 2023-02-14T10:09:24Z

Hm, I pulled the latest develop (commit abd1abb) and tested it like so:

supabase: Client = create_client(project_url, secret, options=ClientOptions(timeout=1))
supabase.auth.sign_up({"email": email, "password": password})

The sign_up() call takes longer than 1 second, however I'm not getting a timeout. Either I'm not setting it correctly or it's still not working yet.

github-actions · 2024-04-30T00:35:54Z

This issue is stale because it has been open for 365 days with no activity.

anand2312 added bug Something isn't working postgrest Issues related to postgrest-py labels Oct 26, 2022

J0 mentioned this issue Feb 11, 2023

fix: pass through timeout #369

Merged

J0 closed this as completed in #369 Feb 11, 2023

J0 reopened this Feb 11, 2023

dschnabel mentioned this issue Feb 17, 2023

setting timeout parameter does not change timeout #376

Open

bolshoytoster mentioned this issue Jul 11, 2023

500 Internal Server Error, 502 error QuivrHQ/quivr#597

Closed

github-actions bot added the Stale label Apr 30, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

httpx.ReadTimeout: The read operation timed out #293

httpx.ReadTimeout: The read operation timed out #293

ak4zh commented Oct 23, 2022 •

edited

rawandahmad698 commented Oct 23, 2022 •

edited

ak4zh commented Oct 24, 2022

ak4zh commented Oct 24, 2022

rawandahmad698 commented Oct 24, 2022

e-gons commented Oct 27, 2022 •

edited

e-gons commented Oct 28, 2022

ximo1984 commented Nov 22, 2022 •

edited

starascendin commented Feb 2, 2023

dschnabel commented Feb 10, 2023

J0 commented Feb 11, 2023 •

edited

dschnabel commented Feb 14, 2023 •

edited

github-actions bot commented Apr 30, 2024

httpx.ReadTimeout: The read operation timed out #293

httpx.ReadTimeout: The read operation timed out #293

Comments

ak4zh commented Oct 23, 2022 • edited

rawandahmad698 commented Oct 23, 2022 • edited

ak4zh commented Oct 24, 2022

ak4zh commented Oct 24, 2022

rawandahmad698 commented Oct 24, 2022

e-gons commented Oct 27, 2022 • edited

e-gons commented Oct 28, 2022

ximo1984 commented Nov 22, 2022 • edited

starascendin commented Feb 2, 2023

dschnabel commented Feb 10, 2023

J0 commented Feb 11, 2023 • edited

dschnabel commented Feb 14, 2023 • edited

github-actions bot commented Apr 30, 2024

ak4zh commented Oct 23, 2022 •

edited

rawandahmad698 commented Oct 23, 2022 •

edited

e-gons commented Oct 27, 2022 •

edited

ximo1984 commented Nov 22, 2022 •

edited

J0 commented Feb 11, 2023 •

edited

dschnabel commented Feb 14, 2023 •

edited