46

I'm writing a REST client for elgg using python, and even when the request succeeds, I get this in response:

Traceback (most recent call last):
  File "testclient.py", line 94, in <module>
    result = sendMessage(token, h1)
  File "testclient.py", line 46, in sendMessage
    res = h1.getresponse().read()
  File "C:\Python25\lib\httplib.py", line 918, in getresponse
    raise ResponseNotReady()
httplib.ResponseNotReady

Looking at the header, I see ('content-length', '5749'), so I know there is a page there, but I can't use .read() to see it because the exception comes up. What does ResponseNotReady mean and why can't I see the content that was returned?

2
  • Are you re-using the connection? Jul 12, 2010 at 19:34
  • Indeed. Oddly, sometimes it works and sometimes it doesn't. I can't determine what behavior determines that though. Jul 12, 2010 at 21:39

6 Answers 6

87

Previous answers are correct, but there's another case where you could get that exception:

Making multiple requests without reading any intermediate responses completely.

For instance:

conn.request('PUT',...)
conn.request('GET',...)
# will not work: raises ResponseNotReady

conn.request('PUT',...)
r = conn.getresponse()
r.read() # <-- that's the important call!
conn.request('GET',...)
r = conn.getresponse()
r.read() # <-- same thing

and so on.

4
  • 1
    Thats what I was needing .read() so I can reuse my connection. Feb 11, 2014 at 19:54
  • 2
    is .read() expensive. What if I don't care about the response? Can I make it run faster ?>
    – Neil
    Jul 7, 2016 at 6:58
  • 6
    @ronnefeldt, Python docs at docs.python.org/3/library/http.client.html has the following note: "Note that you must have read the whole response before you can send a new request to the server.".
    – mvsagar
    Jul 12, 2016 at 6:15
  • If you hadn't said this I would have had a very upsetting next few hours maybe even days. THANK YOU May 29, 2018 at 16:28
46

Make sure you don't reuse the same object from a previous connection. You will hit this once the server keep-alive ends and the socket closes.

2
  • 2
    Generally, as a rule, I don't bother trying to reuse HttpRequest objects unless I have a specific, performance-driven need to do so. Just single-shot 'em
    – rossipedia
    Aug 6, 2010 at 20:31
  • In my case, adding preload_content=False solved the issue. Here is the snippet: http = urllib3.PoolManager(threadsNo, maxsize=threadsNo, block=True); request = http.request('GET', queryUrl, preload_content=False) It looks like request.release_conn() does not really release the previous connection object unless above parameter is passed to http.request. More details here: urllib3.readthedocs.org/en/latest/pools.html
    – Dex
    Sep 8, 2015 at 7:06
2

I was running into this same exception today, using this code:

    conn = httplib.HTTPConnection(self._host, self._port)
    conn.putrequest('GET',
        '/retrieve?id={0}'.format(parsed_store_response['id']))
    retr_response = conn.getresponse()

I didn't notice that I was using putrequest rather than request; I was mixing my interfaces. ResponseNotReady is raised because I haven't actually sent the request yet.

2

Additionally, errors like this can occur when the server sends a response without a Content-Length header, which will cripple the state of the HTTP client if Keep-Alive is used and another request is sent over the same socket.

0

This can also occur if a firewall blocks the connection.

0

Unable to add comment to @Bokeh 's answer; as I do not have the requisite reputation yet on this platform.

So, adding as answer: Bokeh's answer worked for me.

I was trying to pipeline multiple requests sequentially over the same connection object. For few of the responses I wanted to process the response later, hence missed to read the response.

From my experience, I second Bokeh's answer:

response.read() is a must after each request. Even if you wish to process response or not.

From my standpoint this question would have been incomplete without Bokeh's answer. Thanks @Bokeh

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.