[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Bug-wget] [bug #44817] http/gzip compression
From: |
Ander Juaristi |
Subject: |
[Bug-wget] [bug #44817] http/gzip compression |
Date: |
Mon, 13 Apr 2015 12:11:15 +0000 |
User-agent: |
Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:37.0) Gecko/20100101 Firefox/37.0 |
Follow-up Comment #1, bug #44817 (project wget):
For me, the best place to decompress the response body would be at
fd_read_body(), just after the call to fd_read(). Let fd_read() return, and
uncompress the read bytes. Also, we should consider whether the data will be
written to warc compressed or uncompressed. In the latter, we should discuss
how to handle fd_read_line(), since it expects to encounter a line separator.
We could add an extra command line switch to let the user decide the supported
compression algorithms.
Finally, the best way to implement this would be using zlib, since it supports
the two most used compression algorithms on the web: gzip and deflate. Don't
forget to update the dependency list for bootstrap/autoconf.
_______________________________________________________
Reply to this item at:
<http://savannah.gnu.org/bugs/?44817>
_______________________________________________
Message sent via/by Savannah
http://savannah.gnu.org/