bug-wget
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Bug-wget] [bug #44817] http/gzip compression


From: Ander Juaristi
Subject: [Bug-wget] [bug #44817] http/gzip compression
Date: Mon, 13 Apr 2015 12:11:15 +0000
User-agent: Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:37.0) Gecko/20100101 Firefox/37.0

Follow-up Comment #1, bug #44817 (project wget):

For me, the best place to decompress the response body would be at
fd_read_body(), just after the call to fd_read(). Let fd_read() return, and
uncompress the read bytes. Also, we should consider whether the data will be
written to warc compressed or uncompressed. In the latter, we should discuss
how to handle fd_read_line(), since it expects to encounter a line separator.

We could add an extra command line switch to let the user decide the supported
compression algorithms.

Finally, the best way to implement this would be using zlib, since it supports
the two most used compression algorithms on the web: gzip and deflate. Don't
forget to update the dependency list for bootstrap/autoconf.

    _______________________________________________________

Reply to this item at:

  <http://savannah.gnu.org/bugs/?44817>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.gnu.org/




reply via email to

[Prev in Thread] Current Thread [Next in Thread]