Add transparent Content-Encoding: gzip/deflate support

[seriyps]

So, should add Accept-Encoding: gzip,deflate to request, then check for Content-Encoding: gzip or Content-Encoding: deflate and decompress body (after de-chunking).
Decompression may be done in single pass (zlib:gunzip/1 for gzip and zlib:unzip/1 for deflate) in case of synchronous requests and using streaming (zlib:open/0, zlib:inflateInit/1, zlib:inflate/2 ..., zlib:close/1) in case of asynchronous.
Single-pass example can be found here https://github.com/seriyps/xhttpc/blob/master/src/middlewares/compression_middleware.erl

Some option should be added to enable this feature.

[benoitc]

will add it in next release. Thanks for the suggestion.

[zweizeichen]

+1

[seriyps]

Also, bear in mind new Erlang 18.0 API to protect from gzip bombs http://www.erlang.org/documentation/doc-7.0-rc1/erts-7.0/doc/html/zlib.html#inflateChunk-2

[benoitc]

feature is coming. I am in the middle of adding some big improvments to hackney. I will probably include it right after. Thanks for the hint.

[tuscland]

+1 :)

[zyro]

+1 Would be great to see this handled transparently for both requests and responses.

[jedhu0]

+1 :)

[Anonyfox]

+1 on this :)

[kostya]

+1

[edgurgel]

Can I help with this? I would be glad to follow some guidance and help with this feature.

[benoitc]

@edgurgel thanks! It should probably be added to the function receiving the body, if you wrap them and keep the state it should be OK. Anyway betetr to wait over the we, with the new recv and recv_multipart functions :)

[tlvenn]

Any update on this feature ?