aboutsummaryrefslogtreecommitdiffstats
path: root/mitmproxy/docs/features/responsestreaming.rst
blob: 8975c1f80a7ed9f41f79f351cc865695766184f4 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
.. _responsestreaming:

Response Streaming
==================

By using mitmproxy's streaming feature, response contents can be passed to the client incrementally
before they have been fully received by the proxy. This is especially useful for large binary files
such as videos, where buffering the whole file slows down the client's browser.

By default, mitmproxy will read the entire response, perform any indicated
manipulations on it and then send the (possibly modified) response to
the client. In some cases this is undesirable and you may wish to "stream"
the response back to the client. When streaming is enabled, the response is
not buffered on the proxy but directly sent back to the client instead.

On the command-line
-------------------

Streaming can be enabled on the command line for all response bodies exceeding a certain size.
The SIZE argument understands k/m/g suffixes, e.g. 3m for 3 megabytes.

================== =============================
command-line       :option:`--stream SIZE`
================== =============================

.. warning::

    When response streaming is enabled, **streamed response contents will not be
    recorded or preserved in any way.**

.. note::

    When response streaming is enabled, the response body cannot be modified by the usual means.

Customizing Response Streaming
------------------------------

You can also use an :ref:`inlinescripts` to customize exactly
which responses are streamed.

Responses that should be tagged for streaming by setting their ``.stream`` attribute to ``True``:

.. literalinclude:: ../../examples/stream.py
   :caption: examples/stream.py
   :language: python

Implementation Details
----------------------

When response streaming is enabled, portions of the code which would have otherwise performed
changes on the response body will see an empty response body instead
(:py:data:`netlib.http.CONTENT_MISSING`). Any modifications will be ignored.

Streamed responses are usually sent in chunks of 4096 bytes. If the response is sent with a
``Transfer-Encoding: chunked`` header, the response will be streamed one chunk at a time.

Modifying streamed data
-----------------------

If the ``.stream`` attribute is callable, ``.stream`` will wrap the generator that yields all
chunks.

.. literalinclude:: ../../examples/stream_modify.py
   :caption: examples/stream_modify.py
   :language: python

.. seealso::

    - :ref:`passthrough`