Skip to content

Commit 845a73e

Browse files
committed
Docs and changelog
1 parent 38b4347 commit 845a73e

File tree

3 files changed

+52
-0
lines changed

3 files changed

+52
-0
lines changed
Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
{
2+
"type": "enhancement",
3+
"category": "crt",
4+
"description": "Exposes new CRT options for S3 file IO"
5+
}

awscli/s3transfer/crt.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -132,6 +132,9 @@ def create_s3_crt_client(
132132
* path/to/cert/bundle.pem - A filename of the CA cert bundle to
133133
use. Specify this argument if you want to use a custom CA cert
134134
bundle instead of the default one on your system.
135+
136+
:type fio_options: Optional[dict]
137+
:param fio_options: Kwargs to use to build an `awscrt.s3.S3FileIoOptions`.
135138
"""
136139

137140
event_loop_group = EventLoopGroup(num_threads)

awscli/topics/s3-config.rst

Lines changed: 44 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -382,6 +382,50 @@ adjustments mid-transfer command in order to increase throughput and reach the
382382
requested bandwidth.
383383

384384

385+
should_stream
386+
-------------
387+
.. note::
388+
This configuration option is only supported when the ``preferred_transfer_client``
389+
configuration value is set to or resolves to ``crt``. The ``classic`` transfer
390+
client does not support this configuration option.
391+
392+
**Default** - ``false``
393+
394+
If set to ``true``, the CRT client will skip buffering parts in-memory before
395+
sending PUT requests.
396+
397+
398+
disk_throughput
399+
---------------
400+
.. note::
401+
This configuration option is only supported when the ``preferred_transfer_client``
402+
configuration value is set to or resolves to ``crt``. The ``classic`` transfer
403+
client does not support this configuration option.
404+
405+
**Default** - ``10.0``
406+
407+
The estimated target disk throughput. This value is only applied if
408+
``should_stream`` is set to ``true``.This value can be specified using
409+
the same semantics as ``target_throughput``, that is either as the
410+
number of bytes per second as an integer, or using a rate suffix.
411+
412+
413+
direct_io
414+
---------
415+
.. note::
416+
This configuration option is only supported when the ``preferred_transfer_client``
417+
configuration value is set to or resolves to ``crt``. The ``classic`` transfer
418+
client does not support this configuration option.
419+
420+
.. note::
421+
This configuration option is only supported on Linux.
422+
423+
**Default** - ``false``
424+
425+
If set to ``true``, the CRT client will enable direct IO to bypass the OS
426+
cache when sending PUT requests. Enabling direct IO may be useful in cases
427+
where the disk IO outperforms the kernel cache.
428+
385429
Experimental Configuration Values
386430
=================================
387431

0 commit comments

Comments
 (0)