toil.lib.aws.config¶

Attributes¶

`S3_PARALLELIZATION_FACTOR`
`S3_PART_SIZE`
`KiB`
`MiB`
`AWS_MIN_CHUNK_SIZE`
`MULTIPART_THRESHOLD`
`AWS_MAX_MULTIPART_COUNT`

Functions¶

get_s3_multipart_chunk_size(filesize)

Returns the chunk size of the S3 multipart object, given a file's size in bytes.

Module Contents¶

toil.lib.aws.config.S3_PARALLELIZATION_FACTOR = 8¶

toil.lib.aws.config.S3_PART_SIZE = 16777216¶

toil.lib.aws.config.KiB = 1024¶

toil.lib.aws.config.MiB = 1048576¶

toil.lib.aws.config.AWS_MIN_CHUNK_SIZE = 67108864¶

toil.lib.aws.config.MULTIPART_THRESHOLD = 67108865¶

toil.lib.aws.config.AWS_MAX_MULTIPART_COUNT = 10000¶

toil.lib.aws.config.get_s3_multipart_chunk_size(filesize)¶

Returns the chunk size of the S3 multipart object, given a file’s size in bytes.

Parameters:: filesize (int)
Return type:: int