mirror of
https://github.com/rclone/rclone
synced 2024-12-24 15:43:45 +01:00
584e705c0c
The S3 ListObject API returns paginated bucket listings, with "MaxKeys" items for each GET call. The default value is 1000 entries, but for buckets with millions of objects it might make sense to request more elements per request, if the backend supports it. This commit adds a "list_chunk" option for the user to specify a lower or higher value. This commit does not add safe guards around this value - if a user decides to request a too large list, it might result in connection timeouts (on the server or client). In AWS S3, there is a fixed limit of 1000, some other services might have one too. In Ceph, this can be configured in RadosGW. |
||
---|---|---|
.. | ||
s3_test.go | ||
s3.go | ||
v2sign.go |