1
mirror of https://github.com/rclone/rclone synced 2024-11-24 01:26:25 +01:00
rclone/backend/b2
Nick Craig-Wood 351fc609b1 b2: fix uploading files bigger than 1TiB
Before this change when uploading files bigger than 1TiB, the chunk
calculator would work out that the chunk size needed to be bigger than
the default 100 MiB to fit within the 10,000 parts limit.

However the uploader was still using the memory pool for the old chunk
size and this caused errors like

    panic: runtime error: slice bounds out of range [:122683392] with capacity 100663296

The fix for this is to make a temporary pool with the larger chunk
size and use it during the upload of the large file.

See: https://forum.rclone.org/t/rclone-cannot-complete-upload-to-b2-restarts-upload-frequently/35617/
2023-01-22 12:46:23 +00:00
..
api all: fix spelling across the project 2022-08-30 11:16:26 +02:00
b2_internal_test.go build: fix up package paths after repo move 2019-07-28 18:47:38 +01:00
b2_test.go build: fix up package paths after repo move 2019-07-28 18:47:38 +01:00
b2.go build: add package comments to silence revive linter 2022-08-28 13:43:51 +02:00
upload.go b2: fix uploading files bigger than 1TiB 2023-01-22 12:46:23 +00:00