github/rclone
1
Fork 0
mirror of https://github.com/rclone/rclone synced 2024-12-29 22:26:24 +01:00
Code Releases Activity
7,532 Commits 184 Branches 114 Tags 311 MiB
Go 98.6%
HTML 0.4%
Shell 0.3%
Python 0.3%
JavaScript 0.2%
Other 0.1%
d5d28a7513
Go to file
Nick Craig-Wood d5d28a7513 operations: fix overwrite of destination when multi-thread transfer fails 
Before this change, if a multithread upload failed (let's say the
source became unavailable) rclone would finalise the file first before
aborting the transfer.

This caused the partial file to be written which would overwrite any
existing files.

This was fixed by making sure we Abort the transfer before Close-ing
it.

This updates the docs to encourage calling of Abort before Close and
updates writerAtChunkWriter to make sure that works properly.

This also reworks the tests to detect this and to make sure we upload
and download to each multi-thread capable backend (we were only
downloading before which isn't a full test).

Fixes #7071
2023-11-24 11:19:58 +00:00
.github build: refactor version info and icon resource handling on windows 2023-11-01 12:44:04 +01:00
backend s3: detect looping when using gcs and versions 2023-11-23 09:50:28 +00:00
bin fs: implement --metadata-mapper to transform metatadata with a user supplied program 2023-11-18 17:49:35 +00:00
cmd random: speed up String function for generating larger blocks 2023-11-24 11:19:58 +00:00
cmdtest cmdtest: fix typos found by codespell 2023-03-24 20:44:25 +00:00
contrib docker volume plugin: add missing fuse3 dependency #6844 2023-03-15 15:57:53 +00:00
docs Add Alen Šiljak to contributors 2023-11-24 11:19:58 +00:00
fs operations: fix overwrite of destination when multi-thread transfer fails 2023-11-24 11:19:58 +00:00
fstest test_all: limit the Zoho tests to just the backend 2023-11-21 12:06:31 +00:00
graphics build: Add file properties and icon to Windows executable (fixes #4304) 2020-06-11 09:26:14 +01:00
lib random: stop using deprecated rand.Seed in go1.20 and later 2023-11-24 11:19:58 +00:00
librclone docs: document how to build with version info and icon resources on windows 2023-11-01 12:44:04 +01:00
vfs vfs: error out early if can't upload 0 length file 2023-11-18 17:14:45 +00:00
.gitattributes build: add azure pipelines build 2019-08-06 10:31:32 +01:00
.gitignore serve s3: let rclone act as an S3 compatible server 2023-11-16 16:59:55 +00:00
.golangci.yml build: re-enable revive linters 2023-08-29 13:01:15 +01:00
CONTRIBUTING.md Refresh CONTRIBUTING.md 2023-11-19 12:48:27 +00:00
COPYING Initial commit - some small parts working 2012-11-18 17:32:31 +00:00
Dockerfile docker: add missing fuse3 dependency - fixes #6844 2023-03-15 10:54:30 +00:00
go.mod Implement Azure Files backend 2023-11-18 16:42:13 +00:00
go.sum Implement Azure Files backend 2023-11-18 16:42:13 +00:00
MAINTAINERS.md Add @nielash as bisync maintainer 2023-09-05 04:05:39 -04:00
Makefile Makefile: use POSIX compatible install arguments 2023-11-20 15:01:26 +00:00
MANUAL.html Version v1.64.0 2023-09-11 15:59:44 +01:00
MANUAL.md Version v1.64.0 2023-09-11 15:59:44 +01:00
MANUAL.txt Version v1.64.0 2023-09-11 15:59:44 +01:00
notes.txt docs: spelling: etc. 2020-10-28 18:16:23 +00:00
rclone.1 Version v1.64.0 2023-09-11 15:59:44 +01:00
rclone.go lib: add plugin support 2019-09-29 11:05:10 +01:00
README.md backend: add Linkbox backend 2023-11-18 17:14:45 +00:00
RELEASE.md build: update all dependencies 2023-10-29 15:46:38 +00:00
VERSION Start v1.65.0-DEV development 2023-09-12 11:24:17 +01:00

README.md

rclone logo rclone logo

Website | Documentation | Download | Contributing | Changelog | Installation | Forum

Build Status Go Report Card GoDoc Docker Pulls

Rclone

Rclone ("rsync for cloud storage") is a command-line program to sync files and directories to and from different cloud storage providers.

Storage providers

Please see the full list of all storage providers and their features

Virtual storage providers

These backends adapt or modify other storage providers

  • Alias: rename existing remotes 📄
  • Cache: cache remotes (DEPRECATED) 📄
  • Chunker: split large files 📄
  • Combine: combine multiple remotes into a directory tree 📄
  • Compress: compress files 📄
  • Crypt: encrypt files 📄
  • Hasher: hash files 📄
  • Union: join multiple remotes to work together 📄

Features

  • MD5/SHA-1 hashes checked at all times for file integrity
  • Timestamps preserved on files
  • Partial syncs supported on a whole file basis
  • Copy mode to just copy new/changed files
  • Sync (one way) mode to make a directory identical
  • Check mode to check for file hash equality
  • Can sync to and from network, e.g. two different cloud accounts
  • Optional large file chunking (Chunker)
  • Optional transparent compression (Compress)
  • Optional encryption (Crypt)
  • Optional FUSE mount (rclone mount)
  • Multi-threaded downloads to local disk
  • Can serve local or remote files over HTTP/WebDAV/FTP/SFTP/DLNA

Installation & documentation

Please see the rclone website for:

Downloads

License

This is free software under the terms of the MIT license (check the COPYING file included in this package).