Nick Craig-Wood
47eab397ba
sftp: implement connection pooling for multiple ssh connections
...
A connection may be opened for each `--transfers` and `--checkers`
now. Connections are checked when putting them in the pool and
getting them out the pool so it should recover from network errors
much better.
This fixes #1561 , fixes #1541 , fixes #1381 , fixes #1158 , fixes #1538
2017-08-07 17:19:37 +01:00
Nick Craig-Wood
bfe812ea6b
dedupe: implement merging of duplicate directories - fixes #1243
2017-08-07 15:36:41 +01:00
Nick Craig-Wood
db1995e63a
Add MergeDirs optional interface and implement it for drive
2017-08-07 15:32:47 +01:00
Nick Craig-Wood
81a2ab599f
fs: add optional ID to fs.Directory and set it in the remotes which care
2017-08-07 15:31:22 +01:00
Nick Craig-Wood
74687c25f5
sftp: fixup formatting and golint warnings
2017-08-07 14:50:31 +01:00
Nick Craig-Wood
d025066fae
Add Christian Brüggemann to contributors
2017-08-06 11:50:20 +01:00
Christian Brüggemann
80ce569874
sftp: Add support for md5 and sha1 hashes where available
2017-08-06 11:49:52 +01:00
Nick Craig-Wood
ee13ea74f1
box: fix multipart upload giving "parts_mismatch" error #97
2017-08-05 21:01:32 +01:00
Stefan Breunig
40f24e0ea3
config: use absolute ConfigPath to ensure newly written config is on the same mount - fixes #1569
2017-08-05 12:13:25 +02:00
Stefan Breunig
b523cfc01d
oauthutil: don't show "save failed" error when setting up new remote – fixes #1466
2017-08-05 12:04:42 +02:00
Nick Craig-Wood
38dabcf6b2
azure: correct docs on MD5 and chunked files
2017-08-04 23:54:57 +01:00
Nick Craig-Wood
ee6a35d750
Test compilation of all arches
...
* Add compile_all step to Makefile
* Add this to travis
* Add -compile-only flag to cross-compile.go to save time making the zips
2017-08-04 23:20:26 +01:00
Nick Craig-Wood
92d2e1f8d7
azureblob: rework and complete #801
...
* Fixup bitrot (rclone and Azure library)
* Implement Copy
* Add modtime to metadata under mtime key as RFC3339Nano
* Make multipart upload work
* Make it pass the integration tests
* Fix uploading of zero length blobs
* Rename to azureblob as it seems likely we will do azurefile
* Add docs
2017-08-04 22:56:16 +01:00
Nick Craig-Wood
98d238daa4
Add Andrei Dragomir to contributors
2017-08-04 22:56:16 +01:00
Andrei Dragomir
036fd61a50
Added Azure Blob storage support #801
2017-08-04 22:54:27 +01:00
Nick Craig-Wood
91cfcc21ff
vendor: add github.com/Azure/azure-sdk-for-go and dependencies
2017-08-04 22:54:27 +01:00
Nick Craig-Wood
132f71d504
qingstor: add missing file to fix plan9 build
2017-08-04 22:54:27 +01:00
Stefan Breunig
861e125a4f
local: revert to copy when moving file across file system boundaries – fixes #1176
2017-08-04 23:27:32 +02:00
Stefan Breunig
230e65313a
snapcraft: slighty improve buildfile (see #1188 )
2017-08-04 21:37:25 +02:00
Nick Craig-Wood
8a185deefa
qingstor: Fixes before merge
...
* use rclone's http.Client for bwlimit, logging, etc
* remove extraneous fmt.Sprintf from logging
* fix icon in docs
* add docs about --fast-list
* hoist md5 regexp compilation out of function
* create container if necessary on server side copy
* keep note of whether the container has been deleted
* build constraint not to compile for plan9
2017-08-04 19:37:53 +01:00
Nick Craig-Wood
7b9557df90
Add wuyu to contributors
2017-08-04 19:37:53 +01:00
wuyu
ec5b72f8d5
Add new QingStor remote
...
Add new package qingstor to support QingStor API.
Add new unit test for its and tested through; But I commented
on some tests case because of some of the features of QingStor.
Add new docs for it.
2017-08-04 17:25:47 +01:00
wuyu
466dd22b44
vendor: add qingstor-sdk-go for QingStor
2017-08-04 17:09:28 +01:00
Nick Craig-Wood
f682002b84
fs: Make tests create a new bucket rather than purging the old one
...
This enables QingStor to pass the tests as it has a 2 minute lockout
on deleting the old bucket then creating it again.
2017-08-04 17:09:28 +01:00
Nick Craig-Wood
7d34caac83
cmd: add os and go version to rclone version output
2017-08-04 14:25:55 +01:00
Stefan Breunig
28a18303f3
implement rcat – fixes #230 , fixes #1001
2017-08-03 21:42:35 +02:00
Nick Craig-Wood
3e3a59768e
fs/test_all: fix after fstest factorisation
2017-08-03 20:01:05 +01:00
Nick Craig-Wood
d4b9bb9894
gen_tests: allow specification of a build tag
2017-08-03 20:01:05 +01:00
Nick Craig-Wood
e01741b557
fs: Cleaning up directories in test is no longer needed
...
..as it is done in the finalise method.
2017-08-03 20:01:05 +01:00
Nick Craig-Wood
7ec24ad67a
fstests: Use a different container after the Rmdir
...
Use a new directory here. This is for the container based remotes
which take time to create and destroy a container (eg azure blob)
2017-08-03 20:01:05 +01:00
Nick Craig-Wood
eff10bbc1d
Add Oliver Heyme to contributors
2017-08-03 20:01:05 +01:00
Oliver Heyme
73f7278497
oauthutil: Added AuthOptions and shuts down the web server properly
...
1. This makes AuthOptions a parameter for doConfig, Config and ConfigOffline to enable a Fs to add additional options (required for OneDrive for Business)
2. Fix to properly shutdown the webserver recieving the auth information (go1.8)
2017-08-03 19:59:42 +01:00
Nick Craig-Wood
6d59887487
Fix URL encoding issues - fixes #1573
...
This fixes the confusion between paths which were URL encoded and
paths which weren't. In particular it allows files to have % in the
name.
2017-08-02 13:19:36 +01:00
Nick Craig-Wood
21aca68680
tree: fix when running under Windows
2017-08-01 14:46:21 +01:00
Nick Craig-Wood
214f5e6411
http: only run the tests on go1.8+
2017-08-01 12:38:29 +01:00
Nick Craig-Wood
2b5ce6ef51
http: Fix directories with : in #1555
2017-07-31 23:15:31 +01:00
Nick Craig-Wood
b0fd187cba
http: fix panic with url encoded content - fixes #1565
...
This fixes the issue which caused the panic (carrying on after an
error) and the issue which caused the error (double unescaping the
URL).
2017-07-30 23:16:32 +01:00
Nick Craig-Wood
c3cd247d4b
Document --dump-bodies using lots of memory - fixes #1516
2017-07-30 10:02:14 +01:00
Nick Craig-Wood
5d911e9450
pacer: Factor TokenDispenser into pacer from box remote
2017-07-29 23:14:47 +01:00
Nick Craig-Wood
a56d51c594
Add Andy Pilate to contributors
2017-07-27 21:18:37 +01:00
Andy Pilate
ef328c5497
Fixes typo in command dedupe definition
2017-07-27 21:17:57 +01:00
Andy Pilate
49e4cdb8b9
Added information about Drive server copies limits
2017-07-27 21:17:24 +01:00
Stefan Breunig
ee52365e88
doc: add FAQ entry for "tcp lookup no such host" - fixes #683
2017-07-27 18:20:25 +02:00
Nick Craig-Wood
f3060caf04
Implement tree command - fixes #1528
2017-07-26 23:06:48 +01:00
Nick Craig-Wood
bfef0bc2e9
vendor: add github.com/a8m/tree
2017-07-26 23:06:48 +01:00
Nick Craig-Wood
da9926d574
vendor: update golang.org/x/sys
...
Now that https://github.com/golang/go/issues/21136 is fixed
2017-07-26 22:56:17 +01:00
Nick Craig-Wood
ebc8361933
mount: Add notes on Windows limitations from Bill Zissimopoulos
2017-07-26 21:08:24 +01:00
Nick Craig-Wood
71fe046937
fs: Add Find method to DirTree
2017-07-26 16:38:53 +01:00
Nick Craig-Wood
d5ff7104e5
fs: Implement NewDirTree for non --fast-list
2017-07-26 16:38:44 +01:00
Nick Craig-Wood
cd4895690a
fstest: Factor test initialisation into Initialise()
2017-07-26 16:38:33 +01:00
