Rsync: Difference between revisions
From Leo's Notes
This page was last edited on 29 June 2020, at 21:10.
| Line 1: | Line 1: | ||
== Quick Usage Guide == | ==Quick Usage Guide== | ||
=== Copying Files via SSH === | ===Copying Files via SSH=== | ||
To copy files from {{code|/export/backup}} to a remote location (on server 'backup'): | To copy files from {{code|/export/backup}} to a remote location (on server 'backup'): | ||
{{highlight|lang=terminal|code= | {{highlight|lang=terminal|code= | ||
| Line 10: | Line 10: | ||
}} | }} | ||
=== Copying files with Progress Information === | ===Copying files with Progress Information=== | ||
{{highlight|lang=terminal|code= | {{highlight|lang=terminal|code= | ||
$ rsync -avh --progress /src/ /dst/ | $ rsync -avh --progress /src/ /dst/ | ||
}} | }} | ||
=== Limiting Bandwidth === | ===Limiting Bandwidth=== | ||
The transfer rate can be limited with the {{code|1=--bwlimit=kbps}} option. Bytes per second is the default if no unit is given. | The transfer rate can be limited with the {{code|1=--bwlimit=kbps}} option. Bytes per second is the default if no unit is given. | ||
{{highlight|lang=terminal|code= | {{highlight|lang=terminal|code= | ||
| Line 23: | Line 23: | ||
}} | }} | ||
== Copying Directories == | === Parallel Copy === | ||
You may wish to run multiple rsync in parallel to speed up data transfers. | |||
{{Highlight | |||
| code = ## Transfers /source/directory tot /destination/directory with 5 parallel jobs | |||
$ ls -1 /source/directory/ \ | |||
| xargs -I {} -P 5 -n 1 rsync -avh --progress /source/directory/{} /destination/directory/ | |||
| lang = terminal | |||
}} | |||
==Copying Directories== | |||
Because I've been bitten by this issue way too many times in the past couple of days, to avoid copying a directory into another directory, '''always have a trailing slash from the source'''. | Because I've been bitten by this issue way too many times in the past couple of days, to avoid copying a directory into another directory, '''always have a trailing slash from the source'''. | ||
| Line 44: | Line 53: | ||
== See Also == | ==See Also== | ||
* https://calomel.org/rsync_tips.html | |||
*https://calomel.org/rsync_tips.html | |||
{{Navbox Linux}}[[Category:Linux]] | {{Navbox Linux}} | ||
[[Category:Linux]] | |||
[[Category:LinuxUtilities]] | [[Category:LinuxUtilities]] | ||
Revision as of 21:10, 29 June 2020
Quick Usage Guide
Copying Files via SSH
To copy files from /export/backup to a remote location (on server 'backup'):
$ rsync -avz /export/backup/ -e ssh backup:/export/backup/
## Or with a non-standard SSH port
$ rsync -avz /export/backup/ -e "ssh -p 2222" backup:/export/backup/
Copying files with Progress Information
$ rsync -avh --progress /src/ /dst/
Limiting Bandwidth
The transfer rate can be limited with the --bwlimit=kbps option. Bytes per second is the default if no unit is given.
## Limit transfer speed to 1MB/s
$ rsync --bwlimit=1024 /source/ /destination/
$ rsync --bwlimit=1m /source/ /destination/
Parallel Copy
You may wish to run multiple rsync in parallel to speed up data transfers.
## Transfers /source/directory tot /destination/directory with 5 parallel jobs
$ ls -1 /source/directory/ \
Copying Directories
Because I've been bitten by this issue way too many times in the past couple of days, to avoid copying a directory into another directory, always have a trailing slash from the source.
In more depth, suppose I have a src directory and I want its contents to be replicated in dst.
## This copies 'src' into 'dst/src'
$ rsync -avh src dst
## This too copies 'src' into 'dst/src'
$ rsync -avh src dst/
## Works as expected. Contents in src is now in dst
$ rsync -avh src/ dst
## Works as expected as well
$ rsync -avh src/ dst/