Friday, January 30, 2015

Mac: moving large amount of files off to external drive

I have tried to clean up my hard drive in preparation to upgrade to SSD. Moving files using Finder FAILS all the time an in the end you don't know what was copied and what was not.

I used rsynch tool because it it smart enough to copy ONLY new and changed files, so I can run it multiple times and transfer only the differences (delta).

$ sudo rsync -varpog --progress ~/Documents/SourceDir/ /Volumes/1TB_BU/DestinationDir/  Password:building file list ... 8943 files to consider.DS_Store      159748 100%  121.10MB/s    0:00:00 (xfer#1, to-check=8941/8943)2013-08-15 09.35.24.mp4    87290465 100%   22.57MB/s    0:00:03 (xfer#2, to-check=7445/8943)2013-08-15 11.51.18.jpg

...sent 26005122366 bytes  received 163790 bytes  20565667.19 bytes/sec
total size is 35588964732  speedup is 1.37

Consecutive runs:

$ sudo rsync -varhpog --progress ~/Documents/SourceDir/ /Volumes/1TB_BU/DestinationDir/  

building file list ... 8943 files to consider
sent 173.28K bytes  received 20 bytes  346.61K bytes/sectotal size is 35.59G  speedup is 205355.70


-h show full help

-v verbose
--progress show progress while transfer
-h unman readable
-q quiet for non-error
-r recursive
-a archive
-b backup
-p preserve permissions
-o preserve owner
-g preserve group
-z compress data during the transfer