sent 4013337 bytes received 76 bytes 39934.46 bytes/sec
total size is 5171204259 speedup is 1288.48rsync is telling you that it actually transferred 4013337 bytes (~4MB) from the local machine to the remote machine, and 76 bytes in the other direction. It gives you an average transfer rate, and then the big number, the size of the directory that was just synchronized - 5171204259 (~5GB). The speedup number represents the Total size divided by the total data transferred in both directions (TOTAL SIZE / (SENT + RECEIVED)) = SPEEDUP. This is better termed the "advantage" of using rsync, but the developers chose "speedup" and that's what we got. You could think of it as a ratio/multiplier, since a speedup of 1 would mean that you basically transferred the whole thing with no speedup, as opposed to that example operation, which transferred 1/1288 of the total data to make up the difference.
Registered Linux User #370740 (http://counter.li.org)
15 comments:
Nice explanation. Thanks!
I was wondering what speedup was and googling it brought me here (btw, give the rsync --human-readable flag a try)
Eah, also get here by google.
Thanks for explanation!
I got here through google rsync speedup is.
I have never used rsync before tonight and I jumped into the deep end by mirroring getdeb and playdeb on my site http://rsync.labby.co.uk and rsync://rsync.labby.co.uk at the end I saw a lot I understood but couldn't figure out speedup.
Your page was very informative and crystal clear.
Thanks for the heads up :)
Very helpful explanation of the 'speedup' statistic, thanks.
Hiya, just want to say thanx for the to-the-point explanation of the 'speedup'.
It's really nice to know how it's calculated, & that we're getting 'speedups' in the 1000's factor!
Lead Developer @ Studios.DesertBox.Org
^_^
Thanks for this explanation, I have been wondering what that meant!
Thanks for looking into this. Speedup is a common term, rsync didn't invent it. Speedup is technically the ratio of times or speeds, so what rsync says is speedup is actually the estimated speedup. It's also hyperinflated if for example, you are transferring data over ethernet, and all of the files needed to be scanned for differences. Reading and transferring all the data wouldn't take much longer than reading all the files just to find their differences. Big gains bandwidth-wise, though.
I wonder if I should make a patch to rsync to make their fake speedup an accurate estimate of *real* speedup instead...
thanks for explanation!
It helps. Thanks!
Thanks for the explanation, I also got here on the search engine bus.
Thanks for that explanation - helped me too
The speedup will also increase if you use the -z flag, which tells rsync to compress the data before sending. In this way, the total size is much greater than what is actually sent.
I have been using rsync lately to transfer files from my linux desktop to a remote server. Due to the nature of these files, I first delete the entire directory from the server, then transfer the entire directory again from my box. So while I'm not getting the "delta advantage" of rsync, I still get a "speedup" because of the compression.
Thanks for the tip, Johnny!
I think your usage would benefit from the --delete flag, which will delete files present in the target that are not present in the source, effectively giving you the "delta" functionality you were looking for. Of course, if your target is writable by some process that might hit it during the transfer, those files could be overlooked.
rsync always calculates an MD5 checksum of the source and destination files to check if the file needs to be transferred (you can let it decide on size+mtime also, but then it will make the md5 anyway to check if the file has been transferred correctly). On slow connections, this can greatly speedup an incremental update, but on fast connections (like e.g. 100mbit network) and with limited CPU power (like e.g. a cheap NAS), the calculation of the MD5 checksum might take more time then the actual transfer.
In these cases you might notice that the incremental update takes more time then the first time, when the destination file was not there yet)
The speedup value is how much you saved on the data transfer, but as you understand, this might not be a useful indication for the duration of the total transaction
Post a Comment