Web lists-archives.com

Re: Speed Problem Copying Files




On Thursday 09 May 2019 04:49:32 am Lothar Schilling wrote:

> Hi everybody,
>
> for years I have used CentOS for our server landscape. Now I decided
> to give Debian a try. I just set up a Stretch 9.8 system supposed to
> become our main backup server. So I set up a backup job wih rsync. But
> the going is really very very slooooow. Trying to figure out what's
> happening:
>
>   * iperf -c [host] => bandwith almost 1000 Mbit, that's fine.
>   * dd if=/dev/zero of=/daten/testfile bs=1G count=10 oflag=direct =>
>     10737418240 Bytes (11 GB, 10 GiB) kopiert, 40,4992 s, 265 MB/s, so
>     that's fine as well
>
> But whenever I try to rsync, cp or scp - whether copy files on the
> local hard disk only or over the network - speed goes down to 500
> kB/s.
>
> Filesystem is ext4.
>
> I don't have any clue about what's going on. Any kind of help would be
> appreciated, thank you!
>
> Lothar

This is an interesting question. I am useing mc to copy data from old 
wheezy drive to new stretch drive, both with speeds well above 
100M/second performance, but when dealing with small files, theres a 
penalty for obtaining the space to write to, and for the cleanup after, 
and its substantial. So I see speeds below 5 megs when dealing with 
spinning rust and my maildir format email corpus. Drive seek speeds and 
rotational latency will all figure into that, and its one of the reasons 
an SSD seems so much faster because they seek in a microsecond, and they 
don't have to wait until the sector passes under the heads of the drive.

Anything that will speed up that aspect of moving data will surely be 
appreciated, so I'll read carefully the responses here.

Thank you.

Cheers, Gene Heskett
-- 
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
Genes Web page <http://geneslinuxbox.net:6309/gene>