Web lists-archives.com

Re: Speed Problem Copying Files




[ replying to list, not discretely ]

Quoting Lothar Schilling (2019-05-09 12:36:55)
> Am 09.05.2019 um 12:26 schrieb Jonas Smedegaard:
> > Quoting Lothar Schilling (2019-05-09 11:46:00)
> >> Am 09.05.2019 um 11:14 schrieb Jonas Smedegaard:
> >>> Quoting Lothar Schilling (2019-05-09 10:49:32)
> >>>> I just set up a Stretch 9.8 system supposed to become our main 
> >>>> backup server. So I set up a backup job wih rsync. But the going is 
> >>>> really very very slooooow. Trying to figure out what's happening:
> >>>>
> >>>>   * iperf -c [host] => bandwith almost 1000 Mbit, that's fine.
> >>>>   * dd if=/dev/zero of=/daten/testfile bs=1G count=10 oflag=direct 
> >>>>     => 10737418240 Bytes (11 GB, 10 GiB) kopiert, 40,4992 s, 265 
> >>>>     MB/s, so that's fine as well
> >>>>
> >>>> But whenever I try to rsync, cp or scp - whether copy files on the 
> >>>> local hard disk only or over the network - speed goes down to 500 
> >>>> kB/s.
> >>>>
> >>>> Filesystem is ext4.
> >>>>
> >>>> I don't have any clue about what's going on. Any kind of help would 
> >>>> be appreciated, thank you!
> >>> Is _only_ transfer speed affected?
> >>>
> >>> I am no expert in this, but imagine that if you rsync massive 
> >>> amounts involving hardlinks then memory becomes a problem too.
> >>>
> >>> Perhaps run atop to monitor bottlenecks live
> >>>
> >>>
> >>>  - Jonas
> >>>
> >> It is most definitely not a memory or cpu problem. It's a HP Proliant 
> >> with 32 GB RAM and a Intel Xeon CPU 2.40GHz with 4 cores. Also the 
> >> problem stays the same if I just copy one large file.
> > Fair enough :-)
> >
> > Another shot in the dark: Did you install appropriate firmware packages?
> >
> >  - Jonas
> >
> No, actually I did not. But on that very same machine I had installed
> Centos 7 a few days earlier. There were no problems.

I am not familiar with Centos but imagine they build kernels differently 
than Debian - in particular handle firmware differently.  That's why I 
bring up that detail.


NB! Debian mailinglist posting style is to post only to list: 
https://www.debian.org/MailingLists/#codeofconduct

(I guess your posting to me discretely was simply an error)


 - Jonas

-- 
 * Jonas Smedegaard - idealist & Internet-arkitekt
 * Tlf.: +45 40843136  Website: http://dr.jones.dk/

 [x] quote me freely  [ ] ask before reusing  [ ] keep private

Attachment: signature.asc
Description: signature