[3dem] Slow connection linux - falcon3 server

Ludtke, Steven J sludtke at bcm.edu
Thu Dec 21 05:06:30 PST 2017


Hi Benoit,
what sort of storage is being used to store the files in question on the FEI server?  Your description sounds like the files being transferred are on a single 'spinning platter' hard drive, which will generally max out in data I/O at 150-200 MB/s. Most machines used for storing high bandwidth data will either use a RAID 5/6 array of traditional hard drive (which can achieve 1000-2000 MB/s depending on the number of drives) or high speed SSDs which will max out at ~600 MB/s on a standard SATA bus, but can achieve 1000-3000 MB/s if alternative interfaces are used.

--------------------------------------------------------------------------------------
Steven Ludtke, Ph.D.
Charles C. Bell Jr., Professor of Structural Biology
Dept. of Biochemistry and Molecular Biology                      (www.bcm.edu/biochem<http://www.bcm.edu/biochem>)
Co-Director CIBR Center                                    (www.bcm.edu/research/cibr<http://www.bcm.edu/research/cibr>)
Co-Director National Center For Macromolecular Imaging                  (ncmi.bcm.edu<http://ncmi.bcm.edu>)
Baylor College of Medicine
sludtke at bcm.edu<mailto:sludtke at bcm.edu>

On Dec 21, 2017, at 4:19 AM, benoit.zuber at ana.unibe.ch<mailto:benoit.zuber at ana.unibe.ch> wrote:

***CAUTION:*** This email is not from a BCM Source. Only click links or open attachments you know are safe.
________________________________
Dear all

We have a linux workstation connected directly through fiber optics to the so-called FEI server, i.e. the computer where Falcon3 saves frames, which runs under Windows. Strangely, file transfer from linux to windows is fast (600 MB/s) whereas file transfer from windows to linux is slow (160 MB/s). We have tried mounting the windows drive on linux through cifs or nfs, as well as mounting the linux drive on windows through nfs and we always get the same result.

We also tested windows to windows (we connected another windows machine to the fei server) : fast both ways. And we tested linux to linux : fast both ways

We tested network speed using iperf, and it is high in either direction. It is only when we transfer files that we have problems.

Any suggestion welcome.

Thanks
Benoit

--
Prof. Benoît Zuber
University of Bern
Institute of Anatomy
Baltzerstrasse 2
Postfach 922
3000 Bern 9

+41 31 631 84 40
_______________________________________________
3dem mailing list
3dem at ncmir.ucsd.edu<mailto:3dem at ncmir.ucsd.edu>
https://urldefense.proofpoint.com/v2/url?u=https-3A__mail.ncmir.ucsd.edu_mailman_listinfo_3dem&d=DwICAg&c=ZQs-KZ8oxEw0p81sqgiaRA&r=GWA2IF6nkq8sZMXHpp1Xpg&m=iM30kDS0pjLFsoGLC5GUR_9aRscO2JMiBlLeuLAqe-k&s=c228ksyoRZn9VrDIqrz1-8wQz_j3mEiCm-er4g6mrFE&e=

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.ncmir.ucsd.edu/pipermail/3dem/attachments/20171221/7a3a2f28/attachment-0001.html>


More information about the 3dem mailing list