<div dir="ltr"><div style="font-size:small" class="gmail_default"></div><div dir="ltr"><div class="gmail_default" style="font-size:small">There is some really great info in this thread! We have gone a bit of a different route, so I thought I would describe that briefly here in case it might be useful.</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">We have implemented a tiered storage strategy:</div><div class="gmail_default" style="font-size:small"><ul><li><b>Fast scratch for processing: </b>11-28 TB SSD raid zero scratch spaces on several workstations, all cross mounted via NFSv4. Each user has there own space to use for processing, and all cpu/gpu on this local network can access each scratch. These are truly non-redundant, and users need to offload important results to another location.</li></ul><div> <i> Note: we had a handful of SAS SSDs which are much more stable for write operations, but unless you are using these for a write cache to a slower disk system (we are not) these drives are IMO a waste of money. For ~ 1/4 the price, we added several SATA SSDs (eg Samsung 8xx pro) that in raid 0 are just as fast, and have a similar read life-time. In our case, the cost savings means even if they die in three years (warranteed for five) it is still much cheaper than SAS.</i><br></div></div><div class="gmail_default" style="font-size:small"><ul><li><b>Intermediate (lifetime ~ 1 year) storage: </b>Originally, we planned on a Synology station as several others have mentioned. I recommend this for smaller storage (1-200 TB) given your IT permits it. Being in the med school here at Umass, InfoSec made this a non-starter. (That is a different story : ) We looked into two proprietary options, <b>Netapp</b> and <b>Dell EMC Isilon</b>. The isilon ended up being roughly 1/2 the cost compared to the NetApp. </li></ul><div style="margin-left:40px">Notes on the Isilon:</div><ol style="margin-left:40px"><li>While more expensive than an off the shelf NAS option (like synology) the failure prevention and snapshots seem more robust than any RAID option. There a great deal flexibility in what is backed up, how frequently and how long and the excess storage used is lower. We have ~480 TB raw and ~ 360 TB really available based on our snapshot policy and failure policy. I.e. there are four nodes, and a full node can be lost w/o data loss. <br></li><li>Because there is no controller, the system is easily extended to include more nodes, which will increase the raw:useable ratio as a full node is less of the total available. I recall the max efficiency peaked somewhere around 90 for a large system. You can also combine SSD (F-series) and have a tiered system within your Isilon, though we opted to manage this externally.<br></li><li>I haven't yet benchmarked the performance as it is plenty fast enough for our intermediate (active archive) use. If anyone is interested, and provides a specific test, I would be happy to run on our system.</li></ol><div><ul><li><b>Cold storage</b>: we are currently using the good old external HDDs for this. It is not the safest, but is certainly the cheapest. <br></li></ul><div><b>Network:</b></div><div><b><br></b></div><div>We had to run 10Gb (cat6A) cables to the wetlab/drylabs to get 10Gb connectivity back to the IT closets, where we also had to add switches to support the speed. The cable run was somewhere around $7k and each switch was ~$4k. I'm sure there are less expensive options, but these are what IT was willing to support, which is in the long run, making things affordable from my perspective.</div><div><br></div><div>We have dual port NICs, but did not set up bonding as it seemed like we could just saturate the copper when reading from SSD scratch and dumping into another /dev/null.</div><div><br></div><div>HTH</div><div><br></div><div>BEn</div><div><br></div></div></div><div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr">------------------------<br><font size="2" face="Tahoma" color="black"><span style="font-size:10pt" dir="ltr"><font size="1"><span style="font-size:13px"><font face="Arial">Benjamin Himes</font><font face="Arial">, PhD<br>
</font><font face="Arial"><br>
cryoEM methods development </font><font face="Arial"><br></font><font face="Arial">HHMI</font><font face="Arial">, RNA Therapeutics Institute, University of Massachusetts Medical School<br></font></span></font></span></font></div><div dir="ltr"><font size="2" face="Tahoma" color="black"><span style="font-size:10pt" dir="ltr"><font size="1"><span style="font-size:13px"><font face="Arial"><br></font></span></font></span></font></div><div dir="ltr"><font size="2" face="Tahoma" color="black"><span style="font-size:10pt" dir="ltr"><font size="1"><span style="font-size:13px"><font face="Arial">
cryo-STA development @ </font><a href="https://urldefense.com/v3/__https://github.com/bHimes/emClarity__;!!Mih3wA!WZeXBSsDTaAcDru7sWlzE3iQ9ifNMj6s8GhEszQlFDxZPBE8vyuvx4VWc7895sJm_w$" target="_blank"><font face="Arial">emClarity</font></a></span></font></span></font></div><div><font size="2" face="Tahoma" color="black"><span style="font-size:10pt" dir="ltr"><font size="1"><span style="font-size:13px"><font face="Arial">Visual Proteomics @ <a href="https://urldefense.com/v3/__https://github.com/timothygrant80/cisTEM__;!!Mih3wA!WZeXBSsDTaAcDru7sWlzE3iQ9ifNMj6s8GhEszQlFDxZPBE8vyuvx4VWc7_88A8ZXg$" target="_blank">cisTEM</a><br></font></span></font></span></font></div><div dir="ltr"><font size="2" face="Tahoma" color="black"><span style="font-size:10pt" dir="ltr"><font size="1"><span style="font-size:13px"><font face="Arial">-------------------------</font></span></font></span></font></div></div></div></div></div></div></div></div></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sat, Apr 3, 2021 at 12:22 PM <<a href="mailto:3dem-request@ncmir.ucsd.edu">3dem-request@ncmir.ucsd.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Send 3dem mailing list submissions to<br>
<a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a><br>
<br>
To subscribe or unsubscribe via the World Wide Web, visit<br>
<a href="https://mail.ncmir.ucsd.edu/mailman/listinfo/3dem" rel="noreferrer" target="_blank">https://mail.ncmir.ucsd.edu/mailman/listinfo/3dem</a><br>
or, via email, send a message with subject or body 'help' to<br>
<a href="mailto:3dem-request@ncmir.ucsd.edu" target="_blank">3dem-request@ncmir.ucsd.edu</a><br>
<br>
You can reach the person managing the list at<br>
<a href="mailto:3dem-owner@ncmir.ucsd.edu" target="_blank">3dem-owner@ncmir.ucsd.edu</a><br>
<br>
When replying, please edit your Subject line so it is more specific<br>
than "Re: Contents of 3dem digest..."<br>
<br>
<br>
Today's Topics:<br>
<br>
1. Re: Data storage system (Matthias Wolf)<br>
2. Re: Data storage system (Xu, Chen)<br>
<br>
<br>
----------------------------------------------------------------------<br>
<br>
Message: 1<br>
Date: Sat, 3 Apr 2021 05:04:38 +0000<br>
From: Matthias Wolf <<a href="mailto:matthias.wolf@oist.jp" target="_blank">matthias.wolf@oist.jp</a>><br>
To: Lu Gan <<a href="mailto:lu@anaphase.org" target="_blank">lu@anaphase.org</a>><br>
Cc: "<a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a>" <<a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a>><br>
Subject: Re: [3dem] Data storage system<br>
Message-ID:<br>
<<a href="mailto:OSAPR01MB4516F10FE7D43F47AF27A439EC799@OSAPR01MB4516.jpnprd01.prod.outlook.com" target="_blank">OSAPR01MB4516F10FE7D43F47AF27A439EC799@OSAPR01MB4516.jpnprd01.prod.outlook.com</a>><br>
<br>
Content-Type: text/plain; charset="utf-8"<br>
<br>
I second Lu?s suggestion ? tool-free saves a lot of time. Need hot-swap bays, of course.<br>
Also thanks for the dropbox tip, Lu ? I did not know it?s that affordable. This is great for archival, even if slow!<br>
<br>
To correct my previous post ? our server is also supermicro, not Tyan? :-]<br>
<br>
There is one more related aspect: although the trays on this server are tool-free, they are made pretty cheaply and are quite fragile. Because of the software-based FreeNAS, the O/S only knows the drive location logically. So when drive XY failed, I had to identify its physical position. The system has a way to iD the drive by LED, but it?s not through FreeNAS. Steve Ludke gave good advice about many things including the advantage of robust hardware-based raid controllers, where drive-ID is a no-brainer. In the end I learned how to ID the correct drive, but it took some thinking. Because the worst is if you pull the wrong drive from a degraded array?<br>
<br>
Matthias<br>
<br>
<br>
From: Lu Gan <<a href="mailto:lu@anaphase.org" target="_blank">lu@anaphase.org</a>><br>
Sent: Saturday, April 03, 2021 11:52 AM<br>
To: Matthias Wolf <<a href="mailto:matthias.wolf@oist.jp" target="_blank">matthias.wolf@oist.jp</a>><br>
Cc: Charles Bayly-Jones <<a href="mailto:charles.bayly-jones@monash.edu" target="_blank">charles.bayly-jones@monash.edu</a>>; Xu, Chen <<a href="mailto:Chen.Xu@umassmed.edu" target="_blank">Chen.Xu@umassmed.edu</a>>; <a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a><br>
Subject: Re: [3dem] Data storage system<br>
<br>
Make sure you get a server that has tool-free HDD / SSD caddies. The older servers use caddies that require 4 screws to secure each HDD. Why is this relevant? The HDDs you buy today will not have enough capacity in 3 - 4 years. At that time, you'll need to upgrade tens of HDDs, which is a breeze if the caddies are tool free, but a huge time sink if they're not. The Supermicro servers that Matthias and Craig mentioned should have tool free caddies. If you order a different model, double check because some of the older style servers are still being sold. In addition to Supermicro, you check this website, which has good reviews of modern servers that point out important features like the caddies:<br>
<a href="https://urldefense.com/v3/__https://www.servethehome.com/category/storage/__;!!Mih3wA!TrUwzzfVLE1RXJiVYb0TumRmtuyvI-kmj2Fm6HuC0gqpNqTKgV05T6s894zi9thvjw$" rel="noreferrer" target="_blank">https://urldefense.com/v3/__https://www.servethehome.com/category/storage/__;!!Mih3wA!TrUwzzfVLE1RXJiVYb0TumRmtuyvI-kmj2Fm6HuC0gqpNqTKgV05T6s894zi9thvjw$</a> <br>
<br>
Regarding backups, a slower but cheaper alternative is to use Dropbox's advanced business plan. It's < USD 1K per year for "as much as you need" storage. The downside is that transfer to/from is slow. In Singapore, we get 20 - 40 MB/sec. To put this number range in perspective, we just had to restore all our backed up data (35 TB) to our local server and it took 2 weeks.<br>
<br>
Cheers.<br>
Lu<br>
<br>
--<br>
Lu Gan<br>
Associate Professor<br>
Department of Biological Sciences<br>
Centre for BioImaging Sciences<br>
National University of Singapore<br>
14 Science Drive 4<br>
S1A, Lvl 2<br>
Singapore 117543<br>
<br>
<a href="https://urldefense.com/v3/__http://www.anaphase.org__;!!Mih3wA!TrUwzzfVLE1RXJiVYb0TumRmtuyvI-kmj2Fm6HuC0gqpNqTKgV05T6s894wSwss1OQ$" rel="noreferrer" target="_blank">https://urldefense.com/v3/__http://www.anaphase.org__;!!Mih3wA!TrUwzzfVLE1RXJiVYb0TumRmtuyvI-kmj2Fm6HuC0gqpNqTKgV05T6s894wSwss1OQ$</a> <<a href="https://urldefense.com/v3/__http://www.anaphase.org__;!!Mih3wA!TrUwzzfVLE1RXJiVYb0TumRmtuyvI-kmj2Fm6HuC0gqpNqTKgV05T6s894wSwss1OQ$" rel="noreferrer" target="_blank">https://urldefense.com/v3/__http://www.anaphase.org__;!!Mih3wA!TrUwzzfVLE1RXJiVYb0TumRmtuyvI-kmj2Fm6HuC0gqpNqTKgV05T6s894wSwss1OQ$</a> ><br>
<br>
Tel: (65) 6516 8868<br>
<br>
<br>
On Sat, Apr 3, 2021 at 10:14 AM Matthias Wolf <<a href="mailto:matthias.wolf@oist.jp" target="_blank">matthias.wolf@oist.jp</a><mailto:<a href="mailto:matthias.wolf@oist.jp" target="_blank">matthias.wolf@oist.jp</a>>> wrote:<br>
Hi Charles,<br>
<br>
My Tyan FreeNAS box has a quad port 10G SFP+ baseboard-mounted NIC (AOC brand, purchased from Tyan through Superbiiz with the server). I have configured two of its ports for port aggregation with LAGP which is supported by FreeNAS. Two optical fibers are connected to a floor switch managed by IT, which also supports LAGP. The uplink from the floor switch to a core switch in the datacenter has much higher bandwidth (100Gb/s, I think) and this is an all-optical network. My workstations in the lab have 10Gb copper ethernet NICs (Solarflare or Intel) ? they are connected to the floor switch with SFP-UTP transceivers on the switch side, because the cable in the building are all ethernet. Fortunately, these are all CAT6a or CAT7, since the buildings are all less than 10 years old. The highest transfer rates between a cluster front end and our FreeNAS box by rsync I have seen was about 1GB/s (~10 Gb/s) disk-to-disk. I have not measured the network speed yet over this route with a tool like <br>
iperf. Between this storage server and our lab workstations it is less (200-300Mb/s or so), but that?s probably limited by the local RAID5 array on the workstations, or because no network tuning of the workstations that run CentOS8.<br>
<br>
We have a rack enclosure in a side room to the Titan Krios that hosts the K2 summit processor, Tyan FreeNAS box, Warp PC and two FEI Falcon storage servers. All of theses have 10G interfaces and are connected to a local optical switch managed by IT (also in that rack). The FreeNAS also has a BMC. Out HPC people did not want the Tyan server in their datacenter, because they think Tyan/Supermicro etc are inferior hardware without a service contract. They said that there were many reports of supermicro PSUs catching fire and they could not host such hardware in the datacenter. I understand this and I agree, but I bought the Tyan server because it was much cheaper than ?professional? datacenter-grade servers.<br>
<br>
Before the FreeNAS, I had bought a DDN storage server (55 drives, which was later expanded with an additional 80-drive expansion chassis), which is administered by IT and hosted directly in the OIST datacenter. Because the DDN has smaller drives, is a couple years older and has ridiculous redundancy (wasting more than 30% of the raw capacity), the total usable capacity is pretty much the same as the FreeNAS. The annual service contract of the DDN alone is 1/3 of the total cost of the Tyan FreeNAS box. I have therefore decided to let the DDN service contract lapse until something fails? it?s not a comfortable solution, but I just cannot afford this any more. I am considering swapping its drives against new large ones and installing FreeNAS on it.<br>
<br>
For file access we use NFS and CIFS. But I still have not found enough time to figure out NIS on Centos8. This was no problem on Centos7, but for some reason CentOS8 is much harder in this respect. I have one linux box for user authentication in the lab using LDAP, because I want control over my local segment and IT demand to give up root access when authenticating through their central AD domain controller. FreeNAS has all the major network services preconfigured and it is a simple matter of enabling the service. I like it quite a bit.<br>
<br>
I highly recommend to work with your IT team to have them lock down your cryoem network on the router level ? for many trouble-free years, ours has been a dedicated network segment isolated from internet and the rest of the university, only allowing routing of the teamviewer and RAPID ports. This way we got rid of the FEI service PCs, which used to act as firewalled gateways, are crappy hardware, and kill your file transfer bandwidth. The Thermo FSE?s actually prefer teamviewer over RAPID (which you can still run directly on the MPC on demand). All the while we can access our scope PCs and workstations through teamviewer and I could even remotely reboot my FreeNAS via its BMC and a web interface once connected to an internal workstation.<br>
<br>
Hope this provides some inspiration?<br>
<br>
Matthias<br>
<br>
From: Charles Bayly-Jones <<a href="mailto:charles.bayly-jones@monash.edu" target="_blank">charles.bayly-jones@monash.edu</a><mailto:<a href="mailto:charles.bayly-jones@monash.edu" target="_blank">charles.bayly-jones@monash.edu</a>>><br>
Sent: Saturday, April 03, 2021 9:12 AM<br>
To: Xu, Chen <<a href="mailto:Chen.Xu@umassmed.edu" target="_blank">Chen.Xu@umassmed.edu</a><mailto:<a href="mailto:Chen.Xu@umassmed.edu" target="_blank">Chen.Xu@umassmed.edu</a>>><br>
Cc: Matthias Wolf <<a href="mailto:matthias.wolf@oist.jp" target="_blank">matthias.wolf@oist.jp</a><mailto:<a href="mailto:matthias.wolf@oist.jp" target="_blank">matthias.wolf@oist.jp</a>>>; Krishan Pandey <<a href="mailto:krishan.pandey@health.slu.edu" target="_blank">krishan.pandey@health.slu.edu</a><mailto:<a href="mailto:krishan.pandey@health.slu.edu" target="_blank">krishan.pandey@health.slu.edu</a>>>; <a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a><mailto:<a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a>><br>
Subject: Re: [3dem] Data storage system<br>
<br>
Hi all.<br>
<br>
Our lab is also currently making similar considerations for a moderately large server. So this email chain has been quite serendipitous.<br>
<br>
I'm wondering whether those (Chen, Steve, Matthias, Tim) with external servers (45drives, trueNAS, synology, etc) might comment on their network setup? Did you opt for a special network switch? Has this been necessary or can these servers directly host the workstations? What kind of local network infrastructure do you use? Connections, SFP+/RJ45/some fancy optical thing?<br>
<br>
I note Steve has said, in the small 12-drive synologyNAS that a 10Gbe (RJ45?) card has been sufficient for ~950/600 MB/s IO. I recall the synology can be networked directly to workstations without the need for a switch, if I'm not mistaken. So what is people's experience with the other larger servers?<br>
<br>
Perhaps you might also comment on your typical use case? E.g. is your server for long term storage of processed or raw data? Or is it rather a scratch space for analysis with read & write?<br>
<br>
Very best,<br>
Charles<br>
_________________<br>
<br>
Charles Bayly-Jones<br>
BSc(ScSchProg)(Hons)<br>
<br>
Monash Biomedicine Discovery Institute & ARC CoE in advanced molecular imaging<br>
Department of Biochemistry and Molecular Biology<br>
Rm 218, Level 2, Building 77<br>
23 Innovation Walk<br>
Clayton VIC 3800<br>
Australia<br>
<br>
On Sat, 3 Apr 2021 at 04:23, Xu, Chen <<a href="mailto:Chen.Xu@umassmed.edu" target="_blank">Chen.Xu@umassmed.edu</a><mailto:<a href="mailto:Chen.Xu@umassmed.edu" target="_blank">Chen.Xu@umassmed.edu</a>>> wrote:<br>
We also have very positive experience with FreeNAS/TruNAS system. Here is the shop for their<br>
on-the-shelf units.<br>
<br>
<a href="https://urldefense.com/v3/__https://www.amazon.com/stores/iXsystems/page/C88EFDE3-3E4C-4951-860E-0E8A8BD91BF9?ref_=ast_bln__;!!Mih3wA!XMzGwejDpzMf8LVPKLKH7ywovtHBrbzH4RFa7s3_HCHKfln9EJAtGF_JwCOnSJxj9w$" rel="noreferrer" target="_blank">https://urldefense.com/v3/__https://www.amazon.com/stores/iXsystems/page/C88EFDE3-3E4C-4951-860E-0E8A8BD91BF9?ref_=ast_bln__;!!Mih3wA!XMzGwejDpzMf8LVPKLKH7ywovtHBrbzH4RFa7s3_HCHKfln9EJAtGF_JwCOnSJxj9w$</a><<a href="https://urldefense.com/v3/__https:/www.amazon.com/stores/iXsystems/page/C88EFDE3-3E4C-4951-860E-0E8A8BD91BF9?ref_=ast_bln__;!!Mih3wA!XMzGwejDpzMf8LVPKLKH7ywovtHBrbzH4RFa7s3_HCHKfln9EJAtGF_JwCOnSJxj9w$" rel="noreferrer" target="_blank">https://urldefense.com/v3/__https:/www.amazon.com/stores/iXsystems/page/C88EFDE3-3E4C-4951-860E-0E8A8BD91BF9?ref_=ast_bln__;!!Mih3wA!XMzGwejDpzMf8LVPKLKH7ywovtHBrbzH4RFa7s3_HCHKfln9EJAtGF_JwCOnSJxj9w$</a>><br>
<br>
-Chen<br>
<br>
________________________________________<br>
From: 3dem <<a href="mailto:3dem-bounces@ncmir.ucsd.edu" target="_blank">3dem-bounces@ncmir.ucsd.edu</a><mailto:<a href="mailto:3dem-bounces@ncmir.ucsd.edu" target="_blank">3dem-bounces@ncmir.ucsd.edu</a>>> on behalf of Matthias Wolf <<a href="mailto:matthias.wolf@oist.jp" target="_blank">matthias.wolf@oist.jp</a><mailto:<a href="mailto:matthias.wolf@oist.jp" target="_blank">matthias.wolf@oist.jp</a>>><br>
Sent: Friday, April 2, 2021 11:27 AM<br>
To: Krishan Pandey; <a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a><mailto:<a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a>><br>
Subject: Re: [3dem] Data storage system<br>
<br>
Hi Krishan,<br>
<br>
Our 60-drive 760 TB FreeNAS has been running flawless since more than 1 year. One failed drive was easily hot swapped. If you want capacity, this does not cost more per TB than inferior hardware, yet you get good redundancy and performance.<br>
<br>
See my old tweet here <a href="https://urldefense.com/v3/__https://twitter.com/hicryoem/status/1223966559976083458?s=21__;!!Mih3wA!XMzGwejDpzMf8LVPKLKH7ywovtHBrbzH4RFa7s3_HCHKfln9EJAtGF_JwCPmSkFojQ$" rel="noreferrer" target="_blank">https://urldefense.com/v3/__https://twitter.com/hicryoem/status/1223966559976083458?s=21__;!!Mih3wA!XMzGwejDpzMf8LVPKLKH7ywovtHBrbzH4RFa7s3_HCHKfln9EJAtGF_JwCPmSkFojQ$</a><<a href="https://urldefense.com/v3/__https:/twitter.com/hicryoem/status/1223966559976083458?s=21__;!!Mih3wA!XMzGwejDpzMf8LVPKLKH7ywovtHBrbzH4RFa7s3_HCHKfln9EJAtGF_JwCPmSkFojQ$" rel="noreferrer" target="_blank">https://urldefense.com/v3/__https:/twitter.com/hicryoem/status/1223966559976083458?s=21__;!!Mih3wA!XMzGwejDpzMf8LVPKLKH7ywovtHBrbzH4RFa7s3_HCHKfln9EJAtGF_JwCPmSkFojQ$</a>> <<a href="https://urldefense.com/v3/__https://nam10.safelinks.protection.outlook.com/?url=https*3A*2F*2Furldefense.com*2Fv3*2F__https*3A*2F*2Ftwitter.com*2Fhicryoem*2Fstatus*2F1223966559976083458*3Fs*3D21__*3B!!Mih3wA!TpItSV7E6sE1qSO0JgCwUfuLYuNhW92PMSZUaIF70zdj2z4BE_zg2izktUsKL5clRQ*24&data=04*7C01*7CChen.Xu*40umassmed.edu*7Ca3ecd1c220144d5c148208d8f5ebdb95*7Cee9155fe2da34378a6c44405faf57b2e*7C0*7C1*7C637529740649781691*7CUnknown*7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0*3D*7C2000&sdata=kHkXkbLqxxMR*2F*2FgoMCQQQxjSAvsIXrzIxrf93xWYXrE*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUl!!Mih3wA!XMzGwej" rel="noreferrer" target="_blank">https://urldefense.com/v3/__https://nam10.safelinks.protection.outlook.com/?url=https*3A*2F*2Furldefense.com*2Fv3*2F__https*3A*2F*2Ftwitter.com*2Fhicryoem*2Fstatus*2F1223966559976083458*3Fs*3D21__*3B!!Mih3wA!TpItSV7E6sE1qSO0JgCwUfuLYuNhW92PMSZUaIF70zdj2z4BE_zg2izktUsKL5clRQ*24&data=04*7C01*7CChen.Xu*40umassmed.edu*7Ca3ecd1c220144d5c148208d8f5ebdb95*7Cee9155fe2da34378a6c44405faf57b2e*7C0*7C1*7C637529740649781691*7CUnknown*7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0*3D*7C2000&sdata=kHkXkbLqxxMR*2F*2FgoMCQQQxjSAvsIXrzIxrf93xWYXrE*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUl!!Mih3wA!XMzGwej</a><br>
DpzMf8LVPKLKH7ywovtHBrbzH4RFa7s3_HCHKfln9EJAtGF_JwCOaPADKzw$<<a href="https://urldefense.com/v3/__https:/nam10.safelinks.protection.outlook.com/?url=https*3A*2F*2Furldefense.com*2Fv3*2F__https*3A*2F*2Ftwitter.com*2Fhicryoem*2Fstatus*2F1223966559976083458*3Fs*3D21__*3B!!Mih3wA!TpItSV7E6sE1qSO0JgCwUfuLYuNhW92PMSZUaIF70zdj2z4BE_zg2izktUsKL5clRQ*24&data=04*7C01*7CChen.Xu*40umassmed.edu*7Ca3ecd1c220144d5c148208d8f5ebdb95*7Cee9155fe2da34378a6c44405faf57b2e*7C0*7C1*7C637529740649781691*7CUnknown*7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0*3D*7C2000&sdata=kHkXkbLqxxMR*2F*2FgoMCQQQxjSAvsIXrzIxrf93xWYXrE*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUl!!Mih3wA!XMzGwejDpzMf8LVPKLKH7ywovtHBrbzH4RFa7s3_HCHKfln9EJAtGF_JwCOaPADKzw$" rel="noreferrer" target="_blank">https://urldefense.com/v3/__https:/nam10.safelinks.protection.outlook.com/?url=https*3A*2F*2Furldefense.com*2Fv3*2F__https*3A*2F*2Ftwitter.com*2Fhicryoem*2Fstatus*2F1223966559976083458*3Fs*3D21__*3B!!Mih3wA!TpItSV7E6sE1qSO0JgCwUfuLYuNhW92PMSZUaIF70zdj2z4BE_zg2izktUsKL5clRQ*24&data=04*7C01*7CChen.Xu*40umassmed.edu*7Ca3ecd1c220144d5c148208d8f5ebdb95*7Cee9155fe2da34378a6c44405faf57b2e*7C0*7C1*7C637529740649781691*7CUnknown*7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0*3D*7C2000&sdata=kHkXkbLqxxMR*2F*2FgoMCQQQxjSAvsIXrzIxrf93xWYXrE*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUl!!Mih3wA!XMzGwejDpzMf8LVPKLKH7ywovtHBrbzH4RFa7s3_HCHKfln9EJAtGF_JwCOaPADKzw$</a>> ><br>
<br>
Matthias<br>
<br>
________________________________<br>
From: 3dem <<a href="mailto:3dem-bounces@ncmir.ucsd.edu" target="_blank">3dem-bounces@ncmir.ucsd.edu</a><mailto:<a href="mailto:3dem-bounces@ncmir.ucsd.edu" target="_blank">3dem-bounces@ncmir.ucsd.edu</a>>> on behalf of Krishan Pandey <<a href="mailto:krishan.pandey@health.slu.edu" target="_blank">krishan.pandey@health.slu.edu</a><mailto:<a href="mailto:krishan.pandey@health.slu.edu" target="_blank">krishan.pandey@health.slu.edu</a>>><br>
Sent: Friday, April 2, 2021 03:59<br>
To: <a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a><mailto:<a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a>><br>
Subject: [3dem] Data storage system<br>
<br>
Hello,<br>
<br>
I am requesting suggestions and cost estimates about off the shelf data storage systems to store raw cryo-EM movies and processed data for our lab. Our initial target is 150-200 TB with options to expand it in future.<br>
We don't have much local IT support for Linux based systems, that's why I am asking for an off-the shelf system which should be easier to install and manage.<br>
<br>
Thank you<br>
best regards<br>
<br>
Krishan Pandey<br>
<br>
_______________________________________________<br>
3dem mailing list<br>
<a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a><mailto:<a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a>><br>
<a href="https://mail.ncmir.ucsd.edu/mailman/listinfo/3dem" rel="noreferrer" target="_blank">https://mail.ncmir.ucsd.edu/mailman/listinfo/3dem</a><br>
_______________________________________________<br>
3dem mailing list<br>
<a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a><mailto:<a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a>><br>
<a href="https://mail.ncmir.ucsd.edu/mailman/listinfo/3dem" rel="noreferrer" target="_blank">https://mail.ncmir.ucsd.edu/mailman/listinfo/3dem</a><br>
-------------- next part --------------<br>
An HTML attachment was scrubbed...<br>
URL: <<a href="http://mail.ncmir.ucsd.edu/pipermail/3dem/attachments/20210403/57130789/attachment-0001.html" rel="noreferrer" target="_blank">http://mail.ncmir.ucsd.edu/pipermail/3dem/attachments/20210403/57130789/attachment-0001.html</a>><br>
<br>
------------------------------<br>
<br>
Message: 2<br>
Date: Sat, 3 Apr 2021 16:21:35 +0000<br>
From: "Xu, Chen" <<a href="mailto:Chen.Xu@umassmed.edu" target="_blank">Chen.Xu@umassmed.edu</a>><br>
To: Charles Bayly-Jones <<a href="mailto:charles.bayly-jones@monash.edu" target="_blank">charles.bayly-jones@monash.edu</a>><br>
Cc: "<a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a>" <<a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a>><br>
Subject: Re: [3dem] Data storage system<br>
Message-ID:<br>
<<a href="mailto:MN2PR10MB4064BEA110324AB54BF99E5A96799@MN2PR10MB4064.namprd10.prod.outlook.com" target="_blank">MN2PR10MB4064BEA110324AB54BF99E5A96799@MN2PR10MB4064.namprd10.prod.outlook.com</a>><br>
<br>
Content-Type: text/plain; charset="us-ascii"<br>
<br>
Hi Charles,<br>
<br>
In our case, as facility and a research lab we need a decent capacity for<br>
data storage. We have a FreeNAS system with a head unit and two expansion<br>
shelves, so three chases with > 100+ drives. There are a 10GbE switch with<br>
SFP+ and an 1GbE RJ45 switch.<br>
<br>
Our FreeNAS is configured as mirrored running ZFS as default. And Steve is<br>
right - it is not worry-free. In the first five years, we had to hot-swap<br>
5-6 drives. We had unexpected power outrage twice (no UPS) and the system<br>
came up fine without any data loss. However, when the system booted up and<br>
one of the shelves not seen, it was indeed a scary experience. But so far in<br>
five years, we haven't had any data loss. I like ZFS a lot in that sense.<br>
Writing to FreeNAS storage is very fast, almost saturating the bandwidth,<br>
but reading is slightly slower.<br>
<br>
For facility user data, we store for them about 100 days before purging out.<br>
Usually, the data is also transferred to user as soon as collection session is<br>
started. Our own data is stored for long term.<br>
<br>
Workstations all have SFP+ (we like Chelsio cards) connecting to the fiber switch.<br>
I think for small storage unit, it can be directly connected to a single workstation<br>
without needing a switch.<br>
<br>
Best regards,<br>
-Chen<br>
<br>
________________________________________<br>
From: Charles Bayly-Jones <<a href="mailto:charles.bayly-jones@monash.edu" target="_blank">charles.bayly-jones@monash.edu</a>><br>
Sent: Friday, April 2, 2021 8:12 PM<br>
To: Xu, Chen<br>
Cc: Matthias Wolf; Krishan Pandey; <a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a><br>
Subject: Re: [3dem] Data storage system<br>
<br>
Hi all.<br>
<br>
Our lab is also currently making similar considerations for a moderately large server. So this email chain has been quite serendipitous.<br>
<br>
I'm wondering whether those (Chen, Steve, Matthias, Tim) with external servers (45drives, trueNAS, synology, etc) might comment on their network setup? Did you opt for a special network switch? Has this been necessary or can these servers directly host the workstations? What kind of local network infrastructure do you use? Connections, SFP+/RJ45/some fancy optical thing?<br>
<br>
I note Steve has said, in the small 12-drive synologyNAS that a 10Gbe (RJ45?) card has been sufficient for ~950/600 MB/s IO. I recall the synology can be networked directly to workstations without the need for a switch, if I'm not mistaken. So what is people's experience with the other larger servers?<br>
<br>
Perhaps you might also comment on your typical use case? E.g. is your server for long term storage of processed or raw data? Or is it rather a scratch space for analysis with read & write?<br>
<br>
Very best,<br>
Charles<br>
_________________<br>
<br>
Charles Bayly-Jones<br>
BSc(ScSchProg)(Hons)<br>
<br>
Monash Biomedicine Discovery Institute & ARC CoE in advanced molecular imaging<br>
Department of Biochemistry and Molecular Biology<br>
Rm 218, Level 2, Building 77<br>
23 Innovation Walk<br>
Clayton VIC 3800<br>
Australia<br>
[Image result for monash university logo]<br>
<br>
<br>
On Sat, 3 Apr 2021 at 04:23, Xu, Chen <<a href="mailto:Chen.Xu@umassmed.edu" target="_blank">Chen.Xu@umassmed.edu</a><mailto:<a href="mailto:Chen.Xu@umassmed.edu" target="_blank">Chen.Xu@umassmed.edu</a>>> wrote:<br>
We also have very positive experience with FreeNAS/TruNAS system. Here is the shop for their<br>
on-the-shelf units.<br>
<br>
<a href="https://urldefense.com/v3/__https://www.amazon.com/stores/iXsystems/page/C88EFDE3-3E4C-4951-860E-0E8A8BD91BF9?ref_=ast_bln__;!!Mih3wA!XMzGwejDpzMf8LVPKLKH7ywovtHBrbzH4RFa7s3_HCHKfln9EJAtGF_JwCOnSJxj9w$" rel="noreferrer" target="_blank">https://urldefense.com/v3/__https://www.amazon.com/stores/iXsystems/page/C88EFDE3-3E4C-4951-860E-0E8A8BD91BF9?ref_=ast_bln__;!!Mih3wA!XMzGwejDpzMf8LVPKLKH7ywovtHBrbzH4RFa7s3_HCHKfln9EJAtGF_JwCOnSJxj9w$</a><<a href="https://urldefense.com/v3/__https://nam10.safelinks.protection.outlook.com/?url=https*3A*2F*2Furldefense.com*2Fv3*2F__https*3A*2F*2Fwww.amazon.com*2Fstores*2FiXsystems*2Fpage*2FC88EFDE3-3E4C-4951-860E-0E8A8BD91BF9*3Fref_*3Dast_bln__*3B!!Mih3wA!XMzGwejDpzMf8LVPKLKH7ywovtHBrbzH4RFa7s3_HCHKfln9EJAtGF_JwCOnSJxj9w*24&data=04*7C01*7CChen.Xu*40umassmed.edu*7Cd343c3e044014ec146a108d8f6352a35*7Cee9155fe2da34378a6c44405faf57b2e*7C0*7C0*7C637530055509932883*7CUnknown*7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0*3D*7C1000&sdata=xGdB*2FdPlKm*2FnDlBo6nVyrNqCNmUsTkOq8eeqLLa4Xu4*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJQ!!Mih3wA!T7oAvx3lrqO6gZdsEwTFFxNFaBUIlixCdVZ_jI4bU3NXloo_5zsfU6C6ml8D9Q9Yjg$" rel="noreferrer" target="_blank">https://urldefense.com/v3/__https://nam10.safelinks.protection.outlook.com/?url=https*3A*2F*2Furldefense.com*2Fv3*2F__https*3A*2F*2Fwww.amazon.com*2Fstores*2FiXsystems*2Fpage*2FC88EFDE3-3E4C-4951-860E-0E8A8BD91BF9*3Fref_*3Dast_bln__*3B!!Mih3wA!XMzGwejDpzMf8LVPKLKH7ywovtHBrbzH4RFa7s3_HCHKfln9EJAtGF_JwCOnSJxj9w*24&data=04*7C01*7CChen.Xu*40umassmed.edu*7Cd343c3e044014ec146a108d8f6352a35*7Cee9155fe2da34378a6c44405faf57b2e*7C0*7C0*7C637530055509932883*7CUnknown*7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0*3D*7C1000&sdata=xGdB*2FdPlKm*2FnDlBo6nVyrNqCNmUsTkOq8eeqLLa4Xu4*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJQ!!Mih3wA!T7oAvx3lrqO6gZdsEwTFFxNFaBUIlixCdVZ_jI4bU3NXloo_5zsfU6C6ml8D9Q9Yjg$</a> ><br>
<br>
-Chen<br>
<br>
________________________________________<br>
From: 3dem <<a href="mailto:3dem-bounces@ncmir.ucsd.edu" target="_blank">3dem-bounces@ncmir.ucsd.edu</a><mailto:<a href="mailto:3dem-bounces@ncmir.ucsd.edu" target="_blank">3dem-bounces@ncmir.ucsd.edu</a>>> on behalf of Matthias Wolf <<a href="mailto:matthias.wolf@oist.jp" target="_blank">matthias.wolf@oist.jp</a><mailto:<a href="mailto:matthias.wolf@oist.jp" target="_blank">matthias.wolf@oist.jp</a>>><br>
Sent: Friday, April 2, 2021 11:27 AM<br>
To: Krishan Pandey; <a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a><mailto:<a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a>><br>
Subject: Re: [3dem] Data storage system<br>
<br>
Hi Krishan,<br>
<br>
Our 60-drive 760 TB FreeNAS has been running flawless since more than 1 year. One failed drive was easily hot swapped. If you want capacity, this does not cost more per TB than inferior hardware, yet you get good redundancy and performance.<br>
<br>
See my old tweet here <a href="https://urldefense.com/v3/__https://twitter.com/hicryoem/status/1223966559976083458?s=21__;!!Mih3wA!XMzGwejDpzMf8LVPKLKH7ywovtHBrbzH4RFa7s3_HCHKfln9EJAtGF_JwCPmSkFojQ$" rel="noreferrer" target="_blank">https://urldefense.com/v3/__https://twitter.com/hicryoem/status/1223966559976083458?s=21__;!!Mih3wA!XMzGwejDpzMf8LVPKLKH7ywovtHBrbzH4RFa7s3_HCHKfln9EJAtGF_JwCPmSkFojQ$</a><<a href="https://urldefense.com/v3/__https://nam10.safelinks.protection.outlook.com/?url=https*3A*2F*2Furldefense.com*2Fv3*2F__https*3A*2F*2Ftwitter.com*2Fhicryoem*2Fstatus*2F1223966559976083458*3Fs*3D21__*3B!!Mih3wA!XMzGwejDpzMf8LVPKLKH7ywovtHBrbzH4RFa7s3_HCHKfln9EJAtGF_JwCPmSkFojQ*24&data=04*7C01*7CChen.Xu*40umassmed.edu*7Cd343c3e044014ec146a108d8f6352a35*7Cee9155fe2da34378a6c44405faf57b2e*7C0*7C0*7C637530055509932883*7CUnknown*7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0*3D*7C1000&sdata=or4AzmaH3kRTzvJxFCtXFdpCjoHTxBqKUROWxYVfFco*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJQ!!Mih3wA!T7oAvx3lrqO6gZdsEwTFFxNFaBUIlixCdVZ_jI4bU3NXloo_5zsfU6C6ml9YOVVMaw$" rel="noreferrer" target="_blank">https://urldefense.com/v3/__https://nam10.safelinks.protection.outlook.com/?url=https*3A*2F*2Furldefense.com*2Fv3*2F__https*3A*2F*2Ftwitter.com*2Fhicryoem*2Fstatus*2F1223966559976083458*3Fs*3D21__*3B!!Mih3wA!XMzGwejDpzMf8LVPKLKH7ywovtHBrbzH4RFa7s3_HCHKfln9EJAtGF_JwCPmSkFojQ*24&data=04*7C01*7CChen.Xu*40umassmed.edu*7Cd343c3e044014ec146a108d8f6352a35*7Cee9155fe2da34378a6c44405faf57b2e*7C0*7C0*7C637530055509932883*7CUnknown*7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0*3D*7C1000&sdata=or4AzmaH3kRTzvJxFCtXFdpCjoHTxBqKUROWxYVfFco*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJQ!!Mih3wA!T7oAvx3lrqO6gZdsEwTFFxNFaBUIlixCdVZ_jI4bU3NXloo_5zsfU6C6ml9YOVVMaw$</a> > <<a href="https://urldefense.com/v3/__https://nam10.safelinks.protection.outlook.com/?url=https*3A*2F*2Furldefense.com*2F" rel="noreferrer" target="_blank">https://urldefense.com/v3/__https://nam10.safelinks.protection.outlook.com/?url=https*3A*2F*2Furldefense.com*2F</a><br>
v3*2F__https*3A*2F*2Ftwitter.com*2Fhicryoem*2Fstatus*2F1223966559976083458*3Fs*3D21__*3B!!Mih3wA!TpItSV7E6sE1qSO0JgCwUfuLYuNhW92PMSZUaIF70zdj2z4BE_zg2izktUsKL5clRQ*24&data=04*7C01*7CChen.Xu*<a href="https://urldefense.com/v3/__http://40umassmed.edu__;!!Mih3wA!WZeXBSsDTaAcDru7sWlzE3iQ9ifNMj6s8GhEszQlFDxZPBE8vyuvx4VWc79PEBCRUA$" rel="noreferrer" target="_blank">40umassmed.edu</a>*7Ca3ecd1c220144d5c148208d8f5ebdb95*7Cee9155fe2da34378a6c44405faf57b2e*7C0*7C1*7C637529740649781691*7CUnknown*7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0*3D*7C2000&sdata=kHkXkbLqxxMR*2F*2FgoMCQQQxjSAvsIXrzIxrf93xWYXrE*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUl!!Mih3wA!XMzGwejDpzMf8LVPKLKH7ywovtHBrbzH4RFa7s3_HCHKfln9EJAtGF_JwCOaPADKzw$<<a href="https://urldefense.com/v3/__https://nam10.safelinks.protection.outlook.com/?url=https*3A*2F*2Furldefense.com*2Fv3*2F__https*3A*2F*2Fnam10.safelinks.protection.outlook.com*2F*3Furl*3Dhttps*3A*2F*2Furldefense.com*2Fv3*2F__https*3A*2F*2Ftwitter.com*2Fhicryoem*2Fstatus*2F1223966559976083458*3Fs*3D21__*3B!!Mih3wA!TpItSV7E6sE1qSO0JgCwUfuLYuNhW92PMSZUaIF70zdj2z4BE_zg2izktUsKL5clRQ*24*26data*3D04*7C01*7CChen.Xu*4" rel="noreferrer" target="_blank">https://urldefense.com/v3/__https://nam10.safelinks.protection.outlook.com/?url=https*3A*2F*2Furldefense.com*2Fv3*2F__https*3A*2F*2Fnam10.safelinks.protection.outlook.com*2F*3Furl*3Dhttps*3A*2F*2Furldefense.com*2Fv3*2F__https*3A*2F*2Ftwitter.com*2Fhicryoem*2Fstatus*2F1223966559976083458*3Fs*3D21__*3B!!Mih3wA!TpItSV7E6sE1qSO0JgCwUfuLYuNhW92PMSZUaIF70zdj2z4BE_zg2izktUsKL5clRQ*24*26data*3D04*7C01*7CChen.Xu*4</a><br>
<a href="https://urldefense.com/v3/__http://0umassmed.edu__;!!Mih3wA!WZeXBSsDTaAcDru7sWlzE3iQ9ifNMj6s8GhEszQlFDxZPBE8vyuvx4VWc790XS_kTA$" rel="noreferrer" target="_blank">0umassmed.edu</a>*7Ca3ecd1c220144d5c148208d8f5ebdb95*7Cee9155fe2da34378a6c44405faf57b2e*7C0*7C1*7C637529740649781691*7CUnknown*7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0*3D*7C2000*26sdata*3DkHkXkbLqxxMR*2F*2FgoMCQQQxjSAvsIXrzIxrf93xWYXrE*3D*26reserved*3D0__*3BJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUl!!Mih3wA!XMzGwejDpzMf8LVPKLKH7ywovtHBrbzH4RFa7s3_HCHKfln9EJAtGF_JwCOaPADKzw*24&data=04*7C01*7CChen.Xu*<a href="https://urldefense.com/v3/__http://40umassmed.edu__;!!Mih3wA!WZeXBSsDTaAcDru7sWlzE3iQ9ifNMj6s8GhEszQlFDxZPBE8vyuvx4VWc79PEBCRUA$" rel="noreferrer" target="_blank">40umassmed.edu</a>*7Cd343c3e044014ec146a108d8f6352a35*7Cee9155fe2da34378a6c44405faf57b2e*7C0*7C0*7C637530055509942876*7CUnknown*7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0*3D*7C1000&sdata=JDHHDuE7pqL6pDkj7xuugs8Q7*2FsePjbRpvAxE7n2kTk*3D&reserved=0__;JSUlJSUlJSUlJSUqKioqKioqKioqKioqKiolJSoqKioqKioqKioqKiUlKioqJSUlJSUlJSUlJSUlJSUlJSUl!!Mih3wA!T7oAvx3lrqO6gZdsEwTFFxNFaBUIlixCdVZ_jI4bU3NXloo_5zsfU6C6ml-O_lfHFA$ > ><br>
<br>
Matthias<br>
<br>
________________________________<br>
From: 3dem <<a href="mailto:3dem-bounces@ncmir.ucsd.edu" target="_blank">3dem-bounces@ncmir.ucsd.edu</a><mailto:<a href="mailto:3dem-bounces@ncmir.ucsd.edu" target="_blank">3dem-bounces@ncmir.ucsd.edu</a>>> on behalf of Krishan Pandey <<a href="mailto:krishan.pandey@health.slu.edu" target="_blank">krishan.pandey@health.slu.edu</a><mailto:<a href="mailto:krishan.pandey@health.slu.edu" target="_blank">krishan.pandey@health.slu.edu</a>>><br>
Sent: Friday, April 2, 2021 03:59<br>
To: <a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a><mailto:<a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a>><br>
Subject: [3dem] Data storage system<br>
<br>
Hello,<br>
<br>
I am requesting suggestions and cost estimates about off the shelf data storage systems to store raw cryo-EM movies and processed data for our lab. Our initial target is 150-200 TB with options to expand it in future.<br>
We don't have much local IT support for Linux based systems, that's why I am asking for an off-the shelf system which should be easier to install and manage.<br>
<br>
Thank you<br>
best regards<br>
<br>
Krishan Pandey<br>
<br>
_______________________________________________<br>
3dem mailing list<br>
<a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a><mailto:<a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a>><br>
<a href="https://mail.ncmir.ucsd.edu/mailman/listinfo/3dem" rel="noreferrer" target="_blank">https://mail.ncmir.ucsd.edu/mailman/listinfo/3dem</a><<a href="https://urldefense.com/v3/__https://nam10.safelinks.protection.outlook.com/?url=https*3A*2F*2Fmail.ncmir.ucsd.edu*2Fmailman*2Flistinfo*2F3dem&data=04*7C01*7CChen.Xu*40umassmed.edu*7Cd343c3e044014ec146a108d8f6352a35*7Cee9155fe2da34378a6c44405faf57b2e*7C0*7C0*7C637530055509942876*7CUnknown*7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0*3D*7C1000&sdata=HmJlP2rLOwwWvoB9q7p02zsBHgv41FIWLlZNHQf*2BdKg*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSU!!Mih3wA!T7oAvx3lrqO6gZdsEwTFFxNFaBUIlixCdVZ_jI4bU3NXloo_5zsfU6C6ml8NT8HDhA$" rel="noreferrer" target="_blank">https://urldefense.com/v3/__https://nam10.safelinks.protection.outlook.com/?url=https*3A*2F*2Fmail.ncmir.ucsd.edu*2Fmailman*2Flistinfo*2F3dem&data=04*7C01*7CChen.Xu*40umassmed.edu*7Cd343c3e044014ec146a108d8f6352a35*7Cee9155fe2da34378a6c44405faf57b2e*7C0*7C0*7C637530055509942876*7CUnknown*7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0*3D*7C1000&sdata=HmJlP2rLOwwWvoB9q7p02zsBHgv41FIWLlZNHQf*2BdKg*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSU!!Mih3wA!T7oAvx3lrqO6gZdsEwTFFxNFaBUIlixCdVZ_jI4bU3NXloo_5zsfU6C6ml8NT8HDhA$</a> ><br>
<br>
<br>
------------------------------<br>
<br>
Subject: Digest Footer<br>
<br>
_______________________________________________<br>
3dem mailing list<br>
<a href="mailto:3dem@ncmir.ucsd.edu" target="_blank">3dem@ncmir.ucsd.edu</a><br>
<a href="https://mail.ncmir.ucsd.edu/mailman/listinfo/3dem" rel="noreferrer" target="_blank">https://mail.ncmir.ucsd.edu/mailman/listinfo/3dem</a><br>
<br>
<br>
------------------------------<br>
<br>
End of 3dem Digest, Vol 164, Issue 11<br>
*************************************<br>
</blockquote></div></div>