[3dem] cryo-EM data processing in the cloud/AWS

[Chip Lesburg]

Hi 3DEM-ers,

I wonder if anyone has experience processing cryo-EM data in the cloud, specifically using AWS infrastructure? There are a few online resources describing this, listed below. I am hoping to learn from others' experiences, including considerations and unexpected pitfalls.

How does your choice of cloud CPU/GPU instance compare with on-premises computer hardware you may have access to? How do you transfer raw movies from the microscope facility to your own storage area in the cloud (direct network transfer, first transfer to a disk array, etc.)?

https://urldefense.com/v3/__https://aws.amazon.com/blogs/hpc/tag/cryo-em/__;!!Mih3wA!CMWEZwXyRqadyg_1XwJ40k5jk4WfLCJUR4bXgU5Fpic1vMN-Qyx2b--g4gT-aRJs-vb4U6_V7xmYwN6qAA$  
https://urldefense.com/v3/__http://cryoem-tools.cloud/__;!!Mih3wA!CMWEZwXyRqadyg_1XwJ40k5jk4WfLCJUR4bXgU5Fpic1vMN-Qyx2b--g4gT-aRJs-vb4U6_V7xkYBBJREQ$  
https://urldefense.com/v3/__https://sites.google.com/site/emcloudprocessing/__;!!Mih3wA!CMWEZwXyRqadyg_1XwJ40k5jk4WfLCJUR4bXgU5Fpic1vMN-Qyx2b--g4gT-aRJs-vb4U6_V7xl13NL_gg$  
https://urldefense.com/v3/__https://guide.cryosparc.com/deploy/cryosparc-on-aws__;!!Mih3wA!CMWEZwXyRqadyg_1XwJ40k5jk4WfLCJUR4bXgU5Fpic1vMN-Qyx2b--g4gT-aRJs-vb4U6_V7xmRZbOEcg$  
https://urldefense.com/v3/__https://nramm.nysbc.org/wp-content/seminars/2017/slides/nramm_workshop_2017_cianfrocco.pdf__;!!Mih3wA!CMWEZwXyRqadyg_1XwJ40k5jk4WfLCJUR4bXgU5Fpic1vMN-Qyx2b--g4gT-aRJs-vb4U6_V7xnqEA2JNg$  

Chip

P.S. cross-posted to the CCP-EM mailing list


[cid:153156_edd5022b-de61-48a6-bf68-1a41de35ba89.png]   Charles Lesburg
Vice President, Structural Biology

M 908-265-2064
301 Binney Street, Cambridge, MA 02142
odysseytx.com

This message is for the named person's use only. It may contain confidential, proprietary or legally privileged information. If you receive this message in error, please immediately delete it and all copies of it from your system, destroy any hard copies of it and notify the sender. ODYSSEY THERAPEUTICS, INC. ("ODYSSEY THERAPEUTICS") reserves the right to monitor all e-mail communications through its networks. ODYSSEY THERAPEUTICS cannot be committed by this e-mail or warrant the accuracy or validity of any information presented. Any views expressed in this message are those of the individual sender.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.ncmir.ucsd.edu/pipermail/3dem/attachments/20220830/a7f99fa0/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 153156_edd5022b-de61-48a6-bf68-1a41de35ba89.png
Type: image/png
Size: 18009 bytes
Desc: 153156_edd5022b-de61-48a6-bf68-1a41de35ba89.png
URL: <http://mail.ncmir.ucsd.edu/pipermail/3dem/attachments/20220830/a7f99fa0/attachment-0001.png>