<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
Hi,
<div class=""><br class="">
</div>
<div class="">I am getting errors trying to run the RELION version of Topaz to autopick filaments.</div>
<div class=""><br class="">
</div>
<div class="">I cannot use the Relion GUI to submit jobs, since our cluster is not in our control and is not set up to do so.</div>
<div class="">That is not a problem for other things, but for this I am getting ‘File Exists’ errors, when I know that these files are being created during the job and were not there prior to its submission.</div>
<div class=""><br class="">
</div>
<div class="">Perhaps it is a problem caused by the different options that are available when I run the topaz gui vs when I get command help from </div>
<div class="">
<pre class="">run_topaz_train.py -h. ?</pre>
<pre class=""><br class=""></pre>
<pre class=""><font face="Helvetica" class=""><span style="white-space: normal;" class="">Here is the command I get from the gui:</span></font></pre>
<pre class=""><pre class="">topaz train --train-images /projectnb/threepol/CS20Hst5set2e/Denoise/job002denoised_micrographs.star --train-targets /projectnb/threepol/CS20Hst5set2e/Extract/job045/particles.star --k-fold 5 --fold 0 --radius 3 --model resnet8 --image-ext .mrc --units 32 --dropout 0.0 --bn on --unit-scaling 2 --ngf 32 --method GE-binomial --autoencoder 0 --num-particles 1000 --l2 0 --learning-rate 0.0002 --minibatch-size 256 --minibatch-balance 0.0625 --epoch-size 5000 --num-epochs 10 --num-workers -1 --test-batch-size 1 --device 0 --save-prefix /projectnb/threepol/CS20Hst5set2e/Train/job002//model --output /projectnb/threepol/CS20Hst5set2e/Train/job002//results.txt</pre>
<pre class=""><font face="Helvetica" class=""><span style="white-space: normal;" class="">Here is the command I submit:</span></font></pre><div class=""><pre class="">mpirun -np $NSLOTS `which run_topaz_train.py` --inputmic /projectnb/threepol/CS20Hst5set2e/Denoise/job002denoised_micrographs.star --inputpart /projectnb/threepol/CS20Hst5set2e/Extract/job045/particles.star --k-fold 5 --fold 0 --radius 3 --model resnet8 --image-ext .mrc --units 32 --dropout 0.0 --bn on --scalefactor 2 --ngf 32 --method GE-binomial --autoencoder 0 --num-particles 2000 --l2 0 --learning-rate 0.0002 --minibatch-size 256 --minibatch-balance 0.0625 --epoch-size 5000 --num-epochs 10 --num-workers -1 --test-batch-size 1 --device 0 --output /projectnb/threepol/CS20Hst5set2e/Train/job002/
</pre><pre class=""><font face="Helvetica" class=""><span style="white-space: normal;" class=""><br class=""></span></font></pre><pre class=""><font face="Helvetica" class=""><span style="white-space: normal;" class="">Here is part of the error message:</span></font></pre><pre class=""><pre class="">Running command: relion_star_printtable /projectnb/threepol/CS20Hst5set2e/Extract/job045/particles.star data_particles _
rlnMicrographName _rlnCoordinateX _rlnCoordinateY | sed 's#.mrc##' | awk -F"/" '{print $NF}' | awk '{print $1" "$2"
"$3}' >> /projectnb/threepol/CS20Hst5set2e/Train/job002/inputparts.txt
Converting particles.star to Topaz input...
Running command: relion_star_printtable /projectnb/threepol/CS20Hst5set2e/Extract/job045/particles.star data_particles _rlnMicrographName _rlnCoordinateX _rlnCoordinateY | sed 's#.mrc##' | awk -F"/" '{print $NF}' | awk '{print $1" "$2" "$3}' >> /projectnb/threepol/CS20Hst5set2e/Train/job002/inputparts.txt
Traceback (most recent call last):
File "/share/pkg.7/topaz/0.2.5/install/topaz_venv/bin/run_topaz_train.py", line 71, in <module>
os.makedirs(outargsPreProc)
File "/share/pkg.7/python3/3.8.10/install/lib/python3.8/os.py", line 223, in makedirs
mkdir(name, mode)
FileExistsError: [Errno 17] File exists: '/projectnb/threepol/CS20Hst5set2e/Train/job002/PreProcessed/'
Traceback (most recent call last):
File "/share/pkg.7/topaz/0.2.5/install/topaz_venv/bin/run_topaz_train.py", line 71, in <module>
os.makedirs(outargsPreProc)
File "/share/pkg.7/python3/3.8.10/install/lib/python3.8/os.py", line 223, in makedirs
mkdir(name, mode)</pre><pre class="">...
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.</pre>
</pre><pre class="">Lastly, I don’t see a relion version of the Topaz pre-processing command for the micrographs (I did denoise them). Will that happen during training and auto picking, or am I missing a step?</pre><pre class=""><br class=""></pre><pre class="">Thanks very much.</pre><pre class="">Sincerely,</pre><pre class="">Esther</pre>
<br class=""></div>
</pre>
</div>
</body>
</html>