使用Slurm提交.m批处理作业后，是否可以在不更改原始提交的情况下编辑.m文件? [英] After submitting a .m batch job with Slurm, can I edit my .m file without changing my original submission?

问题描述

说我要在集群上运行作业:job1.m

Say I want to run a job on the cluster: job1.m

Slurm处理批处理作业，我正在加载Mathematica以保存输出文件job1.csv

Slurm handles the batch jobs and I'm loading Mathematica to save the output file job1.csv

我提交了job1.m，它正在排队.现在，我将job1.m编辑为具有不同的变量和参数，并告诉它将数据保存到job1_edited.csv.然后，我重新提交job1.m.

I submit job1.m and it is sitting in the queue. Now, I edit job1.m to have different variables and parameters, and tell it to save data to job1_edited.csv. Then I re-submit job1.m.

现在队列中有两个批处理作业.

Now I have two batch jobs in the queue.

我的输出文件将会怎样? job1.csv将是原始job1.m文件中的数据吗?并且job1_edited.csv将成为来自已编辑文件的数据吗?还是job1.csv和job1_edited.csv是相同的输出?

What will happen to my output files? Will job1.csv be data from the original job1.m file? And will job1_edited.csv be data from the edited file? Or will job1.csv and job1_edited.csv be the same output?

:(

提前谢谢！

推荐答案

我假设job1.m是Mathematica作业，从Bash提交脚本内部运行.在这种情况下，job1.m将在作业开始时读取，因此，如果在提交后但在作业开始之前对其进行了修改，则将运行修改后的版本.如果在作业开始后对其进行了修改，则将运行原始版本.

I am assuming job1.m is a Mathematica job, run from inside a Bash submission script. In that case, job1.m is read when the job starts so if it is modified after submission but before job start, the modified version will run. If it is modified after the job starts, the original version will run.

如果job1.m是提交脚本本身(因此您运行sbatch job1.m)，则该脚本将复制到特定于该作业的假脱机目录中，因此，如果在提交作业后对其进行了修改，它仍将运行原始脚本版本.

If job1.m is the submission script itself (so you run sbatch job1.m), that script is copied in a spool directory specific to the job so if it is modified after the job is submitted, it still will run the original version.

在任何情况下，为了可重复性和可追溯性，最好使用工作流管理器，例如 Fireworks 或 Bosco

In any case, it is better, for reproducibility and traceability, to make use of a workflow manager such as Fireworks, or Bosco

这篇关于使用Slurm提交.m批处理作业后，是否可以在不更改原始提交的情况下编辑.m文件?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！