aboutsummaryrefslogtreecommitdiff
path: root/utils/submit-grid-jobs
AgeCommit message (Collapse)Author
2019-08-05add ability to specify a particle combo on the command linetlatorre
This commit updates the fit program to accept a particle combo from the command line so you can fit for a single particle combination hypothesis. For example running: $ ./fit ~/zdabs/mu_minus_700_1000.hdf5 -p 2020 would just fit for the 2 electron hypothesis. The reason for adding this ability is that my grid jobs were getting evicted when fitting muons in run 10,000 since it takes 10s of hours to fit for all the particle hypothesis. With this change, and a small update to the submit-grid-jobs script we now submit a single grid job per particle combination hypothesis which should make each grid job run approximately 4 times faster.
2019-07-11switch from YAML output to HDF5 to speed things uptlatorre
2019-06-20update zdab-cat to emit multiple YAML documentstlatorre
This commit updates zdab-cat to output each event as an individual YAML document. The advantage of this is that we can then iterate over these without loading the entire YAML document in submit-grid-jobs which means that we won't use GB of memory on the grid submission node.
2019-06-20update submit-grid-jobs to send stderr to /dev/nulltlatorre
2019-06-06update submit-grid-jobstlatorre
This commit updates submit-grid-jobs so that it keeps track of which files it's already submitted grid jobs for.
2019-06-05try to import CLoader if possible since it's *much* fastertlatorre
2019-06-02use yaml.loader.SafeLoadertlatorre
2019-06-02fix another bug in submit-grid-jobstlatorre
2019-06-02use full path in submit-grid-jobstlatorre
2019-06-02update submit-grid-jobs to create a new directorytlatorre
2019-05-24add a script to concatenate output from grid jobstlatorre
2019-05-24add the template for condor submit files to submit-grid-jobstlatorre
2019-05-24add a script to submit jobs to the gridtlatorre