aboutsummaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2020-08-30don't sample more instrumentals than there are in the datatlatorre
2020-08-30update dc scriptstlatorre
- delete instrumental tags in both scripts since we already tag them in get_events() - apply the same cuts to the MC as to the data - add a comment about the fitted fraction - quit if we don't have at least 1 type of each instrumental
2020-08-30increase energy resolution uncertainty when running with --coveragetlatorre
2020-08-30treat muons like Monte Carlotlatorre
2020-08-30update energy resolution -> max(EPSILON,resolution)tlatorre
This commit updates the chi2 script to make sure that the energy resolution is nonzero otherwise we get nans.
2020-08-30update bins when adding energy resolutiontlatorre
This commit updates the first bins that we use before applying the energy resolution in the chi2 script. The reason we do this is because when adding the energy resolution, events outside of the original bins may migrate into the first and last bin.
2020-08-30small updates to chi2 scripttlatorre
2020-08-25fix a stupid bug in the last committlatorre
2020-08-25speed up get_multinomial_prob()tlatorre
2020-08-25fix stupid bug in last committlatorre
2020-08-25speed up nll function in chi2tlatorre
2020-08-25update chi2 script to plot p-value coveragetlatorre
2020-08-20add external muons to the chi2 fittlatorre
2020-08-19update chi2 analysis to include bias and resolution termstlatorre
2020-08-17add a new script to plot the michel energy distributiontlatorre
2020-08-17update stoppig muon criteriatlatorre
This commit updates the criteria for selecting stopping muons from: - calibrated nhit < 4000 - udotr < -0.5 to - reconstructed kinetic energy < 10 GeV The previous criteria were intended to remove through going atmospheric events but produced a strong bias in the comparison due to the nhit cut and an energy bias in the data relative to the Monte Carlo. The new cut does a good job of cutting through going muons but doesn't produce the same bias.
2020-08-17simplify likelihood calculation in chi2tlatorre
2020-08-17simplify nllr() functiontlatorre
2020-08-17update function to tag atmosphericstlatorre
Previously the function to tag atmospherics was looking at the *first* event to come after a prompt event and checking to see if it was a neutron. However, this has a huge issue in that for large energy events, there is often secondary events caused by afterpulsing. I've now updated the algorithm to look for any events in which there is *any* follower event that passes the neutron criteria.
2020-08-17fix bug in get_events()tlatorre
ev.r -> ev_single_particle.r
2020-07-28only plot Michels from stopping muonstlatorre
2020-07-28catch Exception when zdab-cat fails and continuetlatorre
2020-07-27update plot-muonstlatorre
2020-07-27update plot-muonstlatorre
- added a cos(theta) cut - plot the energy and angular distribution of stopping muons - fix bug in calculating Michel normalization constant - plot legend for energy resolution plot
2020-07-27identify muons in the MC by looking for 'cosmic' in the filenametlatorre
2020-07-27update how the negative log likelihood ratio is calculatedtlatorre
I found a really simple form for the log likelihood ratio of a Poisson and multinomial likelihood.
2020-07-27update how we calculte the p-value in chi2tlatorre
2020-07-27add 20 MeV cut to dc, dc-closure-test, and plot-dctlatorre
2020-07-27loop over runs in dc, dc-closure-test, and plot-dc to prevent using too much ↵tlatorre
memory
2020-07-27only merge fit info for events with at least 10 fitstlatorre
This commit updates get_events() to only merge fit info for events with at least 10 events. The reason for this is that when analyzing recent data where not all the fits have completed we don't want to plot the data for events which haven't completely finished being fit.
2020-07-27update how the p-value is calculated in get_multinomial_prob()tlatorre
2020-07-07add zdab-reprocess-orphans and plot-muons to Makefiletlatorre
2020-07-07add a script to reprocess just junk eventstlatorre
2020-07-06add function to print particle probabilities in plot-muonstlatorre
2020-07-06update plot-muons to plot energy distributions for each particle ID for ↵tlatorre
stopping muons
2020-07-06small updates to plot-muons and plot_energy.pytlatorre
- use pd.Series.where() instead of DataFrame.loc() to speed things up in tag_michels - don't set y limits when plotting bias and resolution for stopping muons
2020-07-06update plot-muonstlatorre
- add get_multinomial_prob() function to stats.py - add plot_hist2_data_mc() function to do the normal particle id plot but also print p values - other small bug fixes
2020-07-06add sddm/stats.pytlatorre
This commit adds the new file sddm/stats.py to and adds a function to correctly sample a Monte Carlo histogram when computing p-values. In particular, I now take into account the uncertainty on the total number of expected events by drawing from a gamma distribution, which is the posterior of the Poisson likelihood function with a prior of 1/lambda.
2020-07-06only look at Michel electrons where the muon had < 2500 nhittlatorre
2020-07-06update plot-muonstlatorre
- only look at muons with nhit < 4000 and udotr < -0.5 - switch from energy1 -> ke
2020-07-06add first draft of plot-muonstlatorre
This commit adds a first draft of a script to plot the michel energy distribution and particle id histograms for data and Monte Carlo and to plot the energy bias and resolution for stopping muons.
2020-06-29only set prompt events to muonstlatorre
2020-06-29add energy scale to chi2 fittlatorre
2020-06-29mark all events as muon if 'muon' is in the filenametlatorre
2020-06-23first draft of a script to do the chi2 analysistlatorre
This commit adds a first draft of a script called chi2. This script calculates a chi2 for the null hypothesis test if the events in the energy range 20 MeV - 10 GeV match what we expect from atmospheric neutrino events.
2020-06-22only recreate the fits dataset if there are new fitstlatorre
2020-06-22update get_events() to require at least 1 nhit trigger to firetlatorre
This commit updates get_events() to require at least 1 nhit trigger to fire. The reason for this is that after looking at a small fraction of the data I noticed a bunch of instrumental events that weren't getting tagged in run 10141. They looked sort of like neck events and were surrounded by hundreds of orphaned PMT hits. My best guess is that they really were neck events but the neck PMT hits and the hits in the lower hemisphere were erroneously not getting built into the events. Luckily, all of these events failed the psi cut, but it's not great to rely on such a high level cut to cut these events. One other thing I noticed was that these events were triggered mostly by MISS, OWLEL, and OWLEH. Therefore I thought it might be a good idea to require events to have at least 1 NHIT trigger. To test whether the NHIT triggers were reliably firing before the other triggers I looked at all muon events which *didn't* have an NHIT trigger fire. All of them appeared to be falsely tagged neck events so I'm fairly confident that the NHIT triggers do reliably fire before the other triggers for physics events.
2020-06-22update cat-grid-jobs to not use hdf5 resizetlatorre
This commit updates cat-grid-jobs to just add all the fits at once at the end instead of continuously resizing the fits dataset. The reason for this is that I noticed that several fit results files would occasionally have a large block of the fits be set to all zeros. I have no idea how this happened, but I suspect it might have been a bug with resizing the dataset so many times.
2020-06-22set reprocessed attribute to 1 instead of Truetlatorre
This commit updates cat-grid-jobs to change the reprocessed attribute to be 1 instead of True since the previous value was giving the following warning: /usr/lib64/python2.7/site-packages/tables/attributeset.py:298: DataTypeWarning: Unsupported type for attribute 'reprocessed' in node '/'. Offending HDF5 class: 8 value = self._g_getattr(self._v_node, name) when opening them up with pandas read_hdf() function.
2020-06-22update neck cuttlatorre
This commit updates the neck cut to increase the number of neck PMT hits even if the neck PMT hit time isn't calibrated correctly. This is because I was looking at all muon events which didn't have an NHIT trigger fire and I noticed the following events: Run GTID ---- ---- 10036 1462054 10040 2270713 10133 1096180 They all appear to be neck events, but the first one in particular has 4 neck PMTs that got hit. When looking into it I realized that all 4 hits had ept times of -9999. several events: