<feed xmlns='http://www.w3.org/2005/Atom'>
<title>sddm/utils/plot-michels, branch master</title>
<subtitle>Code for the self-destructing dark matter search in SNO</subtitle>
<link rel='alternate' type='text/html' href='https://www.tlatorre.com/cgit/sddm/'/>
<entry>
<title>get rid of nhit_thresh</title>
<updated>2021-01-04T19:03:03+00:00</updated>
<author>
<name>tlatorre</name>
<email>tlatorre@uchicago.edu</email>
</author>
<published>2021-01-04T19:03:03+00:00</published>
<link rel='alternate' type='text/html' href='https://www.tlatorre.com/cgit/sddm/commit/?id=3d13f8f409d412c6d2aa3447b81e29a1a3d7b2a7'/>
<id>3d13f8f409d412c6d2aa3447b81e29a1a3d7b2a7</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>cache results from get_events()</title>
<updated>2021-01-03T17:40:47+00:00</updated>
<author>
<name>tlatorre</name>
<email>tlatorre@uchicago.edu</email>
</author>
<published>2021-01-03T17:40:47+00:00</published>
<link rel='alternate' type='text/html' href='https://www.tlatorre.com/cgit/sddm/commit/?id=6fc97e22fa2a8cc48a96b2ce22c4d55a8fd2b80f'/>
<id>6fc97e22fa2a8cc48a96b2ce22c4d55a8fd2b80f</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>don't apply retrigger cut to MC</title>
<updated>2020-11-16T14:02:30+00:00</updated>
<author>
<name>tlatorre</name>
<email>tlatorre@uchicago.edu</email>
</author>
<published>2020-11-16T14:02:30+00:00</published>
<link rel='alternate' type='text/html' href='https://www.tlatorre.com/cgit/sddm/commit/?id=d248f5bef3d9e26d9e3adb0ac165bc2b351a6234'/>
<id>d248f5bef3d9e26d9e3adb0ac165bc2b351a6234</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>loop over MC filenames</title>
<updated>2020-11-16T14:00:44+00:00</updated>
<author>
<name>tlatorre</name>
<email>tlatorre@uchicago.edu</email>
</author>
<published>2020-11-16T14:00:44+00:00</published>
<link rel='alternate' type='text/html' href='https://www.tlatorre.com/cgit/sddm/commit/?id=b11000942eb96c5b50a18030b0b8bb130a3701af'/>
<id>b11000942eb96c5b50a18030b0b8bb130a3701af</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>don't apply nhit trigger cut to MC</title>
<updated>2020-11-01T17:12:14+00:00</updated>
<author>
<name>tlatorre</name>
<email>tlatorre@uchicago.edu</email>
</author>
<published>2020-11-01T17:12:14+00:00</published>
<link rel='alternate' type='text/html' href='https://www.tlatorre.com/cgit/sddm/commit/?id=d36ee0ae1209e124f794db103b2258a73df20c89'/>
<id>d36ee0ae1209e124f794db103b2258a73df20c89</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>major updates to the chi2 analysis</title>
<updated>2020-10-05T19:36:40+00:00</updated>
<author>
<name>tlatorre</name>
<email>tlatorre@uchicago.edu</email>
</author>
<published>2020-10-05T19:36:40+00:00</published>
<link rel='alternate' type='text/html' href='https://www.tlatorre.com/cgit/sddm/commit/?id=d48484c29d09a944de6f9251a3c659e76279464e'/>
<id>d48484c29d09a944de6f9251a3c659e76279464e</id>
<content type='text'>
This commit fixes the chi2 analysis so that it is no longer biased.
Previously, the chi2 analysis pull plots showed a consistent bias. At
first, I thought this was due to the fact that the posterior wasn't
gaussian, but even after switching to percentile plots based on the
algorithm outlined in "Validating Bayesian Inference Algorithms with
Simulation-Based Calibration", I was still seeing a bias. I finally
tracked it down to the fact that I was applying the energy scale
parameters to the data instead of the Monte Carlo. Therefore, in this
commit I update the posterior to now apply the energy scale parameters
to the Monte Carlo instead of the data. This has the slight disadvantage
that the final histograms will be binned in the biased energy, but
that's not really a big deal.

In addition, this commit contains several other updates:

- switch to plotting percentile plots based on the algorithm in
  "Validating Bayesian Inference Algorithms with Simulation-Based
  Calibration" instead of pull plots
- apply both the energy scale and resolution at the individual particle
  level, i.e. there is no longer an energy resolution term for electron
  + muon fits
- separate pull plots and coverage plots. Previously I was making both
  the p-value coverage plots and the pull plots at the same time.
  However, the pull plots shouldn't have anything to do with the GENIE
  weights whereas the p-value coverage plots should draw samples
  weighted by the GENIE weights. In addition, for the pull plots we draw
  new truth parameters on every iteration whereas for the p-value
  coverage plots we only draw them once.
- switch to using KDEMove() for the MCMC since I think it samples
  multimodal distributions a lot better than the default emcee move.
- I now correct for the reconstruction energy bias in plot-michel and
  plot-muons
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
This commit fixes the chi2 analysis so that it is no longer biased.
Previously, the chi2 analysis pull plots showed a consistent bias. At
first, I thought this was due to the fact that the posterior wasn't
gaussian, but even after switching to percentile plots based on the
algorithm outlined in "Validating Bayesian Inference Algorithms with
Simulation-Based Calibration", I was still seeing a bias. I finally
tracked it down to the fact that I was applying the energy scale
parameters to the data instead of the Monte Carlo. Therefore, in this
commit I update the posterior to now apply the energy scale parameters
to the Monte Carlo instead of the data. This has the slight disadvantage
that the final histograms will be binned in the biased energy, but
that's not really a big deal.

In addition, this commit contains several other updates:

- switch to plotting percentile plots based on the algorithm in
  "Validating Bayesian Inference Algorithms with Simulation-Based
  Calibration" instead of pull plots
- apply both the energy scale and resolution at the individual particle
  level, i.e. there is no longer an energy resolution term for electron
  + muon fits
- separate pull plots and coverage plots. Previously I was making both
  the p-value coverage plots and the pull plots at the same time.
  However, the pull plots shouldn't have anything to do with the GENIE
  weights whereas the p-value coverage plots should draw samples
  weighted by the GENIE weights. In addition, for the pull plots we draw
  new truth parameters on every iteration whereas for the p-value
  coverage plots we only draw them once.
- switch to using KDEMove() for the MCMC since I think it samples
  multimodal distributions a lot better than the default emcee move.
- I now correct for the reconstruction energy bias in plot-michel and
  plot-muons
</pre>
</div>
</content>
</entry>
<entry>
<title>update how the energy bias is applied in chi2 and plot-michels</title>
<updated>2020-10-05T16:15:33+00:00</updated>
<author>
<name>tlatorre</name>
<email>tlatorre@uchicago.edu</email>
</author>
<published>2020-10-05T16:15:33+00:00</published>
<link rel='alternate' type='text/html' href='https://www.tlatorre.com/cgit/sddm/commit/?id=1cd79549ee8ceb0f5e64e06611d891098905c05a'/>
<id>1cd79549ee8ceb0f5e64e06611d891098905c05a</id>
<content type='text'>
This commit updates how the energy bias is applied when we correct for
the energy bias in correct_energy_bias(). The correct way to apply this
correction is to compute:

    T_corrected = T_reco/(1+bias)

whereas previously we were multiplying by (1-bias).
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
This commit updates how the energy bias is applied when we correct for
the energy bias in correct_energy_bias(). The correct way to apply this
correction is to compute:

    T_corrected = T_reco/(1+bias)

whereas previously we were multiplying by (1-bias).
</pre>
</div>
</content>
</entry>
<entry>
<title>argmin -&gt; argmax</title>
<updated>2020-09-09T19:44:26+00:00</updated>
<author>
<name>tlatorre</name>
<email>tlatorre@uchicago.edu</email>
</author>
<published>2020-09-09T19:44:26+00:00</published>
<link rel='alternate' type='text/html' href='https://www.tlatorre.com/cgit/sddm/commit/?id=e9a15c52a88b86188c60cd423f9266a45a1701d6'/>
<id>e9a15c52a88b86188c60cd423f9266a45a1701d6</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>update michel script to fit for bias and resolution</title>
<updated>2020-09-09T19:25:54+00:00</updated>
<author>
<name>tlatorre</name>
<email>tlatorre@uchicago.edu</email>
</author>
<published>2020-09-09T19:25:54+00:00</published>
<link rel='alternate' type='text/html' href='https://www.tlatorre.com/cgit/sddm/commit/?id=0d9c562d02950f03deac10d2377f8e5c644aff31'/>
<id>0d9c562d02950f03deac10d2377f8e5c644aff31</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>update python scripts to not call plt.show() when run with --save</title>
<updated>2020-09-07T16:35:10+00:00</updated>
<author>
<name>tlatorre</name>
<email>tlatorre@uchicago.edu</email>
</author>
<published>2020-09-07T16:35:10+00:00</published>
<link rel='alternate' type='text/html' href='https://www.tlatorre.com/cgit/sddm/commit/?id=fd231f3d5472ff43044ee57ff3ac5fb37f85da5b'/>
<id>fd231f3d5472ff43044ee57ff3ac5fb37f85da5b</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
</feed>
