OK, to check:
- run various models on various dataset (i.e., different signal fractions) to see if relegator does acutally give better performance than the binary softmax. Multiple trials on each dataset to check stability. run_master.py does this. Running on wintermute rn. Need to write a script to visualize results.
- apply models that have been trained on various randomly generated weighted datasets. When sig_frac is small, there will be a large amount of statistical variation in n_S between weighted datasets. So, apply a trained model to many weighted datasets to investigate the variation in analysis power. Need to write a new script to do this.
No comments:
Post a Comment