haskell-te: f11e64d6444ff28ba8771e2f42fa0510295f56ea

     1: From: Chris Warburton
     2: Date: Sun, 26 Nov 2017 19:17:44 +0000
     3: State: resolved
     4: Subject: Run benchmark analyses even after failure
     5: Message-Id: <d47550d08485b89b-0-artemis@nixos>
     6: resolution: fixed
     7: 
     8: In particular, we need to know the number of wanted conjectures for
     9: *all* data points, including those which failed. This is easy enough,
    10: since it only depends on the sample, which we know whether or not the
    11: exploration succeeded. We can supply '[]' to the analyser's stdin in the
    12: case of a failure, which will give us 0 recall, undefined precision and
    13: a list of all the wanted conjectures.
    14: 
    15: The reason we need to know this is to work out the standard deviation of
    16: our precisions and recalls.