Compare commits

Home / Compare d6dd24c3 .. 815bd7f4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.329-1754.046=1.283
σ0.366-0.365=0.001
min1754.756-1753.470=1.287
max1755.919-1754.643=1.276
mean1670.000-1664.400=5.600
σ619.161-632.529=-13.369
min678.000-684.000=-6.000
max2648.000-2616.000=32.000
mean2.217-2.764=-0.547
σ0.079-0.178=-0.100
min2.128-2.180=-0.052
max2.391-3.001=-0.609

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.720-190.721=86.999
σ0.008-0.007=0.001
min277.707-190.715=86.992
max277.725-190.732=86.993
mean2648.000-2616.000=32.000
σ0.000
min2648.000-2616.000=32.000
max2648.000-2616.000=32.000
mean0.418-0.284=0.134
σ0.001-0.003=-0.001
min0.417-0.280=0.137
max0.419-0.286=0.133
iters=5
new-facts=1
prior-facts=6402
mean2267.888-1989.484=278.405
σ0.007-0.045=-0.039
min2267.879-1989.408=278.471
max2267.898-1989.528=278.369
mean2648.000-2616.000=32.000
σ0.000
min2648.000-2616.000=32.000
max2648.000-2616.000=32.000
mean2.863-2.440=0.423
σ0.058-0.144=-0.086
min2.817-2.237=0.580
max2.963-2.605=0.358
iters=5
new-facts=6402
prior-facts=1
mean4954.960-4880.083=74.877
σ0.564-0.622=-0.057
min4954.662-4879.735=74.928
max4955.967-4881.188=74.779
mean2648.000-2616.000=32.000
σ0.000
min2648.000-2616.000=32.000
max2648.000-2616.000=32.000
mean7.923-8.286=-0.363
σ0.227-0.205=0.022
min7.653-8.099=-0.446
max8.189-8.513=-0.325
iters=5
new-facts=6402
prior-facts=6402
mean5169.793-4891.689=278.104
σ0.079-0.077=0.002
min5169.704-4891.616=278.088
max5169.869-4891.773=278.096
mean3379.200-3201.000=178.200
σ473.000-376.060=96.940
min2730.000-2828.000=-98.000
max3969.000-3580.000=389.000
mean9.216-8.222=0.993
σ0.313-0.247=0.066
min8.761-8.003=0.758
max9.531-8.605=0.926

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-1.562=-0.559
σ0.138-0.089=0.048
min0.935-1.459=-0.523
max1.249-1.663=-0.414

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean456.319-456.477=-0.158
σ572.595-572.538=0.057
min170.021-170.207=-0.186
max1315.212-1315.284=-0.072
mean79.500
σ7.000
min76.000
max90.000
mean432.000-433.000=-1.000
σ0.000
min432.000-433.000=-1.000
max432.000-433.000=-1.000
mean0.551-0.533=0.018
σ0.556-0.536=0.020
min0.269-0.261=0.009
max1.385-1.337=0.048
policies=20
mean1700.730-1702.577=-1.847
σ0.304-0.310=-0.006
min1700.503-1702.355=-1.851
max1701.174-1703.033=-1.859
mean760.000
σ0.000
min760.000
max760.000
mean444.500-442.500=2.000
σ11.240-8.660=2.580
min432.000-435.000=-3.000
max454.000-450.000=4.000
mean2.624-2.621=0.003
σ0.005-0.016=-0.010
min2.619-2.602=0.017
max2.631-2.639=-0.008
policies=200
mean17016.732-17035.297=-18.565
σ0.063-0.129=-0.066
min17016.641-17035.135=-18.493
max17016.784-17035.441=-18.657
mean7600.000
σ0.000
min7600.000
max7600.000
mean494.750-491.750=3.000
σ3.594-2.500=1.094
min490.000-488.000=2.000
max498.000-493.000=5.000
mean26.390-26.572=-0.181
σ0.082-0.123=-0.041
min26.304-26.389=-0.086
max26.468-26.659=-0.191