Compare commits

Home / Compare 19c71f07 .. 769ae10e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.727
σ0.611
min35.931
max37.215
mean3791.000
σ0.000
min3791.000
max3791.000
mean0.075
σ0.001
min0.074
max0.079
cache=y
dps=1
iters=10
policies=100
mean26.587
σ0.608
min26.207
max27.469
mean3791.000
σ0.000
min3791.000
max3791.000
mean0.061
σ0.001
min0.059
max0.064

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.359-1755.328=1.030
σ0.373-0.366=0.007
min1755.780-1754.752=1.028
max1756.955-1755.921=1.034
mean1653.750-1663.550=-9.800
σ626.512-628.401=-1.888
min613.000-677.000=-64.000
max2631.000-2691.000=-60.000
mean2.291-2.260=0.031
σ0.184-0.092=0.092
min2.134-2.095=0.039
max2.792-2.434=0.358

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.673-277.739=0.934
σ0.014-0.014=-0.000
min278.660-277.721=0.939
max278.696-277.756=0.940
mean2631.000-2691.000=-60.000
σ0.000
min2631.000-2691.000=-60.000
max2631.000-2691.000=-60.000
mean0.418-0.411=0.007
σ0.002-0.002=-0.000
min0.416-0.408=0.008
max0.420-0.413=0.007
iters=5
new-facts=1
prior-facts=6402
mean2268.833-2267.883=0.951
σ0.021-0.007=0.014
min2268.809-2267.873=0.936
max2268.853-2267.891=0.963
mean2631.000-2691.000=-60.000
σ0.000
min2631.000-2691.000=-60.000
max2631.000-2691.000=-60.000
mean3.118-2.978=0.140
σ0.157-0.088=0.068
min2.863-2.913=-0.050
max3.275-3.133=0.141
iters=5
new-facts=6402
prior-facts=1
mean4952.344-4955.215=-2.871
σ0.775-0.986=-0.210
min4951.955-4954.507=-2.553
max4953.730-4956.917=-3.187
mean2631.000-2691.000=-60.000
σ0.000
min2631.000-2691.000=-60.000
max2631.000-2691.000=-60.000
mean7.816-7.996=-0.180
σ0.138-0.169=-0.031
min7.582-7.849=-0.267
max7.943-8.286=-0.343
iters=5
new-facts=6402
prior-facts=6402
mean5167.047-5169.760=-2.714
σ0.006-0.083=-0.077
min5167.039-5169.695=-2.655
max5167.053-5169.852=-2.799
mean3355.200-3401.400=-46.200
σ427.903-473.727=-45.824
min2936.000-2750.000=186.000
max3791.000-3996.000=-205.000
mean9.307-9.204=0.103
σ0.216-0.128=0.088
min9.065-9.080=-0.015
max9.620-9.379=0.241

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.594-1.078=0.516
σ0.362-0.227=0.135
min1.159-0.946=0.213
max1.905-1.473=0.432

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.256-456.315=3.942
σ572.608-572.592=0.016
min173.949-170.017=3.931
max1319.167-1315.202=3.965
mean79.500
σ7.000
min76.000
max90.000
mean436.000-433.000=3.000
σ0.000
min436.000-433.000=3.000
max436.000-433.000=3.000
mean0.547-0.543=0.004
σ0.550-0.559=-0.009
min0.270-0.262=0.008
max1.372-1.382=-0.010
policies=20
mean1740.012-1700.706=39.306
σ0.329-0.314=0.016
min1739.772-1700.477=39.295
max1740.495-1701.165=39.330
mean760.000
σ0.000
min760.000
max760.000
mean445.250-447.250=-2.000
σ9.032-11.927=-2.895
min436.000-434.000=2.000
max453.000-463.000=-10.000
mean2.655-2.633=0.022
σ0.022-0.010=0.012
min2.637-2.618=0.019
max2.686-2.642=0.043
policies=200
mean17409.295-17016.605=392.689
σ0.078-0.098=-0.019
min17409.201-17016.488=392.712
max17409.375-17016.728=392.647
mean7600.000
σ0.000
min7600.000
max7600.000
mean488.000-494.000=-6.000
σ2.944
min484.000-490.000=-6.000
max491.000-497.000=-6.000
mean26.820-26.479=0.341
σ0.073-0.050=0.023
min26.732-26.413=0.319
max26.910-26.530=0.379