Compare commits

Home / Compare b7ef13b7 .. a8baec13

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.692
σ0.593
min35.929
max37.212
mean4136.000
σ0.000
min4136.000
max4136.000
mean0.076
σ0.001
min0.075
max0.077
cache=y
dps=1
iters=10
policies=100
mean26.712
σ0.644
min26.209
max27.464
mean4136.000
σ0.000
min4136.000
max4136.000
mean0.060
σ0.001
min0.059
max0.061

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.366-1756.306=0.060
σ0.373-0.367=0.006
min1755.794-1755.752=0.043
max1756.966-1756.898=0.068
mean1649.800-1652.850=-3.050
σ625.248-636.462=-11.214
min613.000-615.000=-2.000
max2651.000-2611.000=40.000
mean2.339-2.244=0.095
σ0.241-0.138=0.103
min2.136-2.087=0.049
max3.050-2.736=0.314

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.699-278.695=0.005
σ0.012-0.014=-0.002
min278.687-278.677=0.010
max278.715-278.709=0.006
mean2651.000-2611.000=40.000
σ0.000
min2651.000-2611.000=40.000
max2651.000-2611.000=40.000
mean0.416-0.420=-0.004
σ0.002-0.001=0.001
min0.413-0.418=-0.005
max0.419-0.421=-0.002
iters=5
new-facts=1
prior-facts=6402
mean2268.864-2268.840=0.024
σ0.006-0.017=-0.011
min2268.853-2268.822=0.032
max2268.869-2268.864=0.005
mean2651.000-2611.000=40.000
σ0.000
min2651.000-2611.000=40.000
max2651.000-2611.000=40.000
mean3.054-3.303=-0.249
σ0.151-0.136=0.015
min2.868-3.144=-0.276
max3.214-3.491=-0.277
iters=5
new-facts=6402
prior-facts=1
mean4952.357-4955.921=-3.564
σ0.789-1.046=-0.257
min4951.949-4955.025=-3.076
max4953.767-4957.720=-3.954
mean2651.000-2611.000=40.000
σ0.000
min2651.000-2611.000=40.000
max2651.000-2611.000=40.000
mean7.896-8.126=-0.229
σ0.193-0.322=-0.130
min7.714-7.745=-0.031
max8.163-8.620=-0.457
iters=5
new-facts=6402
prior-facts=6402
mean5166.999-5170.773=-3.774
σ0.165-0.084=0.081
min5166.706-5170.678=-3.972
max5167.096-5170.850=-3.754
mean3422.600-3454.200=-31.600
σ478.771-474.506=4.264
min2877.000-2839.000=38.000
max4136.000-4118.000=18.000
mean9.350-9.320=0.030
σ0.480-0.153=0.327
min8.517-9.107=-0.589
max9.725-9.459=0.266

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.027-1.037=-0.010
σ0.131-0.137=-0.007
min0.936-0.947=-0.011
max1.241-1.262=-0.021

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.259-460.252=0.007
σ572.607-572.608=-0.001
min173.954-173.947=0.007
max1319.170-1319.164=0.006
mean79.500
σ7.000
min76.000
max90.000
mean435.000
σ0.000
min435.000
max435.000
mean0.559-0.554=0.005
σ0.570-0.546=0.025
min0.267-0.274=-0.007
max1.414-1.372=0.042
policies=20
mean1740.048-1739.984=0.064
σ0.335-0.332=0.002
min1739.810-1739.746=0.064
max1740.541-1740.473=0.068
mean760.000
σ0.000
min760.000
max760.000
mean446.250-445.500=0.750
σ10.308-9.950=0.358
min435.000
max455.000-454.000=1.000
mean2.673-2.662=0.011
σ0.015-0.013=0.002
min2.661-2.651=0.010
max2.693-2.679=0.013
policies=200
mean17409.790-17409.258=0.533
σ0.081-0.167=-0.086
min17409.686-17409.060=0.626
max17409.879-17409.467=0.412
mean7600.000
σ0.000
min7600.000
max7600.000
mean492.750-492.500=0.250
σ2.754-3.416=-0.662
min490.000-489.000=1.000
max496.000-497.000=-1.000
mean26.869-26.978=-0.109
σ0.097-0.102=-0.005
min26.776-26.894=-0.118
max27.005-27.116=-0.111