Compare commits

Home / Compare 6bae6140 .. 7bd17dd0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.957-30.958=-0.001
σ0.049-0.050=-0.001
min30.918-30.915=0.003
max31.094-31.096=-0.002
mean413.000
σ0.000
min413.000
max413.000
mean0.076-0.075=0.001
σ0.004-0.005=-0.001
min0.071-0.070=0.001
max0.082-0.085=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=0.001
σ0.003-0.002=0.001
min21.055-21.057=-0.001
max21.064-21.063=0.001
mean413.000
σ0.000
min413.000
max413.000
mean0.060-0.059=0.001
σ0.003-0.004=-0.001
min0.057-0.057=0.000
max0.065-0.070=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.410=0.001
σ0.363-0.361=0.002
min1750.838-1750.849=-0.010
max1751.994-1751.994=0.000
mean1655.000-1651.150=3.850
σ649.188-615.506=33.682
min646.000-636.000=10.000
max2861.000-2487.000=374.000
mean2.807-2.807=-0.001
σ0.186-0.199=-0.013
min2.536-2.309=0.227
max3.175-3.088=0.087

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.762-275.764=-0.001
σ0.004-0.012=-0.008
min275.756-275.749=0.008
max275.767-275.777=-0.010
mean2861.000-2487.000=374.000
σ0.000
min2861.000-2487.000=374.000
max2861.000-2487.000=374.000
mean0.406-0.400=0.006
σ0.010-0.016=-0.007
min0.398-0.375=0.023
max0.418-0.419=-0.000
iters=5
new-facts=1
prior-facts=6402
mean2168.280-2168.296=-0.016
σ0.019-0.006=0.014
min2168.251-2168.292=-0.041
max2168.300-2168.306=-0.006
mean2861.000-2487.000=374.000
σ0.000
min2861.000-2487.000=374.000
max2861.000-2487.000=374.000
mean2.803-2.974=-0.171
σ0.107-0.148=-0.041
min2.674-2.787=-0.113
max2.942-3.165=-0.223
iters=5
new-facts=6402
prior-facts=1
mean5048.004-5048.006=-0.002
σ1.004-1.021=-0.017
min5047.265-5047.093=0.172
max5049.766-5049.752=0.014
mean2861.000-2487.000=374.000
σ0.000
min2861.000-2487.000=374.000
max2861.000-2487.000=374.000
mean8.727-8.787=-0.060
σ0.504-0.482=0.022
min8.041-8.122=-0.081
max9.271-9.393=-0.121
iters=5
new-facts=6402
prior-facts=6402
mean5179.253-5179.251=0.002
σ0.087-0.075=0.012
min5179.171-5179.184=-0.013
max5179.350-5179.345=0.004
mean3318.800-3227.800=91.000
σ446.028-395.165=50.863
min2861.000-2690.000=171.000
max3953.000-3733.000=220.000
mean10.071-10.046=0.025
σ0.103-0.170=-0.067
min9.970-9.797=0.173
max10.220-10.237=-0.017

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.052-1.731=-0.679
σ0.123-0.170=-0.047
min0.937-1.467=-0.530
max1.238-1.894=-0.656

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.342-463.332=0.010
σ572.196-572.196=-0.000
min177.238-177.230=0.009
max1321.635-1321.626=0.009
mean79.750
σ7.500
min76.000
max91.000
mean2861.000-2487.000=374.000
σ0.000
min2861.000-2487.000=374.000
max2861.000-2487.000=374.000
mean0.440-0.548=-0.108
σ0.304-0.526=-0.222
min0.282-0.277=0.005
max0.896-1.337=-0.441
policies=20
mean1772.638-1772.568=0.071
σ0.334-0.343=-0.009
min1772.398-1772.334=0.064
max1773.126-1773.076=0.051
mean760.000
σ0.000
min760.000
max760.000
mean2861.000-2487.000=374.000
σ0.000
min2861.000-2487.000=374.000
max2861.000-2487.000=374.000
mean2.850-2.769=0.082
σ0.009-0.029=-0.020
min2.842-2.732=0.110
max2.859-2.803=0.057
policies=200
mean17732.449-17732.247=0.203
σ0.537-0.705=-0.168
min17732.160-17731.691=0.469
max17733.254-17733.279=-0.026
mean7600.000
σ0.000
min7600.000
max7600.000
mean2861.000-2487.000=374.000
σ0.000
min2861.000-2487.000=374.000
max2861.000-2487.000=374.000
mean28.385-27.805=0.580
σ0.450-0.146=0.304
min27.997-27.701=0.296
max28.869-28.020=0.849