Compare commits

Home / Compare 3f37f9c3 .. bfaa9a22

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.964-35.965=-0.001
σ0.105-0.107=-0.002
min35.920-35.923=-0.003
max36.262-36.269=-0.007
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.077-0.076=0.001
σ0.003-0.005=-0.001
min0.074-0.071=0.003
max0.084-0.083=0.000
cache=y
dps=1
iters=10
policies=100
mean26.203-26.202=0.001
σ0.005-0.005=0.001
min26.197-26.196=0.001
max26.212-26.208=0.004
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.062-0.062=0.001
σ0.003-0.003=0.001
min0.060-0.060=-0.000
max0.069-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.610-1756.614=-0.004
σ0.370-0.368=0.002
min1756.039-1756.041=-0.002
max1757.208-1757.210=-0.002
mean1637.000-1638.950=-1.950
σ629.169-629.593=-0.424
min638.000-640.000=-2.000
max2833.000-2837.000=-4.000
mean2.441-2.432=0.010
σ0.154-0.196=-0.042
min2.304-2.284=0.020
max2.917-2.966=-0.050

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.692-277.693=-0.001
σ0.009-0.005=0.004
min277.679-277.686=-0.007
max277.702-277.698=0.003
mean2833.000-2837.000=-4.000
σ0.000
min2833.000-2837.000=-4.000
max2833.000-2837.000=-4.000
mean0.408-0.409=-0.001
σ0.006-0.008=-0.002
min0.400-0.401=-0.001
max0.414-0.418=-0.004
iters=5
new-facts=1
prior-facts=6402
mean2176.655-2176.663=-0.008
σ0.012-0.008=0.004
min2176.642-2176.649=-0.008
max2176.670-2176.671=-0.001
mean2833.000-2837.000=-4.000
σ0.000
min2833.000-2837.000=-4.000
max2833.000-2837.000=-4.000
mean2.961-2.854=0.107
σ0.108-0.113=-0.004
min2.823-2.765=0.058
max3.080-3.042=0.038
iters=5
new-facts=6402
prior-facts=1
mean5046.164-5046.315=-0.150
σ0.982-0.948=0.033
min5045.292-5045.796=-0.504
max5047.846-5048.004=-0.158
mean2833.000-2837.000=-4.000
σ0.000
min2833.000-2837.000=-4.000
max2833.000-2837.000=-4.000
mean8.494-8.667=-0.173
σ0.398-0.642=-0.245
min8.053-8.136=-0.083
max8.945-9.754=-0.809
iters=5
new-facts=6402
prior-facts=6402
mean5183.682-5183.614=0.069
σ0.080-0.207=-0.128
min5183.611-5183.266=0.344
max5183.775-5183.784=-0.009
mean3292.000-3237.600=54.400
σ360.699-417.728=-57.028
min2833.000-2837.000=-4.000
max3645.000-3829.000=-184.000
mean8.845-8.882=-0.037
σ0.099-0.302=-0.203
min8.718-8.652=0.066
max8.974-9.359=-0.385

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.076-1.040=0.036
σ0.214-0.146=0.067
min0.937-0.947=-0.011
max1.443-1.284=0.159

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.916-463.904=0.012
σ573.070-573.080=-0.010
min177.372-177.358=0.014
max1323.521-1323.523=-0.002
mean77.750
σ7.500
min74.000
max89.000
mean2833.000-2837.000=-4.000
σ0.000
min2833.000-2837.000=-4.000
max2833.000-2837.000=-4.000
mean0.438-0.438=-0.000
σ0.306-0.301=0.005
min0.284-0.285=-0.001
max0.897-0.890=0.007
policies=20
mean1774.021-1773.866=0.154
σ0.324-0.329=-0.005
min1773.813-1773.653=0.160
max1774.502-1774.354=0.148
mean740.000
σ0.000
min740.000
max740.000
mean2833.000-2837.000=-4.000
σ0.000
min2833.000-2837.000=-4.000
max2833.000-2837.000=-4.000
mean2.831-2.824=0.007
σ0.011-0.005=0.006
min2.815-2.818=-0.003
max2.840-2.830=0.010
policies=200
mean17745.754-17744.837=0.916
σ0.716-0.508=0.207
min17744.719-17744.478=0.242
max17746.281-17745.591=0.690
mean7400.000
σ0.000
min7400.000
max7400.000
mean2833.000-2837.000=-4.000
σ0.000
min2833.000-2837.000=-4.000
max2833.000-2837.000=-4.000
mean28.346-28.127=0.219
σ0.635-0.530=0.104
min27.710-27.570=0.140
max29.139-28.720=0.419