Compare commits

Home / Compare 3185a422 .. f3e5d982

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.041=-0.000
σ0.048-0.049=-0.001
min31.001-30.999=0.002
max31.174-31.175=-0.001
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.079-0.077=0.002
σ0.003-0.006=-0.004
min0.076-0.070=0.006
max0.084-0.089=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.143-21.142=0.000
σ0.002-0.002=-0.000
min21.139-21.139=0.000
max21.145-21.146=-0.001
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.063-0.061=0.002
σ0.003-0.003=0.000
min0.060-0.058=0.002
max0.071-0.067=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.413-1751.410=0.003
σ0.364-0.363=0.001
min1750.845-1750.846=-0.002
max1751.996-1751.998=-0.001
mean1655.350-1648.750=6.600
σ644.941-637.791=7.151
min633.000-630.000=3.000
max2851.000-2842.000=9.000
mean2.837-2.788=0.049
σ0.175-0.162=0.013
min2.303-2.282=0.021
max3.016-2.994=0.022

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.641-271.644=-0.003
σ0.005-0.008=-0.003
min271.637-271.631=0.006
max271.649-271.652=-0.004
mean2851.000-2842.000=9.000
σ0.000
min2851.000-2842.000=9.000
max2851.000-2842.000=9.000
mean0.384-0.378=0.006
σ0.008-0.005=0.003
min0.378-0.375=0.003
max0.396-0.387=0.009
iters=5
new-facts=1
prior-facts=6402
mean1932.104-1932.102=0.002
σ0.012-0.018=-0.006
min1932.086-1932.080=0.006
max1932.113-1932.118=-0.005
mean2851.000-2842.000=9.000
σ0.000
min2851.000-2842.000=9.000
max2851.000-2842.000=9.000
mean2.565-2.594=-0.028
σ0.197-0.246=-0.050
min2.443-2.385=0.058
max2.910-3.004=-0.094
iters=5
new-facts=6402
prior-facts=1
mean4752.622-4752.414=0.208
σ0.786-1.008=-0.222
min4752.159-4751.622=0.537
max4754.021-4754.113=-0.092
mean2851.000-2842.000=9.000
σ0.000
min2851.000-2842.000=9.000
max2851.000-2842.000=9.000
mean8.260-8.159=0.101
σ0.620-0.468=0.152
min7.644-7.752=-0.108
max9.190-8.906=0.284
iters=5
new-facts=6402
prior-facts=6402
mean4943.047-4943.043=0.004
σ0.085-0.080=0.005
min4942.968-4942.971=-0.003
max4943.151-4943.131=0.020
mean3053.400-3063.600=-10.200
σ256.488-295.017=-38.529
min2851.000-2842.000=9.000
max3436.000-3521.000=-85.000
mean8.428-8.432=-0.004
σ0.083-0.270=-0.187
min8.339-8.276=0.063
max8.565-8.910=-0.345

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.083-1.044=0.039
σ0.109-0.117=-0.008
min0.947-0.937=0.011
max1.252-1.222=0.030

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.128-465.122=0.006
σ575.766-575.755=0.011
min177.235-177.237=-0.002
max1328.777-1328.754=0.023
mean79.750
σ7.500
min76.000
max91.000
mean2851.000-2842.000=9.000
σ0.000
min2851.000-2842.000=9.000
max2851.000-2842.000=9.000
mean0.442-0.434=0.008
σ0.311-0.305=0.006
min0.282-0.281=0.001
max0.908-0.891=0.017
policies=20
mean1772.617-1772.626=-0.009
σ0.325-0.333=-0.008
min1772.378-1772.393=-0.015
max1773.093-1773.115=-0.022
mean760.000
σ0.000
min760.000
max760.000
mean2851.000-2842.000=9.000
σ0.000
min2851.000-2842.000=9.000
max2851.000-2842.000=9.000
mean2.828-2.831=-0.002
σ0.017-0.011=0.006
min2.809-2.817=-0.008
max2.848-2.844=0.003
policies=200
mean17732.581-17732.541=0.040
σ0.455-0.465=-0.010
min17732.239-17732.189=0.050
max17733.252-17733.227=0.025
mean7600.000
σ0.000
min7600.000
max7600.000
mean2851.000-2842.000=9.000
σ0.000
min2851.000-2842.000=9.000
max2851.000-2842.000=9.000
mean28.176-28.173=0.003
σ0.506-0.575=-0.068
min27.623-27.577=0.046
max28.606-28.875=-0.268