Compare commits

Home / Compare cfa49386 .. 3c1b1e4b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.978=0.002
σ0.049-0.050=-0.000
min33.942-33.939=0.004
max34.117-34.115=0.002
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.084-0.079=0.005
σ0.002-0.004=-0.002
min0.082-0.075=0.007
max0.089-0.088=0.002
cache=y
dps=1
iters=10
policies=100
mean23.318-23.319=-0.001
σ0.003-0.002=0.001
min23.315-23.315=-0.000
max23.324-23.322=0.002
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.064-0.064=0.001
σ0.004-0.003=0.001
min0.060-0.060=-0.000
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.302-1757.301=0.001
σ0.365-0.364=0.001
min1756.726-1756.727=-0.001
max1757.886-1757.894=-0.008
mean1648.050-1647.350=0.700
σ630.487-623.751=6.735
min636.000-638.000=-2.000
max2835.000-2825.000=10.000
mean2.369-2.352=0.017
σ0.087-0.068=0.019
min2.266-2.227=0.039
max2.636-2.495=0.142

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.443-326.452=-0.009
σ0.058-0.031=0.027
min326.339-326.398=-0.059
max326.477-326.472=0.005
mean2835.000-2825.000=10.000
σ0.000
min2835.000-2825.000=10.000
max2835.000-2825.000=10.000
mean0.427-0.424=0.003
σ0.012-0.003=0.009
min0.420-0.421=-0.001
max0.449-0.430=0.020
iters=5
new-facts=1
prior-facts=6402
mean1988.612-1848.274=140.338
σ0.014-313.784=-313.770
min1988.593-1286.960=701.633
max1988.627-1988.617=0.009
mean2835.000-2825.000=10.000
σ0.000
min2835.000-2825.000=10.000
max2835.000-2825.000=10.000
mean2.728-2.666=0.062
σ0.142-0.500=-0.358
min2.558-1.798=0.760
max2.879-3.001=-0.122
iters=5
new-facts=6402
prior-facts=1
mean4813.391-4813.512=-0.121
σ7.763-7.694=0.069
min4809.610-4809.911=-0.300
max4827.273-4827.274=-0.001
mean2835.000-2825.000=10.000
σ0.000
min2835.000-2825.000=10.000
max2835.000-2825.000=10.000
mean8.212-8.194=0.017
σ0.572-0.561=0.011
min7.609-7.744=-0.135
max9.044-9.114=-0.070
iters=5
new-facts=6402
prior-facts=6402
mean5001.005-5001.017=-0.012
σ0.035-0.035=0.000
min5000.975-5000.975=-0.000
max5001.063-5001.065=-0.002
mean3035.800-2986.800=49.000
σ253.285-232.556=20.729
min2835.000-2825.000=10.000
max3411.000-3351.000=60.000
mean9.442-9.781=-0.339
σ0.635-0.274=0.360
min8.520-9.328=-0.808
max10.229-10.012=0.217

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.052-0.975=0.078
σ0.171-0.068=0.103
min0.917-0.915=0.002
max1.338-1.051=0.287

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.441-464.438=0.002
σ574.770-574.771=-0.001
min177.047-177.042=0.005
max1326.596-1326.594=0.001
mean88.250
σ8.500
min84.000
max101.000
mean2835.000-2825.000=10.000
σ0.000
min2835.000-2825.000=10.000
max2835.000-2825.000=10.000
mean0.437-0.434=0.003
σ0.308-0.299=0.009
min0.282-0.281=0.001
max0.898-0.882=0.017
policies=20
mean1770.774-1770.751=0.024
σ0.362-0.363=-0.002
min1770.525-1770.488=0.037
max1771.310-1771.286=0.023
mean840.000
σ0.000
min840.000
max840.000
mean2835.000-2825.000=10.000
σ0.000
min2835.000-2825.000=10.000
max2835.000-2825.000=10.000
mean2.776-2.784=-0.008
σ0.008-0.003=0.005
min2.766-2.780=-0.014
max2.785-2.786=-0.000
policies=200
mean17714.699-17714.745=-0.045
σ0.563-0.454=0.109
min17714.385-17714.397=-0.012
max17715.541-17715.412=0.129
mean8400.000
σ0.000
min8400.000
max8400.000
mean2835.000-2825.000=10.000
σ0.000
min2835.000-2825.000=10.000
max2835.000-2825.000=10.000
mean27.852-27.844=0.008
σ0.333-0.444=-0.111
min27.570-27.429=0.141
max28.225-28.286=-0.061