Compare commits

Home / Compare cd98de84 .. 1c31cc64

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.797=0.001
σ0.107-0.108=-0.001
min35.749-35.749=-0.000
max36.102-36.103=-0.001
mean414.000-415.200=-1.200
σ0.000-0.422=-0.422
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.075-0.073=0.002
σ0.003-0.005=-0.001
min0.071-0.069=0.002
max0.082-0.082=0.000
cache=y
dps=1
iters=10
policies=100
mean26.064-26.065=-0.001
σ0.003-0.004=-0.001
min26.060-26.060=0.000
max26.069-26.072=-0.003
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.061-0.061=-0.000
σ0.003-0.002=0.000
min0.057-0.057=0.000
max0.067-0.066=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1755.922=0.002
σ0.365-0.368=-0.002
min1755.345-1755.355=-0.010
max1756.517-1756.515=0.002
mean1672.000-1669.700=2.300
σ639.372-631.599=7.773
min673.000-669.000=4.000
max2700.000-2627.000=73.000
mean2.815-2.740=0.075
σ0.109-0.237=-0.128
min2.576-2.195=0.381
max3.000-3.066=-0.065

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.194-277.196=-0.002
σ0.007-0.005=0.003
min277.184-277.190=-0.007
max277.203-277.201=0.002
mean2700.000-2627.000=73.000
σ0.000
min2700.000-2627.000=73.000
max2700.000-2627.000=73.000
mean0.395-0.402=-0.008
σ0.010-0.004=0.006
min0.390-0.400=-0.010
max0.412-0.409=0.003
iters=5
new-facts=1
prior-facts=6402
mean2174.433-2174.448=-0.015
σ0.014-0.023=-0.009
min2174.415-2174.424=-0.009
max2174.450-2174.471=-0.021
mean2700.000-2627.000=73.000
σ0.000
min2700.000-2627.000=73.000
max2700.000-2627.000=73.000
mean3.032-3.020=0.012
σ0.229-0.100=0.129
min2.775-2.876=-0.102
max3.325-3.140=0.184
iters=5
new-facts=6402
prior-facts=1
mean5052.635-5052.618=0.017
σ0.986-0.985=0.001
min5052.051-5052.035=0.016
max5054.387-5054.371=0.016
mean2700.000-2627.000=73.000
σ0.000
min2700.000-2627.000=73.000
max2700.000-2627.000=73.000
mean8.639-8.596=0.043
σ0.676-0.620=0.056
min7.979-7.943=0.036
max9.706-9.490=0.215
iters=5
new-facts=6402
prior-facts=6402
mean5188.426-5188.431=-0.005
σ0.083-0.085=-0.002
min5188.365-5188.351=0.013
max5188.520-5188.528=-0.008
mean3236.400-3218.600=17.800
σ381.299-388.678=-7.379
min2700.000-2682.000=18.000
max3698.000-3706.000=-8.000
mean8.957-8.927=0.030
σ0.511-0.437=0.074
min8.653-8.550=0.102
max9.863-9.670=0.194

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.100-1.270=-0.170
σ0.122-0.280=-0.158
min0.933-0.940=-0.007
max1.248-1.647=-0.400

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.858-464.857=0.001
σ572.660-572.658=0.002
min178.524-178.523=0.000
max1323.848-1323.844=0.005
mean79.500
σ7.000
min76.000
max90.000
mean2700.000-2627.000=73.000
σ0.000
min2700.000-2627.000=73.000
max2700.000-2627.000=73.000
mean0.560-0.554=0.006
σ0.560-0.538=0.022
min0.274-0.266=0.009
max1.400-1.361=0.039
policies=20
mean1785.487-1785.460=0.027
σ0.348-0.349=-0.001
min1785.253-1785.230=0.023
max1786.004-1785.979=0.025
mean760.000
σ0.000
min760.000
max760.000
mean2700.000-2627.000=73.000
σ0.000
min2700.000-2627.000=73.000
max2700.000-2627.000=73.000
mean2.786-2.767=0.019
σ0.012-0.013=-0.000
min2.772-2.752=0.021
max2.800-2.782=0.018
policies=200
mean17861.396-17861.498=-0.102
σ0.597-0.544=0.053
min17861.054-17861.110=-0.055
max17862.287-17862.302=-0.015
mean7600.000
σ0.000
min7600.000
max7600.000
mean2700.000-2627.000=73.000
σ0.000
min2700.000-2627.000=73.000
max2700.000-2627.000=73.000
mean28.061-28.036=0.024
σ0.145-0.128=0.018
min27.934-27.907=0.027
max28.206-28.155=0.051