Compare commits

Home / Compare e21f26cd .. a73f93f3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.001
σ0.048-0.047=0.001
min33.950-33.952=-0.001
max34.113-34.110=0.004
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.083-0.084=-0.000
σ0.004-0.003=0.001
min0.078-0.081=-0.004
max0.090-0.090=0.001
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.001
σ0.003-0.002=0.001
min23.315-23.314=0.001
max23.325-23.321=0.004
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.066-0.065=0.000
σ0.003-0.003=-0.000
min0.064-0.063=0.000
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.364-1757.365=-0.002
σ0.364-0.364=-0.000
min1756.790-1756.790=-0.000
max1757.953-1757.956=-0.003
mean1644.850-1664.050=-19.200
σ623.728-627.572=-3.844
min635.000-670.000=-35.000
max2821.000-2612.000=209.000
mean2.344-2.329=0.015
σ0.102-0.107=-0.004
min2.238-2.166=0.072
max2.675-2.672=0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.516-326.501=0.015
σ0.038-0.065=-0.027
min326.450-326.386=0.064
max326.540-326.541=-0.001
mean2821.000-2612.000=209.000
σ0.000
min2821.000-2612.000=209.000
max2821.000-2612.000=209.000
mean0.424-0.424=0.000
σ0.003-0.000=0.003
min0.422-0.424=-0.002
max0.430-0.425=0.005
iters=5
new-facts=1
prior-facts=6402
mean1988.669-1988.671=-0.001
σ0.015-0.012=0.002
min1988.649-1988.652=-0.002
max1988.683-1988.683=0.000
mean2821.000-2612.000=209.000
σ0.000
min2821.000-2612.000=209.000
max2821.000-2612.000=209.000
mean2.807-2.684=0.123
σ0.171-0.088=0.083
min2.650-2.616=0.034
max3.016-2.837=0.179
iters=5
new-facts=6402
prior-facts=1
mean4813.527-4813.567=-0.040
σ7.688-7.680=0.008
min4810.034-4810.004=0.031
max4827.279-4827.304=-0.025
mean2821.000-2612.000=209.000
σ0.000
min2821.000-2612.000=209.000
max2821.000-2612.000=209.000
mean8.451-8.325=0.126
σ0.506-0.462=0.045
min7.806-7.714=0.093
max8.933-8.923=0.010
iters=5
new-facts=6402
prior-facts=6402
mean5001.068-5000.865=0.203
σ0.021-0.184=-0.163
min5001.037-5000.702=0.335
max5001.095-5001.081=0.014
mean3029.000-2976.800=52.200
σ260.182-275.295=-15.113
min2821.000-2612.000=209.000
max3416.000-3308.000=108.000
mean9.659-9.829=-0.169
σ0.136-0.140=-0.004
min9.510-9.632=-0.122
max9.780-9.983=-0.203

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.948-1.225=-0.277
σ0.060-0.364=-0.304
min0.907-0.913=-0.007
max1.053-1.719=-0.666

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.499-464.504=-0.004
σ574.772-574.780=-0.008
min177.107-177.110=-0.004
max1326.658-1326.674=-0.016
mean88.250
σ8.500
min84.000
max101.000
mean2821.000-2612.000=209.000
σ0.000
min2821.000-2612.000=209.000
max2821.000-2612.000=209.000
mean0.436-0.550=-0.113
σ0.305-0.555=-0.250
min0.282-0.271=0.011
max0.893-1.382=-0.489
policies=20
mean1771.399-1771.392=0.007
σ0.357-0.363=-0.006
min1771.153-1771.147=0.006
max1771.926-1771.930=-0.004
mean840.000
σ0.000
min840.000
max840.000
mean2821.000-2612.000=209.000
σ0.000
min2821.000-2612.000=209.000
max2821.000-2612.000=209.000
mean2.800-2.741=0.059
σ0.012-0.038=-0.027
min2.783-2.719=0.065
max2.811-2.798=0.012
policies=200
mean17721.118-17720.993=0.125
σ0.528-0.534=-0.006
min17720.770-17720.619=0.151
max17721.888-17721.776=0.113
mean8400.000
σ0.000
min8400.000
max8400.000
mean2821.000-2612.000=209.000
σ0.000
min2821.000-2612.000=209.000
max2821.000-2612.000=209.000
mean27.908-27.390=0.518
σ0.380-0.140=0.240
min27.563-27.213=0.350
max28.264-27.543=0.721