Compare commits

Home / Compare d93c2fab .. 57ae9f73

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.040=0.000
σ0.048-0.049=-0.001
min31.001-31.002=-0.001
max31.173-31.176=-0.003
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.079-0.073=0.005
σ0.002-0.004=-0.001
min0.077-0.070=0.006
max0.085-0.081=0.004
cache=y
dps=1
iters=10
policies=100
mean21.143-21.144=-0.001
σ0.003-0.003=0.000
min21.139-21.141=-0.002
max21.147-21.148=-0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.064-0.066=-0.002
σ0.004-0.003=0.001
min0.058-0.063=-0.005
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.412=-0.001
σ0.363-0.360=0.002
min1750.838-1750.853=-0.015
max1751.995-1751.976=0.020
mean1647.950-1660.600=-12.650
σ628.474-621.270=7.204
min628.000-639.000=-11.000
max2849.000-2505.000=344.000
mean2.831-2.831=-0.000
σ0.096-0.191=-0.096
min2.627-2.293=0.334
max3.066-3.210=-0.144

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.643-273.397=-1.754
σ0.004-0.018=-0.014
min271.639-273.367=-1.728
max271.648-273.412=-1.765
mean2849.000-2505.000=344.000
σ0.000
min2849.000-2505.000=344.000
max2849.000-2505.000=344.000
mean0.384-0.384=-0.000
σ0.009-0.009=0.000
min0.377-0.377=0.001
max0.397-0.394=0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.112-1933.834=-1.723
σ0.007-0.004=0.003
min1932.100-1933.831=-1.730
max1932.117-1933.841=-1.725
mean2849.000-2505.000=344.000
σ0.000
min2849.000-2505.000=344.000
max2849.000-2505.000=344.000
mean2.573-3.030=-0.456
σ0.195-0.109=0.086
min2.429-2.876=-0.447
max2.913-3.165=-0.252
iters=5
new-facts=6402
prior-facts=1
mean4752.642-4754.292=-1.650
σ0.770-0.879=-0.109
min4752.244-4753.614=-1.369
max4754.017-4755.835=-1.818
mean2849.000-2505.000=344.000
σ0.000
min2849.000-2505.000=344.000
max2849.000-2505.000=344.000
mean8.080-8.069=0.012
σ0.272-0.382=-0.110
min7.719-7.740=-0.021
max8.397-8.707=-0.310
iters=5
new-facts=6402
prior-facts=6402
mean4943.041-4944.727=-1.686
σ0.080-0.199=-0.118
min4942.961-4944.391=-1.430
max4943.128-4944.876=-1.749
mean3055.000-2962.200=92.800
σ266.493-412.198=-145.705
min2849.000-2505.000=344.000
max3462.000-3523.000=-61.000
mean8.414-8.625=-0.210
σ0.104-0.461=-0.357
min8.345-8.393=-0.049
max8.588-9.449=-0.861

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.076-1.732=-0.656
σ0.107-0.066=0.041
min0.938-1.639=-0.702
max1.239-1.801=-0.562

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.124-463.333=1.791
σ575.762-572.193=3.569
min177.233-177.235=-0.002
max1328.767-1321.623=7.144
mean79.750
σ7.500
min76.000
max91.000
mean2849.000-2505.000=344.000
σ0.000
min2849.000-2505.000=344.000
max2849.000-2505.000=344.000
mean0.443-0.540=-0.097
σ0.312-0.519=-0.208
min0.283-0.272=0.011
max0.910-1.319=-0.409
policies=20
mean1772.618-1772.587=0.031
σ0.333-0.337=-0.004
min1772.374-1772.366=0.008
max1773.106-1773.087=0.019
mean760.000
σ0.000
min760.000
max760.000
mean2849.000-2505.000=344.000
σ0.000
min2849.000-2505.000=344.000
max2849.000-2505.000=344.000
mean2.831-2.741=0.090
σ0.011-0.001=0.010
min2.818-2.739=0.078
max2.845-2.742=0.102
policies=200
mean17732.450-17732.364=0.086
σ0.455-0.596=-0.141
min17731.993-17731.993=-0.000
max17733.079-17733.247=-0.167
mean7600.000
σ0.000
min7600.000
max7600.000
mean2849.000-2505.000=344.000
σ0.000
min2849.000-2505.000=344.000
max2849.000-2505.000=344.000
mean28.173-27.666=0.508
σ0.425-0.154=0.271
min27.639-27.521=0.117
max28.559-27.878=0.681