Compare commits

Home / Compare f09d8f4e .. e3f21fee

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.966-35.965=0.002
σ0.103-0.102=0.002
min35.922-35.923=-0.001
max36.259-36.253=0.006
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.077-0.076=0.001
σ0.003-0.004=-0.001
min0.074-0.072=0.002
max0.084-0.083=0.001
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=-0.000
σ0.005-0.005=-0.000
min26.201-26.202=-0.001
max26.215-26.219=-0.004
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.060-0.062=-0.002
σ0.003-0.003=-0.000
min0.057-0.060=-0.003
max0.067-0.069=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.307-1756.305=0.001
σ0.368-0.369=-0.002
min1755.731-1755.731=0.000
max1756.898-1756.901=-0.002
mean1662.850-1658.700=4.150
σ635.230-635.030=0.200
min614.000-611.000=3.000
max2740.000-2736.000=4.000
mean2.377-2.370=0.008
σ0.147-0.142=0.005
min2.076-2.114=-0.038
max2.820-2.828=-0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.820-278.816=0.005
σ0.008-0.032=-0.024
min278.807-278.758=0.049
max278.827-278.835=-0.008
mean2740.000-2736.000=4.000
σ0.000
min2740.000-2736.000=4.000
max2740.000-2736.000=4.000
mean0.412-0.423=-0.011
σ0.005-0.010=-0.005
min0.408-0.407=0.001
max0.421-0.431=-0.010
iters=5
new-facts=1
prior-facts=6402
mean2268.877-2268.897=-0.020
σ0.016-0.013=0.004
min2268.848-2268.877=-0.029
max2268.889-2268.908=-0.019
mean2740.000-2736.000=4.000
σ0.000
min2740.000-2736.000=4.000
max2740.000-2736.000=4.000
mean3.012-3.152=-0.139
σ0.204-0.166=0.038
min2.904-2.910=-0.006
max3.376-3.332=0.045
iters=5
new-facts=6402
prior-facts=1
mean4954.228-4954.241=-0.013
σ0.817-0.935=-0.117
min4953.717-4953.724=-0.007
max4955.675-4955.905=-0.230
mean2740.000-2736.000=4.000
σ0.000
min2740.000-2736.000=4.000
max2740.000-2736.000=4.000
mean8.038-8.202=-0.165
σ0.246-0.476=-0.230
min7.752-7.859=-0.107
max8.417-9.024=-0.607
iters=5
new-facts=6402
prior-facts=6402
mean5168.731-5168.792=-0.061
σ0.204-0.081=0.122
min5168.387-5168.726=-0.339
max5168.887-5168.886=0.002
mean3362.400-3300.800=61.600
σ464.339-389.588=74.751
min2743.000-2915.000=-172.000
max3975.000-3694.000=281.000
mean9.454-9.329=0.125
σ0.488-0.208=0.280
min9.054-9.023=0.031
max10.131-9.597=0.534

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.028-0.996=0.032
σ0.145-0.072=0.073
min0.936-0.932=0.003
max1.269-1.074=0.195

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.358-460.355=0.003
σ572.652-572.653=-0.001
min174.023-174.020=0.003
max1319.336-1319.335=0.001
mean79.500
σ7.000
min76.000
max90.000
mean2740.000-2736.000=4.000
σ0.000
min2740.000-2736.000=4.000
max2740.000-2736.000=4.000
mean0.527-0.528=-0.001
σ0.516-0.525=-0.010
min0.264-0.264=0.000
max1.301-1.316=-0.015
policies=20
mean1740.454-1740.446=0.008
σ0.323-0.308=0.015
min1740.242-1740.250=-0.008
max1740.936-1740.905=0.030
mean760.000
σ0.000
min760.000
max760.000
mean2740.000-2736.000=4.000
σ0.000
min2740.000-2736.000=4.000
max2740.000-2736.000=4.000
mean2.693-2.662=0.031
σ0.007-0.029=-0.021
min2.684-2.620=0.064
max2.700-2.686=0.013
policies=200
mean17411.384-17411.521=-0.137
σ0.584-0.459=0.125
min17411.045-17411.243=-0.198
max17412.258-17412.207=0.052
mean7600.000
σ0.000
min7600.000
max7600.000
mean2740.000-2736.000=4.000
σ0.000
min2740.000-2736.000=4.000
max2740.000-2736.000=4.000
mean27.050-27.099=-0.049
σ0.059-0.094=-0.035
min26.993-27.046=-0.053
max27.111-27.240=-0.129