Compare commits

Home / Compare 07171241 .. f13bed70

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.706-70.708=-0.002
σ0.047-0.047=0.001
min70.680-70.679=0.002
max70.838-70.838=-0.000
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.155-0.160=-0.005
σ0.004-0.004=0.000
min0.149-0.157=-0.008
max0.162-0.167=-0.006
cache=y
dps=1
iters=10
policies=100
mean21.413-21.412=0.001
σ0.002-0.002=0.001
min21.409-21.409=-0.000
max21.416-21.415=0.001
mean414.000-412.800=1.200
σ0.000-0.422=-0.422
min414.000-412.000=2.000
max414.000-413.000=1.000
mean0.065-0.065=0.000
σ0.003-0.003=-0.000
min0.063-0.063=0.000
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.931=-0.001
σ0.361-0.361=-0.000
min1754.357-1754.365=-0.008
max1755.522-1755.518=0.004
mean1655.950-1659.300=-3.350
σ620.054-620.432=-0.378
min682.000-623.000=59.000
max2770.000-2510.000=260.000
mean2.778-2.759=0.019
σ0.163-0.212=-0.048
min2.316-2.141=0.175
max3.014-2.949=0.065

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.779-272.793=-0.014
σ0.013-0.006=0.006
min272.766-272.785=-0.020
max272.794-272.801=-0.008
mean2770.000-2510.000=260.000
σ0.000
min2770.000-2510.000=260.000
max2770.000-2510.000=260.000
mean0.384-0.382=0.002
σ0.010-0.008=0.003
min0.378-0.376=0.002
max0.403-0.395=0.008
iters=5
new-facts=1
prior-facts=6402
mean1933.227-1933.210=0.017
σ0.014-0.011=0.002
min1933.206-1933.195=0.011
max1933.241-1933.223=0.018
mean2770.000-2510.000=260.000
σ0.000
min2770.000-2510.000=260.000
max2770.000-2510.000=260.000
mean3.130-3.087=0.043
σ0.146-0.179=-0.033
min3.026-2.810=0.215
max3.376-3.245=0.130
iters=5
new-facts=6402
prior-facts=1
mean4756.939-4757.026=-0.087
σ7.667-7.521=0.146
min4753.435-4753.581=-0.146
max4770.654-4770.479=0.175
mean2770.000-2510.000=260.000
σ0.000
min2770.000-2510.000=260.000
max2770.000-2510.000=260.000
mean8.897-8.112=0.785
σ0.425-0.320=0.105
min8.487-7.783=0.703
max9.587-8.615=0.972
iters=5
new-facts=6402
prior-facts=6402
mean4944.449-4944.389=0.060
σ0.018-0.163=-0.145
min4944.429-4944.098=0.332
max4944.472-4944.477=-0.005
mean3037.400-2941.400=96.000
σ326.239-392.145=-65.906
min2770.000-2510.000=260.000
max3526.000-3476.000=50.000
mean8.420-8.529=-0.109
σ0.066-0.243=-0.177
min8.350-8.338=0.012
max8.517-8.888=-0.371

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-1.638=-0.635
σ0.145-0.246=-0.101
min0.905-1.222=-0.317
max1.240-1.866=-0.625

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.344-468.304=0.040
σ574.233-574.226=0.007
min181.221-181.186=0.035
max1329.693-1329.643=0.050
mean88.250
σ8.500
min84.000
max101.000
mean2770.000-2510.000=260.000
σ0.000
min2770.000-2510.000=260.000
max2770.000-2510.000=260.000
mean0.442-0.562=-0.120
σ0.299-0.561=-0.262
min0.289-0.279=0.011
max0.891-1.404=-0.513
policies=20
mean1812.545-1812.149=0.396
σ0.385-0.387=-0.002
min1812.281-1811.900=0.381
max1813.112-1812.724=0.389
mean840.000
σ0.000
min840.000
max840.000
mean2770.000-2510.000=260.000
σ0.000
min2770.000-2510.000=260.000
max2770.000-2510.000=260.000
mean2.868-2.794=0.074
σ0.007-0.010=-0.002
min2.860-2.782=0.078
max2.876-2.804=0.072
policies=200
mean18129.285-18128.974=0.311
σ0.493-0.235=0.258
min18128.917-18128.820=0.097
max18129.966-18129.322=0.645
mean8400.000
σ0.000
min8400.000
max8400.000
mean2770.000-2510.000=260.000
σ0.000
min2770.000-2510.000=260.000
max2770.000-2510.000=260.000
mean28.342-28.225=0.117
σ0.227-0.093=0.134
min28.104-28.121=-0.016
max28.616-28.328=0.288