Compare commits

Home / Compare 2f083f98 .. 6d77ee9b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.700-70.781=-0.081
σ0.047-0.045=0.002
min70.673-70.749=-0.076
max70.832-70.908=-0.076
mean415.000
σ0.000
min415.000
max415.000
mean0.152-0.159=-0.007
σ0.011-0.005=0.006
min0.126-0.151=-0.026
max0.165-0.169=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.407-21.492=-0.085
σ0.001-0.002=-0.001
min21.405-21.489=-0.084
max21.409-21.495=-0.086
mean415.800-415.000=0.800
σ0.422-0.000=0.422
min415.000
max416.000-415.000=1.000
mean0.053-0.064=-0.011
σ0.004-0.004=0.000
min0.050-0.059=-0.008
max0.061-0.072=-0.011

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.932-1754.093=0.839
σ0.363-0.360=0.003
min1754.367-1753.531=0.836
max1755.529-1754.672=0.857
mean1667.500-1643.950=23.550
σ620.926-634.514=-13.588
min625.000-640.000=-15.000
max2504.000-2845.000=-341.000
mean2.795-2.792=0.003
σ0.186-0.150=0.036
min2.178-2.388=-0.210
max3.034-2.976=0.058

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.756-271.953=0.803
σ0.008-0.007=0.001
min272.744-271.941=0.802
max272.766-271.959=0.807
mean2504.000-2845.000=-341.000
σ0.000
min2504.000-2845.000=-341.000
max2504.000-2845.000=-341.000
mean0.383-0.380=0.003
σ0.010-0.003=0.007
min0.371-0.377=-0.006
max0.397-0.383=0.014
iters=5
new-facts=1
prior-facts=6402
mean1933.158-1932.325=0.833
σ0.017-0.002=0.015
min1933.130-1932.323=0.807
max1933.177-1932.328=0.848
mean2504.000-2845.000=-341.000
σ0.000
min2504.000-2845.000=-341.000
max2504.000-2845.000=-341.000
mean3.070-3.122=-0.052
σ0.214-0.119=0.095
min2.771-3.033=-0.262
max3.373-3.279=0.093
iters=5
new-facts=6402
prior-facts=1
mean4756.813-4752.944=3.869
σ7.653-0.976=6.677
min4753.000-4752.235=0.765
max4770.497-4754.665=15.832
mean2504.000-2845.000=-341.000
σ0.000
min2504.000-2845.000=-341.000
max2504.000-2845.000=-341.000
mean8.513-8.699=-0.187
σ0.427-0.500=-0.073
min7.843-7.963=-0.120
max9.034-9.322=-0.288
iters=5
new-facts=6402
prior-facts=6402
mean4944.398-4943.486=0.911
σ0.025-0.151=-0.126
min4944.363-4943.217=1.146
max4944.423-4943.572=0.851
mean2961.400-3054.000=-92.600
σ402.498-194.282=208.216
min2504.000-2845.000=-341.000
max3479.000-3328.000=151.000
mean8.495-8.616=-0.121
σ0.086-0.250=-0.164
min8.408-8.446=-0.039
max8.616-9.041=-0.426

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.620-0.987=0.633
σ0.274-0.139=0.135
min1.223-0.923=0.300
max1.842-1.235=0.607

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.319-468.636=-0.317
σ574.258-574.923=-0.666
min181.187-181.162=0.025
max1329.706-1331.021=-1.315
mean88.250
σ8.500
min84.000
max101.000
mean2504.000-2845.000=-341.000
σ0.000
min2504.000-2845.000=-341.000
max2504.000-2845.000=-341.000
mean0.560-0.443=0.117
σ0.548-0.297=0.251
min0.285-0.292=-0.008
max1.382-0.889=0.493
policies=20
mean1812.181-1811.973=0.208
σ0.386-0.388=-0.002
min1811.932-1811.698=0.234
max1812.753-1812.540=0.213
mean840.000
σ0.000
min840.000
max840.000
mean2504.000-2845.000=-341.000
σ0.000
min2504.000-2845.000=-341.000
max2504.000-2845.000=-341.000
mean2.825-2.917=-0.092
σ0.010-0.013=-0.003
min2.812-2.902=-0.090
max2.836-2.932=-0.096
policies=200
mean18128.905-18126.693=2.212
σ0.629-0.390=0.239
min18128.495-18126.315=2.179
max18129.842-18127.234=2.609
mean8400.000
σ0.000
min8400.000
max8400.000
mean2504.000-2845.000=-341.000
σ0.000
min2504.000-2845.000=-341.000
max2504.000-2845.000=-341.000
mean28.423-29.006=-0.583
σ0.009-0.506=-0.496
min28.415-28.566=-0.151
max28.435-29.454=-1.019