Compare commits

Home / Compare b0de4fb3 .. f0bbdae7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.702=0.000
σ0.045-0.048=-0.003
min70.668-70.672=-0.004
max70.827-70.834=-0.007
mean412.000-411.600=0.400
σ0.000-0.516=-0.516
min412.000-411.000=1.000
max412.000
mean0.165-0.161=0.004
σ0.012-0.003=0.009
min0.148-0.156=-0.008
max0.183-0.165=0.018
cache=y
dps=1
iters=10
policies=100
mean21.409-21.409=0.000
σ0.003-0.003=-0.000
min21.405-21.404=0.002
max21.414-21.414=0.000
mean412.000
σ0.000
min412.000
max412.000
mean0.066-0.065=0.000
σ0.003-0.003=0.001
min0.064-0.064=0.000
max0.074-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.930=0.001
σ0.360-0.361=-0.001
min1754.362-1754.352=0.010
max1755.516-1755.516=-0.000
mean1661.450-1649.550=11.900
σ620.264-626.896=-6.632
min622.000-621.000=1.000
max2502.000-2770.000=-268.000
mean2.826-2.830=-0.003
σ0.117-0.184=-0.067
min2.433-2.235=0.198
max2.957-3.083=-0.126

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.754-272.756=-0.001
σ0.006-0.006=-0.001
min272.746-272.747=-0.001
max272.762-272.763=-0.001
mean2502.000-2770.000=-268.000
σ0.000
min2502.000-2770.000=-268.000
max2502.000-2770.000=-268.000
mean0.384-0.381=0.004
σ0.010-0.001=0.009
min0.377-0.380=-0.003
max0.401-0.382=0.018
iters=5
new-facts=1
prior-facts=6402
mean1933.156-1933.165=-0.009
σ0.015-0.012=0.003
min1933.133-1933.145=-0.012
max1933.173-1933.175=-0.002
mean2502.000-2770.000=-268.000
σ0.000
min2502.000-2770.000=-268.000
max2502.000-2770.000=-268.000
mean3.074-2.892=0.182
σ0.111-0.248=-0.137
min2.964-2.480=0.484
max3.235-3.095=0.139
iters=5
new-facts=6402
prior-facts=1
mean4756.933-4756.900=0.033
σ7.585-7.607=-0.023
min4753.494-4753.419=0.075
max4770.502-4770.508=-0.007
mean2502.000-2770.000=-268.000
σ0.000
min2502.000-2770.000=-268.000
max2502.000-2770.000=-268.000
mean8.464-8.697=-0.233
σ0.418-0.292=0.127
min7.744-8.329=-0.585
max8.826-9.078=-0.252
iters=5
new-facts=6402
prior-facts=6402
mean4944.392-4944.325=0.067
σ0.016-0.168=-0.152
min4944.367-4944.025=0.342
max4944.406-4944.418=-0.011
mean2922.800-3019.000=-96.200
σ376.475-307.909=68.566
min2502.000-2770.000=-268.000
max3443.000-3490.000=-47.000
mean8.370-8.446=-0.076
σ0.031-0.157=-0.126
min8.343-8.346=-0.004
max8.422-8.719=-0.297

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.526-1.023=0.503
σ0.179-0.181=-0.002
min1.323-0.912=0.411
max1.785-1.331=0.455

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.323-468.339=-0.016
σ574.260-574.259=0.002
min181.187-181.206=-0.019
max1329.713-1329.727=-0.013
mean88.250
σ8.500
min84.000
max101.000
mean2502.000-2770.000=-268.000
σ0.000
min2502.000-2770.000=-268.000
max2502.000-2770.000=-268.000
mean0.565-0.470=0.095
σ0.563-0.373=0.190
min0.280-0.277=0.003
max1.410-1.030=0.380
policies=20
mean1812.168-1812.380=-0.211
σ0.384-0.394=-0.010
min1811.903-1812.109=-0.206
max1812.735-1812.960=-0.224
mean840.000
σ0.000
min840.000
max840.000
mean2502.000-2770.000=-268.000
σ0.000
min2502.000-2770.000=-268.000
max2502.000-2770.000=-268.000
mean2.819-2.887=-0.069
σ0.006-0.009=-0.003
min2.813-2.877=-0.064
max2.826-2.898=-0.071
policies=200
mean18128.900-18129.147=-0.247
σ0.625-0.461=0.163
min18128.505-18128.760=-0.256
max18129.818-18129.800=0.018
mean8400.000
σ0.000
min8400.000
max8400.000
mean2502.000-2770.000=-268.000
σ0.000
min2502.000-2770.000=-268.000
max2502.000-2770.000=-268.000
mean28.419-28.509=-0.089
σ0.113-0.208=-0.095
min28.258-28.268=-0.010
max28.519-28.744=-0.225