Compare commits

Home / Compare f9a539e2 .. cd9aa50e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.707-70.707=-0.000
σ0.045-0.045=0.000
min70.681-70.679=0.002
max70.833-70.832=0.002
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.160-0.161=-0.001
σ0.004-0.004=-0.000
min0.153-0.157=-0.004
max0.165-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.412-21.411=0.001
σ0.003-0.002=0.000
min21.408-21.408=0.000
max21.416-21.414=0.001
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.063-0.066=-0.003
σ0.005-0.003=0.002
min0.058-0.063=-0.005
max0.073-0.073=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.928-1754.931=-0.003
σ0.361-0.360=0.002
min1754.365-1754.366=-0.001
max1755.514-1755.511=0.003
mean1667.400-1664.400=3.000
σ625.881-626.553=-0.672
min626.000-621.000=5.000
max2525.000-2523.000=2.000
mean2.860-2.847=0.014
σ0.131-0.085=0.047
min2.609-2.669=-0.061
max3.181-3.046=0.135

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.792-272.791=0.000
σ0.007-0.005=0.002
min272.783-272.784=-0.001
max272.801-272.799=0.002
mean2525.000-2523.000=2.000
σ0.000
min2525.000-2523.000=2.000
max2525.000-2523.000=2.000
mean0.381-0.379=0.002
σ0.009-0.002=0.006
min0.376-0.377=-0.001
max0.396-0.383=0.014
iters=5
new-facts=1
prior-facts=6402
mean1933.214-1933.217=-0.004
σ0.012-0.016=-0.003
min1933.204-1933.192=0.012
max1933.234-1933.231=0.004
mean2525.000-2523.000=2.000
σ0.000
min2525.000-2523.000=2.000
max2525.000-2523.000=2.000
mean3.043-3.082=-0.040
σ0.052-0.088=-0.036
min2.957-3.005=-0.048
max3.088-3.197=-0.109
iters=5
new-facts=6402
prior-facts=1
mean4756.935-4756.864=0.071
σ7.599-7.269=0.330
min4753.456-4753.573=-0.117
max4770.529-4769.867=0.662
mean2525.000-2523.000=2.000
σ0.000
min2525.000-2523.000=2.000
max2525.000-2523.000=2.000
mean8.672-8.328=0.344
σ0.401-0.317=0.084
min8.036-7.817=0.219
max9.079-8.591=0.489
iters=5
new-facts=6402
prior-facts=6402
mean4944.165-4944.451=-0.286
σ0.386-0.025=0.360
min4943.720-4944.424=-0.705
max4944.474-4944.482=-0.008
mean2926.200-2981.000=-54.800
σ363.567-388.844=-25.278
min2525.000-2523.000=2.000
max3433.000-3515.000=-82.000
mean8.421-8.476=-0.055
σ0.062-0.161=-0.099
min8.350-8.346=0.004
max8.499-8.707=-0.208

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.645-1.551=0.094
σ0.218-0.256=-0.038
min1.290-1.227=0.063
max1.871-1.788=0.083

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.301-468.305=-0.004
σ574.229-574.230=-0.000
min181.182-181.184=-0.002
max1329.645-1329.650=-0.005
mean88.250
σ8.500
min84.000
max101.000
mean2525.000-2523.000=2.000
σ0.000
min2525.000-2523.000=2.000
max2525.000-2523.000=2.000
mean0.561-0.568=-0.008
σ0.553-0.571=-0.017
min0.283-0.280=0.004
max1.390-1.424=-0.034
policies=20
mean1812.136-1812.151=-0.015
σ0.387-0.382=0.006
min1811.893-1811.901=-0.008
max1812.712-1812.717=-0.005
mean840.000
σ0.000
min840.000
max840.000
mean2525.000-2523.000=2.000
σ0.000
min2525.000-2523.000=2.000
max2525.000-2523.000=2.000
mean2.812-2.807=0.004
σ0.011-0.012=-0.000
min2.797-2.796=0.001
max2.823-2.821=0.002
policies=200
mean18128.947-18128.999=-0.052
σ0.610-0.423=0.188
min18128.503-18128.682=-0.179
max18129.829-18129.620=0.209
mean8400.000
σ0.000
min8400.000
max8400.000
mean2525.000-2523.000=2.000
σ0.000
min2525.000-2523.000=2.000
max2525.000-2523.000=2.000
mean28.316-28.259=0.056
σ0.105-0.034=0.070
min28.174-28.208=-0.034
max28.406-28.281=0.125