Compare commits

Home / Compare 8918d657 .. d7d25f2a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.781=0.001
σ0.047-0.047=0.001
min70.755-70.749=0.006
max70.914-70.910=0.004
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.162-0.159=0.003
σ0.004-0.005=-0.001
min0.158-0.153=0.006
max0.168-0.169=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.494-21.493=0.001
σ0.003-0.002=0.000
min21.489-21.490=-0.001
max21.498-21.498=-0.000
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.066-0.067=-0.001
σ0.004-0.004=0.000
min0.061-0.064=-0.003
max0.072-0.075=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.094=-0.001
σ0.361-0.361=0.001
min1753.522-1753.529=-0.007
max1754.677-1754.679=-0.002
mean1662.150-1658.600=3.550
σ635.647-629.790=5.857
min628.000
max2778.000-2771.000=7.000
mean2.804-2.767=0.037
σ0.199-0.223=-0.023
min2.162-2.149=0.013
max3.078-3.025=0.054

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.955-271.601=0.354
σ0.005-0.007=-0.002
min271.950-271.591=0.358
max271.964-271.609=0.355
mean2778.000-2771.000=7.000
σ0.000
min2778.000-2771.000=7.000
max2778.000-2771.000=7.000
mean0.381-0.384=-0.002
σ0.008-0.007=0.001
min0.377-0.379=-0.002
max0.396-0.397=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.322-1932.003=0.319
σ0.019-0.011=0.008
min1932.301-1931.990=0.311
max1932.344-1932.013=0.332
mean2778.000-2771.000=7.000
σ0.000
min2778.000-2771.000=7.000
max2778.000-2771.000=7.000
mean2.992-2.579=0.413
σ0.057-0.129=-0.072
min2.898-2.475=0.422
max3.055-2.736=0.318
iters=5
new-facts=6402
prior-facts=1
mean4753.080-4752.585=0.496
σ0.899-1.018=-0.119
min4752.607-4751.733=0.874
max4754.678-4754.354=0.325
mean2778.000-2771.000=7.000
σ0.000
min2778.000-2771.000=7.000
max2778.000-2771.000=7.000
mean8.575-8.742=-0.168
σ0.446-0.483=-0.037
min7.987-7.997=-0.010
max8.945-9.231=-0.286
iters=5
new-facts=6402
prior-facts=6402
mean4943.563-4943.212=0.351
σ0.012-0.015=-0.003
min4943.544-4943.195=0.350
max4943.572-4943.230=0.342
mean2991.800-3040.600=-48.800
σ212.757-248.281=-35.523
min2778.000-2771.000=7.000
max3304.000-3384.000=-80.000
mean8.591-8.773=-0.182
σ0.209-0.218=-0.009
min8.394-8.472=-0.079
max8.922-9.023=-0.101

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.018-1.002=0.016
σ0.133-0.143=-0.010
min0.931-0.935=-0.004
max1.237-1.258=-0.021

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.665-468.642=0.023
σ574.924-574.932=-0.008
min181.197-181.169=0.028
max1331.051-1331.041=0.010
mean88.250
σ8.500
min84.000
max101.000
mean2778.000-2771.000=7.000
σ0.000
min2778.000-2771.000=7.000
max2778.000-2771.000=7.000
mean0.451-0.447=0.005
σ0.307-0.305=0.002
min0.295-0.291=0.004
max0.912-0.904=0.008
policies=20
mean1812.246-1811.991=0.255
σ0.387-0.389=-0.002
min1811.971-1811.700=0.271
max1812.812-1812.560=0.252
mean840.000
σ0.000
min840.000
max840.000
mean2778.000-2771.000=7.000
σ0.000
min2778.000-2771.000=7.000
max2778.000-2771.000=7.000
mean2.940-2.940=0.001
σ0.049-0.093=-0.044
min2.912-2.849=0.064
max3.013-3.067=-0.054
policies=200
mean18129.083-18126.758=2.326
σ0.650-0.543=0.107
min18128.680-18126.342=2.338
max18130.054-18127.555=2.498
mean8400.000
σ0.000
min8400.000
max8400.000
mean2778.000-2771.000=7.000
σ0.000
min2778.000-2771.000=7.000
max2778.000-2771.000=7.000
mean28.544-28.681=-0.137
σ0.066-0.033=0.034
min28.451-28.648=-0.197
max28.600-28.722=-0.123