Compare commits

Home / Compare e0a4add1 .. 13258337

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.700-70.703=-0.003
σ0.047-0.046=0.001
min70.673-70.675=-0.002
max70.832-70.831=0.000
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.152-0.161=-0.010
σ0.011-0.003=0.007
min0.126-0.158=-0.033
max0.165-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.407-21.408=-0.001
σ0.001-0.003=-0.001
min21.405-21.403=0.002
max21.409-21.411=-0.002
mean415.800-414.000=1.800
σ0.422-0.000=0.422
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.053-0.064=-0.010
σ0.004-0.003=0.000
min0.050-0.058=-0.008
max0.061-0.068=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.932-1754.928=0.003
σ0.363-0.360=0.003
min1754.367-1754.364=0.004
max1755.529-1755.511=0.018
mean1667.500-1663.050=4.450
σ620.926-617.230=3.696
min625.000-624.000=1.000
max2504.000-2487.000=17.000
mean2.795-2.808=-0.014
σ0.186-0.120=0.066
min2.178-2.551=-0.373
max3.034-3.039=-0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.756-272.756=0.000
σ0.008-0.006=0.002
min272.744-272.749=-0.005
max272.766-272.765=0.001
mean2504.000-2487.000=17.000
σ0.000
min2504.000-2487.000=17.000
max2504.000-2487.000=17.000
mean0.383-0.382=0.001
σ0.010-0.008=0.002
min0.371-0.377=-0.006
max0.397-0.397=0.000
iters=5
new-facts=1
prior-facts=6402
mean1933.158-1933.168=-0.011
σ0.017-0.021=-0.004
min1933.130-1933.140=-0.011
max1933.177-1933.194=-0.017
mean2504.000-2487.000=17.000
σ0.000
min2504.000-2487.000=17.000
max2504.000-2487.000=17.000
mean3.070-3.009=0.061
σ0.214-0.135=0.079
min2.771-2.778=-0.007
max3.373-3.129=0.244
iters=5
new-facts=6402
prior-facts=1
mean4756.813-4756.907=-0.093
σ7.653-7.595=0.058
min4753.000-4753.473=-0.473
max4770.497-4770.493=0.005
mean2504.000-2487.000=17.000
σ0.000
min2504.000-2487.000=17.000
max2504.000-2487.000=17.000
mean8.513-8.604=-0.091
σ0.427-0.369=0.058
min7.843-8.040=-0.196
max9.034-8.974=0.060
iters=5
new-facts=6402
prior-facts=6402
mean4944.398-4944.386=0.011
σ0.025-0.028=-0.003
min4944.363-4944.345=0.018
max4944.423-4944.414=0.009
mean2961.400-2933.200=28.200
σ402.498-381.955=20.542
min2504.000-2487.000=17.000
max3479.000-3442.000=37.000
mean8.495-8.477=0.018
σ0.086-0.151=-0.064
min8.408-8.380=0.028
max8.616-8.743=-0.127

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.620-1.621=-0.001
σ0.274-0.226=0.048
min1.223-1.221=0.002
max1.842-1.767=0.075

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.319-468.313=0.006
σ574.258-574.256=0.002
min181.187-181.184=0.003
max1329.706-1329.697=0.009
mean88.250
σ8.500
min84.000
max101.000
mean2504.000-2487.000=17.000
σ0.000
min2504.000-2487.000=17.000
max2504.000-2487.000=17.000
mean0.560-0.566=-0.006
σ0.548-0.561=-0.014
min0.285-0.284=0.001
max1.382-1.408=-0.027
policies=20
mean1812.181-1812.134=0.048
σ0.386-0.386=0.001
min1811.932-1811.888=0.044
max1812.753-1812.704=0.049
mean840.000
σ0.000
min840.000
max840.000
mean2504.000-2487.000=17.000
σ0.000
min2504.000-2487.000=17.000
max2504.000-2487.000=17.000
mean2.825-2.825=0.000
σ0.010-0.032=-0.022
min2.812-2.779=0.033
max2.836-2.850=-0.014
policies=200
mean18128.905-18128.903=0.002
σ0.629-0.502=0.127
min18128.495-18128.617=-0.122
max18129.842-18129.655=0.188
mean8400.000
σ0.000
min8400.000
max8400.000
mean2504.000-2487.000=17.000
σ0.000
min2504.000-2487.000=17.000
max2504.000-2487.000=17.000
mean28.423-28.389=0.034
σ0.009-0.064=-0.055
min28.415-28.295=0.120
max28.435-28.436=-0.001