Compare commits

Home / Compare 4dfec2f0 .. 4276bee9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.798=0.001
σ0.107-0.109=-0.002
min35.751-35.751=0.000
max36.103-36.106=-0.004
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.077-0.076=0.001
σ0.003-0.003=0.000
min0.074-0.073=0.001
max0.083-0.082=0.000
cache=y
dps=1
iters=10
policies=100
mean26.064-26.064=-0.000
σ0.002-0.005=-0.002
min26.061-26.058=0.003
max26.068-26.073=-0.005
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.060-0.060=-0.000
σ0.003-0.004=-0.001
min0.057-0.056=0.000
max0.066-0.069=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.925-1755.923=0.002
σ0.366-0.365=0.001
min1755.353-1755.345=0.007
max1756.517-1756.510=0.008
mean1657.700-1661.900=-4.200
σ626.147-626.013=0.134
min671.000-667.000=4.000
max2661.000-2599.000=62.000
mean2.771-2.811=-0.040
σ0.188-0.103=0.085
min2.402-2.537=-0.136
max3.030-2.953=0.077

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.197-277.196=0.001
σ0.002-0.005=-0.003
min277.195-277.191=0.004
max277.201-277.203=-0.002
mean2661.000-2599.000=62.000
σ0.000
min2661.000-2599.000=62.000
max2661.000-2599.000=62.000
mean0.409-0.404=0.006
σ0.009-0.007=0.001
min0.405-0.396=0.009
max0.425-0.414=0.011
iters=5
new-facts=1
prior-facts=6402
mean2174.407-2174.436=-0.030
σ0.041-0.006=0.034
min2174.341-2174.427=-0.086
max2174.442-2174.442=0.001
mean2661.000-2599.000=62.000
σ0.000
min2661.000-2599.000=62.000
max2661.000-2599.000=62.000
mean2.896-2.988=-0.092
σ0.192-0.218=-0.027
min2.750-2.758=-0.007
max3.110-3.283=-0.173
iters=5
new-facts=6402
prior-facts=1
mean5052.596-5052.639=-0.043
σ0.904-0.960=-0.055
min5052.069-5052.098=-0.029
max5054.199-5054.345=-0.147
mean2661.000-2599.000=62.000
σ0.000
min2661.000-2599.000=62.000
max2661.000-2599.000=62.000
mean8.813-8.552=0.261
σ0.480-0.580=-0.100
min8.151-7.916=0.235
max9.393-9.411=-0.018
iters=5
new-facts=6402
prior-facts=6402
mean5188.421-5188.426=-0.005
σ0.088-0.085=0.003
min5188.351-5188.359=-0.008
max5188.523-5188.522=0.001
mean3218.800-3276.000=-57.200
σ481.181-432.241=48.940
min2661.000-2674.000=-13.000
max3872.000-3674.000=198.000
mean8.765-8.850=-0.085
σ0.175-0.239=-0.064
min8.633-8.581=0.052
max9.049-9.237=-0.188

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.288-1.425=-0.137
σ0.291-0.397=-0.106
min1.086-0.945=0.141
max1.789-1.837=-0.048

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.857-464.850=0.006
σ572.654-572.649=0.005
min178.527-178.523=0.004
max1323.838-1323.824=0.013
mean79.500
σ7.000
min76.000
max90.000
mean2661.000-2599.000=62.000
σ0.000
min2661.000-2599.000=62.000
max2661.000-2599.000=62.000
mean0.560-0.553=0.007
σ0.536-0.529=0.008
min0.286-0.284=0.002
max1.364-1.346=0.019
policies=20
mean1785.473-1785.478=-0.005
σ0.326-0.347=-0.020
min1785.248-1785.262=-0.014
max1785.956-1785.995=-0.039
mean760.000
σ0.000
min760.000
max760.000
mean2661.000-2599.000=62.000
σ0.000
min2661.000-2599.000=62.000
max2661.000-2599.000=62.000
mean2.790-2.768=0.021
σ0.007-0.022=-0.014
min2.780-2.749=0.031
max2.798-2.799=-0.000
policies=200
mean17861.425-17861.550=-0.125
σ0.597-0.453=0.144
min17861.034-17861.280=-0.246
max17862.306-17862.228=0.079
mean7600.000
σ0.000
min7600.000
max7600.000
mean2661.000-2599.000=62.000
σ0.000
min2661.000-2599.000=62.000
max2661.000-2599.000=62.000
mean28.213-28.030=0.183
σ0.176-0.104=0.072
min28.055-27.909=0.146
max28.394-28.155=0.239