Compare commits

Home / Compare 05af0fd7 .. 0a48e6bf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.987-33.986=0.001
σ0.055-0.055=-0.000
min33.960-33.959=0.001
max34.142-34.142=0.000
mean413.000-417.900=-4.900
σ0.000-0.316=-0.316
min413.000-417.000=-4.000
max413.000-418.000=-5.000
mean0.084-0.083=0.001
σ0.005-0.005=-0.000
min0.077-0.078=-0.001
max0.090-0.091=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.324-23.324=0.000
σ0.003-0.003=0.001
min23.320-23.319=0.001
max23.331-23.327=0.003
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.066-0.066=0.000
σ0.003-0.003=-0.000
min0.064-0.064=0.000
max0.074-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.725-1756.727=-0.001
σ0.363-0.365=-0.002
min1756.151-1756.151=-0.000
max1757.312-1757.310=0.002
mean1646.150-1648.350=-2.200
σ625.770-623.593=2.177
min645.000
max2835.000-2838.000=-3.000
mean2.374-2.373=0.001
σ0.125-0.100=0.025
min2.272-2.280=-0.009
max2.839-2.653=0.185

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean325.315-325.320=-0.005
σ0.055-0.047=0.008
min325.216-325.235=-0.019
max325.343-325.346=-0.003
mean2835.000-2838.000=-3.000
σ0.000
min2835.000-2838.000=-3.000
max2835.000-2838.000=-3.000
mean0.431-0.425=0.006
σ0.004-0.001=0.003
min0.428-0.423=0.004
max0.438-0.427=0.011
iters=5
new-facts=1
prior-facts=6402
mean1985.877-1985.869=0.008
σ0.011-0.019=-0.008
min1985.867-1985.841=0.026
max1985.894-1985.891=0.003
mean2835.000-2838.000=-3.000
σ0.000
min2835.000-2838.000=-3.000
max2835.000-2838.000=-3.000
mean2.777-2.755=0.022
σ0.126-0.127=-0.001
min2.637-2.667=-0.030
max2.964-2.961=0.004
iters=5
new-facts=6402
prior-facts=1
mean4809.646-4809.652=-0.006
σ7.738-7.688=0.050
min4806.164-4806.121=0.043
max4823.488-4823.403=0.085
mean2835.000-2838.000=-3.000
σ0.000
min2835.000-2838.000=-3.000
max2835.000-2838.000=-3.000
mean8.953-8.544=0.410
σ0.339-0.492=-0.153
min8.399-7.979=0.421
max9.259-8.921=0.338
iters=5
new-facts=6402
prior-facts=6402
mean4997.117-4997.107=0.010
σ0.170-0.169=0.001
min4996.814-4996.808=0.006
max4997.218-4997.211=0.007
mean3086.200-3073.600=12.600
σ265.547-311.286=-45.739
min2835.000-2838.000=-3.000
max3363.000-3556.000=-193.000
mean8.997-8.579=0.418
σ0.411-0.130=0.280
min8.606-8.489=0.117
max9.664-8.808=0.856

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.002-0.946=0.056
σ0.133-0.064=0.069
min0.914-0.897=0.016
max1.221-1.057=0.164

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.373-463.381=-0.008
σ574.772-574.770=0.001
min175.982-175.985=-0.003
max1325.530-1325.536=-0.006
mean86.250
σ8.500
min82.000
max99.000
mean2835.000-2838.000=-3.000
σ0.000
min2835.000-2838.000=-3.000
max2835.000-2838.000=-3.000
mean0.473-0.470=0.003
σ0.377-0.372=0.006
min0.281-0.281=-0.000
max1.039-1.028=0.011
policies=20
mean1760.155-1760.150=0.005
σ0.351-0.346=0.005
min1759.916-1759.918=-0.001
max1760.674-1760.663=0.011
mean820.000
σ0.000
min820.000
max820.000
mean2835.000-2838.000=-3.000
σ0.000
min2835.000-2838.000=-3.000
max2835.000-2838.000=-3.000
mean2.794-2.785=0.009
σ0.012-0.010=0.001
min2.782-2.775=0.007
max2.810-2.796=0.014
policies=200
mean17608.452-17608.517=-0.065
σ0.444-0.436=0.008
min17608.102-17608.242=-0.140
max17609.102-17609.167=-0.065
mean8200.000
σ0.000
min8200.000
max8200.000
mean2835.000-2838.000=-3.000
σ0.000
min2835.000-2838.000=-3.000
max2835.000-2838.000=-3.000
mean28.002-28.012=-0.009
σ0.390-0.402=-0.011
min27.658-27.685=-0.027
max28.401-28.523=-0.121