Compare commits

Home / Compare c9ccf23a .. 41334c42

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.040=-0.000
σ0.049-0.048=0.001
min30.997-30.996=0.000
max31.176-31.174=0.001
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.078-0.078=0.000
σ0.008-0.004=0.004
min0.058-0.072=-0.013
max0.086-0.084=0.003
cache=y
dps=1
iters=10
policies=100
mean21.140-21.144=-0.004
σ0.002-0.002=0.001
min21.136-21.141=-0.005
max21.144-21.146=-0.002
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.052-0.063=-0.011
σ0.002-0.004=-0.001
min0.050-0.058=-0.008
max0.057-0.071=-0.014

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.411=0.002
σ0.364-0.362=0.001
min1750.846-1750.843=0.003
max1751.995-1751.999=-0.003
mean1638.400-1640.050=-1.650
σ613.812-618.418=-4.606
min628.000-650.000=-22.000
max2468.000-2476.000=-8.000
mean2.821-2.811=0.010
σ0.130-0.114=0.015
min2.334-2.535=-0.201
max2.983-2.991=-0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.379-273.400=-0.021
σ0.010-0.009=0.000
min273.371-273.393=-0.022
max273.391-273.415=-0.024
mean2468.000-2476.000=-8.000
σ0.000
min2468.000-2476.000=-8.000
max2468.000-2476.000=-8.000
mean0.389-0.386=0.003
σ0.010-0.006=0.004
min0.378-0.379=-0.001
max0.402-0.392=0.010
iters=5
new-facts=1
prior-facts=6402
mean1933.838-1933.836=0.002
σ0.006-0.004=0.002
min1933.827-1933.829=-0.002
max1933.843-1933.840=0.003
mean2468.000-2476.000=-8.000
σ0.000
min2468.000-2476.000=-8.000
max2468.000-2476.000=-8.000
mean3.020-2.978=0.042
σ0.169-0.128=0.041
min2.773-2.767=0.005
max3.238-3.110=0.128
iters=5
new-facts=6402
prior-facts=1
mean4754.403-4754.384=0.019
σ0.726-0.798=-0.072
min4753.992-4753.989=0.003
max4755.693-4755.810=-0.117
mean2468.000-2476.000=-8.000
σ0.000
min2468.000-2476.000=-8.000
max2468.000-2476.000=-8.000
mean7.901-8.148=-0.247
σ0.238-0.497=-0.259
min7.665-7.688=-0.023
max8.253-8.831=-0.578
iters=5
new-facts=6402
prior-facts=6402
mean4944.784-4944.728=0.056
σ0.087-0.199=-0.112
min4944.704-4944.393=0.311
max4944.880-4944.882=-0.002
mean2953.600-2967.000=-13.400
σ441.755-444.856=-3.101
min2468.000-2476.000=-8.000
max3551.000-3564.000=-13.000
mean8.380-8.486=-0.106
σ0.127-0.093=0.034
min8.273-8.383=-0.110
max8.591-8.624=-0.033

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.835-1.785=0.050
σ0.186-0.091=0.095
min1.565-1.640=-0.075
max2.027-1.855=0.171

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.334-463.331=0.003
σ572.193-572.193=0.001
min177.235-177.232=0.003
max1321.624-1321.620=0.004
mean79.750
σ7.500
min76.000
max91.000
mean2468.000-2476.000=-8.000
σ0.000
min2468.000-2476.000=-8.000
max2468.000-2476.000=-8.000
mean0.567-0.531=0.035
σ0.577-0.507=0.070
min0.270-0.276=-0.006
max1.432-1.292=0.140
policies=20
mean1772.588-1772.583=0.005
σ0.329-0.336=-0.007
min1772.372-1772.356=0.016
max1773.077-1773.080=-0.004
mean760.000
σ0.000
min760.000
max760.000
mean2468.000-2476.000=-8.000
σ0.000
min2468.000-2476.000=-8.000
max2468.000-2476.000=-8.000
mean2.743-2.741=0.002
σ0.017-0.030=-0.013
min2.721-2.704=0.017
max2.763-2.777=-0.013
policies=200
mean17732.506-17732.393=0.114
σ0.448-0.480=-0.032
min17732.201-17732.063=0.138
max17733.172-17733.097=0.075
mean7600.000
σ0.000
min7600.000
max7600.000
mean2468.000-2476.000=-8.000
σ0.000
min2468.000-2476.000=-8.000
max2468.000-2476.000=-8.000
mean27.603-27.710=-0.107
σ0.098-0.181=-0.083
min27.500-27.564=-0.064
max27.729-27.968=-0.238