Compare commits

Home / Compare def1cc34 .. 3b692394

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.978=0.000
σ0.047-0.050=-0.003
min33.950-33.951=-0.001
max34.107-34.115=-0.007
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.084-0.083=0.002
σ0.003-0.005=-0.002
min0.082-0.077=0.005
max0.090-0.091=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.318-23.318=-0.000
σ0.003-0.003=-0.000
min23.311-23.312=-0.001
max23.323-23.324=-0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.066-0.065=0.000
σ0.002-0.003=-0.001
min0.064-0.064=0.000
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1757.303=-0.000
σ0.365-0.365=0.000
min1756.728-1756.731=-0.002
max1757.889-1757.887=0.002
mean1659.150-1648.750=10.400
σ620.151-624.928=-4.776
min670.000-637.000=33.000
max2586.000-2825.000=-239.000
mean2.344-2.368=-0.024
σ0.103-0.106=-0.003
min2.187-2.267=-0.079
max2.700-2.641=0.059

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.444-326.453=-0.010
σ0.057-0.034=0.024
min326.342-326.395=-0.053
max326.478-326.477=0.001
mean2586.000-2825.000=-239.000
σ0.000
min2586.000-2825.000=-239.000
max2586.000-2825.000=-239.000
mean0.427-0.425=0.003
σ0.011-0.001=0.010
min0.421-0.423=-0.003
max0.447-0.426=0.021
iters=5
new-facts=1
prior-facts=6402
mean1988.614-1988.606=0.008
σ0.010-0.021=-0.011
min1988.599-1988.583=0.016
max1988.623-1988.629=-0.006
mean2586.000-2825.000=-239.000
σ0.000
min2586.000-2825.000=-239.000
max2586.000-2825.000=-239.000
mean2.700-2.763=-0.063
σ0.104-0.287=-0.184
min2.626-2.526=0.100
max2.879-3.258=-0.379
iters=5
new-facts=6402
prior-facts=1
mean4813.501-4813.471=0.030
σ7.734-7.736=-0.002
min4809.901-4809.903=-0.002
max4827.334-4827.309=0.025
mean2586.000-2825.000=-239.000
σ0.000
min2586.000-2825.000=-239.000
max2586.000-2825.000=-239.000
mean8.581-8.527=0.054
σ0.633-0.518=0.114
min7.756-8.005=-0.248
max9.451-9.273=0.178
iters=5
new-facts=6402
prior-facts=6402
mean5000.877-5000.878=-0.002
σ0.198-0.170=0.028
min5000.650-5000.666=-0.015
max5001.042-5001.018=0.024
mean2973.800-3039.800=-66.000
σ280.725-208.975=71.750
min2588.000-2825.000=-237.000
max3311.000-3301.000=10.000
mean9.626-9.888=-0.262
σ0.570-0.183=0.387
min8.634-9.689=-1.054
max10.097-10.171=-0.074

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.189-0.945=0.245
σ0.369-0.064=0.305
min0.907-0.902=0.005
max1.643-1.055=0.589

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.437-464.439=-0.001
σ574.784-574.773=0.011
min177.038-177.044=-0.005
max1326.613-1326.598=0.015
mean88.250
σ8.500
min84.000
max101.000
mean2586.000-2825.000=-239.000
σ0.000
min2586.000-2825.000=-239.000
max2586.000-2825.000=-239.000
mean0.537-0.439=0.097
σ0.525-0.307=0.219
min0.272-0.280=-0.008
max1.324-0.899=0.425
policies=20
mean1770.759-1770.812=-0.053
σ0.340-0.368=-0.029
min1770.531-1770.546=-0.014
max1771.264-1771.353=-0.089
mean840.000
σ0.000
min840.000
max840.000
mean2586.000-2825.000=-239.000
σ0.000
min2586.000-2825.000=-239.000
max2586.000-2825.000=-239.000
mean2.737-2.837=-0.100
σ0.016-0.051=-0.035
min2.717-2.797=-0.080
max2.753-2.911=-0.158
policies=200
mean17714.785-17714.926=-0.141
σ0.614-0.452=0.162
min17714.377-17714.386=-0.009
max17715.696-17715.452=0.244
mean8400.000
σ0.000
min8400.000
max8400.000
mean2586.000-2825.000=-239.000
σ0.000
min2586.000-2825.000=-239.000
max2586.000-2825.000=-239.000
mean27.458-28.004=-0.545
σ0.055-0.546=-0.491
min27.408-27.468=-0.059
max27.534-28.658=-1.125