Compare commits

Home / Compare 41334c42 .. ef531d10

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.040=0.000
σ0.049-0.049=-0.000
min31.002-30.997=0.005
max31.176-31.176=0.001
mean419.000-411.000=8.000
σ0.000
min419.000-411.000=8.000
max419.000-411.000=8.000
mean0.077-0.078=-0.001
σ0.004-0.008=-0.003
min0.071-0.058=0.013
max0.084-0.086=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.143-21.140=0.003
σ0.003-0.002=0.000
min21.139-21.136=0.003
max21.148-21.144=0.004
mean419.000-411.000=8.000
σ0.000
min419.000-411.000=8.000
max419.000-411.000=8.000
mean0.064-0.052=0.012
σ0.001-0.002=-0.002
min0.063-0.050=0.013
max0.065-0.057=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.410-1751.412=-0.002
σ0.362-0.364=-0.002
min1750.844-1750.846=-0.002
max1751.995-1751.995=-0.000
mean1657.700-1638.400=19.300
σ646.869-613.812=33.057
min654.000-628.000=26.000
max2854.000-2468.000=386.000
mean2.813-2.821=-0.007
σ0.156-0.130=0.027
min2.468-2.334=0.134
max3.158-2.983=0.174

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.397-273.379=0.018
σ0.006-0.010=-0.004
min273.388-273.371=0.016
max273.403-273.391=0.012
mean2854.000-2468.000=386.000
σ0.000
min2854.000-2468.000=386.000
max2854.000-2468.000=386.000
mean0.381-0.389=-0.007
σ0.007-0.010=-0.003
min0.377-0.378=-0.001
max0.393-0.402=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1933.838-1933.838=-0.001
σ0.010-0.006=0.004
min1933.831-1933.827=0.004
max1933.855-1933.843=0.012
mean2854.000-2468.000=386.000
σ0.000
min2854.000-2468.000=386.000
max2854.000-2468.000=386.000
mean2.997-3.020=-0.023
σ0.040-0.169=-0.129
min2.948-2.773=0.176
max3.036-3.238=-0.202
iters=5
new-facts=6402
prior-facts=1
mean4754.267-4754.403=-0.136
σ0.989-0.726=0.263
min4753.338-4753.992=-0.654
max4755.941-4755.693=0.248
mean2854.000-2468.000=386.000
σ0.000
min2854.000-2468.000=386.000
max2854.000-2468.000=386.000
mean8.326-7.901=0.425
σ0.594-0.238=0.356
min7.822-7.665=0.157
max9.217-8.253=0.963
iters=5
new-facts=6402
prior-facts=6402
mean4944.505-4944.784=-0.279
σ0.348-0.087=0.261
min4943.988-4944.704=-0.716
max4944.879-4944.880=-0.001
mean3084.000-2953.600=130.400
σ304.428-441.755=-137.327
min2854.000-2468.000=386.000
max3556.000-3551.000=5.000
mean8.417-8.380=0.037
σ0.087-0.127=-0.040
min8.316-8.273=0.044
max8.547-8.591=-0.043

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.023-1.835=-0.812
σ0.135-0.186=-0.051
min0.933-1.565=-0.632
max1.243-2.027=-0.784

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.342-463.334=0.008
σ572.196-572.193=0.003
min177.235-177.235=-0.000
max1321.636-1321.624=0.012
mean79.750
σ7.500
min76.000
max91.000
mean2854.000-2468.000=386.000
σ0.000
min2854.000-2468.000=386.000
max2854.000-2468.000=386.000
mean0.437-0.567=-0.130
σ0.301-0.577=-0.276
min0.283-0.270=0.013
max0.889-1.432=-0.543
policies=20
mean1772.630-1772.588=0.042
σ0.326-0.329=-0.003
min1772.400-1772.372=0.029
max1773.109-1773.077=0.032
mean760.000
σ0.000
min760.000
max760.000
mean2854.000-2468.000=386.000
σ0.000
min2854.000-2468.000=386.000
max2854.000-2468.000=386.000
mean2.827-2.743=0.084
σ0.009-0.017=-0.008
min2.813-2.721=0.093
max2.835-2.763=0.071
policies=200
mean17732.547-17732.506=0.041
σ0.487-0.448=0.039
min17732.167-17732.201=-0.033
max17733.260-17733.172=0.088
mean7600.000
σ0.000
min7600.000
max7600.000
mean2854.000-2468.000=386.000
σ0.000
min2854.000-2468.000=386.000
max2854.000-2468.000=386.000
mean28.185-27.603=0.582
σ0.548-0.098=0.450
min27.626-27.500=0.126
max28.786-27.729=1.057