Compare commits

Home / Compare 968ea894 .. bef0d48c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.700-70.781=-0.081
σ0.047-0.047=0.001
min70.671-70.745=-0.074
max70.831-70.910=-0.079
mean412.000-419.000=-7.000
σ0.000
min412.000-419.000=-7.000
max412.000-419.000=-7.000
mean0.159-0.157=0.002
σ0.005-0.004=0.000
min0.152-0.152=0.000
max0.167-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean21.409-21.490=-0.081
σ0.004-0.002=0.001
min21.403-21.486=-0.083
max21.414-21.493=-0.079
mean412.000-419.000=-7.000
σ0.000
min412.000-419.000=-7.000
max412.000-419.000=-7.000
mean0.063-0.053=0.010
σ0.004-0.003=0.000
min0.059-0.047=0.013
max0.072-0.059=0.013

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.897-1754.898=-0.001
σ0.362-0.360=0.002
min1754.323-1754.324=-0.001
max1755.481-1755.482=-0.001
mean1635.950-1650.900=-14.950
σ630.360-631.516=-1.157
min621.000-631.000=-10.000
max2786.000-2771.000=15.000
mean2.846-2.820=0.026
σ0.201-0.243=-0.042
min2.186-2.170=0.016
max3.152-3.205=-0.053

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.760-272.756=0.004
σ0.006-0.003=0.003
min272.753-272.752=0.001
max272.766-272.759=0.007
mean2786.000-2771.000=15.000
σ0.000
min2786.000-2771.000=15.000
max2786.000-2771.000=15.000
mean0.387-0.388=-0.001
σ0.005-0.004=0.001
min0.383-0.384=-0.001
max0.395-0.395=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1933.135-1933.130=0.005
σ0.010-0.003=0.007
min1933.123-1933.126=-0.003
max1933.146-1933.133=0.013
mean2786.000-2771.000=15.000
σ0.000
min2786.000-2771.000=15.000
max2786.000-2771.000=15.000
mean3.076-3.099=-0.022
σ0.158-0.092=0.066
min2.896-3.016=-0.120
max3.301-3.229=0.072
iters=5
new-facts=6402
prior-facts=1
mean4753.863-4753.678=0.185
σ0.932-0.773=0.159
min4753.367-4753.058=0.310
max4755.528-4755.009=0.518
mean2786.000-2771.000=15.000
σ0.000
min2786.000-2771.000=15.000
max2786.000-2771.000=15.000
mean8.675-8.517=0.158
σ0.508-0.764=-0.256
min7.865-7.698=0.167
max9.140-9.372=-0.232
iters=5
new-facts=6402
prior-facts=6402
mean4944.356-4944.368=-0.011
σ0.022-0.013=0.009
min4944.322-4944.355=-0.033
max4944.380-4944.384=-0.004
mean3004.400-3017.800=-13.400
σ278.751-307.043=-28.291
min2786.000-2771.000=15.000
max3424.000-3479.000=-55.000
mean8.301-8.662=-0.360
σ0.073-0.198=-0.125
min8.187-8.454=-0.268
max8.388-8.855=-0.467

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.042-1.043=-0.000
σ0.129-0.125=0.004
min0.928-0.928=-0.000
max1.245-1.235=0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.656-468.657=-0.001
σ574.921-574.929=-0.007
min181.184-181.190=-0.006
max1331.038-1331.051=-0.012
mean88.250
σ8.500
min84.000
max101.000
mean2786.000-2771.000=15.000
σ0.000
min2786.000-2771.000=15.000
max2786.000-2771.000=15.000
mean0.532-0.448=0.084
σ0.477-0.305=0.172
min0.287-0.292=-0.004
max1.247-0.906=0.342
policies=20
mean1812.191-1812.228=-0.037
σ0.386-0.400=-0.014
min1811.932-1811.960=-0.028
max1812.763-1812.813=-0.051
mean840.000
σ0.000
min840.000
max840.000
mean2786.000-2771.000=15.000
σ0.000
min2786.000-2771.000=15.000
max2786.000-2771.000=15.000
mean2.833-2.923=-0.090
σ0.021-0.092=-0.071
min2.806-2.839=-0.033
max2.854-3.044=-0.190
policies=200
mean18129.228-18128.906=0.321
σ0.468-0.641=-0.173
min18128.908-18128.488=0.419
max18129.920-18129.844=0.076
mean8400.000
σ0.000
min8400.000
max8400.000
mean2786.000-2771.000=15.000
σ0.000
min2786.000-2771.000=15.000
max2786.000-2771.000=15.000
mean28.570-28.660=-0.089
σ0.056-0.060=-0.004
min28.532-28.584=-0.052
max28.651-28.712=-0.062