Compare commits

Home / Compare ebe903d8 .. 3e5ebe3d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.997-36.720=-0.723
σ0.102-0.651=-0.549
min35.957-35.932=0.025
max36.286-37.535=-1.249
mean3828.000-4160.000=-332.000
σ0.000
min3828.000-4160.000=-332.000
max3828.000-4160.000=-332.000
mean0.076-0.075=0.001
σ0.003-0.002=0.002
min0.070-0.073=-0.003
max0.083-0.079=0.004
cache=y
dps=1
iters=10
policies=100
mean26.215-26.589=-0.374
σ0.006-0.603=-0.597
min26.206-26.206=-0.000
max26.223-27.469=-1.245
mean3828.000-4160.000=-332.000
σ0.000
min3828.000-4160.000=-332.000
max3828.000-4160.000=-332.000
mean0.061-0.060=0.001
σ0.002-0.001=0.001
min0.059-0.059=0.001
max0.066-0.061=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.372-1756.358=0.014
σ0.373-0.374=-0.001
min1755.791-1755.787=0.003
max1756.968-1756.950=0.018
mean1660.450-1658.850=1.600
σ626.577-627.154=-0.576
min615.000-685.000=-70.000
max2637.000-2607.000=30.000
mean2.296-2.252=0.044
σ0.142-0.081=0.061
min2.162-2.138=0.024
max2.742-2.440=0.303

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.701-278.675=0.025
σ0.013-0.013=0.001
min278.686-278.659=0.027
max278.721-278.688=0.033
mean2637.000-2607.000=30.000
σ0.000
min2637.000-2607.000=30.000
max2637.000-2607.000=30.000
mean0.419-0.423=-0.004
σ0.001-0.009=-0.008
min0.418-0.415=0.003
max0.421-0.437=-0.016
iters=5
new-facts=1
prior-facts=6402
mean2268.862-2268.846=0.017
σ0.018-0.010=0.008
min2268.841-2268.832=0.009
max2268.877-2268.859=0.018
mean2637.000-2607.000=30.000
σ0.000
min2637.000-2607.000=30.000
max2637.000-2607.000=30.000
mean3.147-2.985=0.162
σ0.169-0.172=-0.003
min2.894-2.825=0.070
max3.332-3.210=0.121
iters=5
new-facts=6402
prior-facts=1
mean4952.339-4952.174=0.164
σ0.825-0.863=-0.038
min4951.853-4951.704=0.149
max4953.809-4953.714=0.095
mean2637.000-2607.000=30.000
σ0.000
min2637.000-2607.000=30.000
max2637.000-2607.000=30.000
mean8.181-7.962=0.218
σ0.342-0.274=0.068
min7.821-7.729=0.091
max8.679-8.400=0.279
iters=5
new-facts=6402
prior-facts=6402
mean5167.084-5166.900=0.184
σ0.009-0.027=-0.017
min5167.076-5166.883=0.194
max5167.095-5166.948=0.147
mean3365.800-3466.800=-101.000
σ452.575-465.017=-12.442
min2924.000-2888.000=36.000
max3828.000-4160.000=-332.000
mean9.430-9.433=-0.003
σ0.411-0.376=0.035
min9.051-9.143=-0.093
max10.025-10.065=-0.040

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.568-1.140=0.428
σ0.449-0.234=0.215
min0.947-0.940=0.007
max1.994-1.497=0.497

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.263-460.255=0.008
σ572.608-572.608=-0.000
min173.959-173.951=0.008
max1319.175-1319.167=0.008
mean79.500
σ7.000
min76.000
max90.000
mean438.000-437.000=1.000
σ0.000
min438.000-437.000=1.000
max438.000-437.000=1.000
mean0.537-0.550=-0.012
σ0.522-0.556=-0.034
min0.273-0.266=0.007
max1.320-1.383=-0.063
policies=20
mean1740.097-1740.017=0.080
σ0.332-0.342=-0.010
min1739.854-1739.773=0.080
max1740.583-1740.520=0.063
mean760.000
σ0.000
min760.000
max760.000
mean447.750
σ9.605-9.743=-0.138
min438.000-437.000=1.000
max456.000
mean2.663-2.679=-0.016
σ0.018-0.018=0.000
min2.643-2.661=-0.018
max2.686-2.702=-0.016
policies=200
mean17410.202-17409.399=0.803
σ0.037-0.136=-0.099
min17410.148-17409.232=0.916
max17410.229-17409.563=0.666
mean7600.000
σ0.000
min7600.000
max7600.000
mean494.250-493.000=1.250
σ4.500-2.449=2.051
min488.000-491.000=-3.000
max498.000-496.000=2.000
mean26.919-27.101=-0.182
σ0.089-0.125=-0.035
min26.803-26.957=-0.154
max27.019-27.235=-0.215