Compare commits

Home / Compare df84c0d7 .. 685b9309

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.718
σ0.654
min35.926
max37.532
mean3983.000
σ0.000
min3983.000
max3983.000
mean0.075
σ0.001
min0.074
max0.076
cache=y
dps=1
iters=10
policies=100
mean26.587
σ0.603
min26.209
max27.463
mean3983.000
σ0.000
min3983.000
max3983.000
mean0.060
σ0.001
min0.059
max0.061

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.368-1753.261=3.107
σ0.375-0.364=0.011
min1755.786-1752.685=3.102
max1756.969-1753.851=3.118
mean1653.450-1668.150=-14.700
σ624.896-618.701=6.195
min685.000-671.000=14.000
max2588.000-2603.000=-15.000
mean2.273-2.654=-0.380
σ0.147-0.196=-0.049
min2.086-2.140=-0.055
max2.660-2.865=-0.205

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.692-274.436=4.256
σ0.014-0.005=0.009
min278.678-274.427=4.251
max278.715-274.442=4.272
mean2588.000-2603.000=-15.000
σ0.000
min2588.000-2603.000=-15.000
max2588.000-2603.000=-15.000
mean0.427-0.403=0.024
σ0.012-0.001=0.011
min0.417-0.402=0.015
max0.441-0.405=0.036
iters=5
new-facts=1
prior-facts=6402
mean2268.867-2264.673=4.194
σ0.002-0.014=-0.012
min2268.864-2264.657=4.207
max2268.870-2264.689=4.181
mean2588.000-2603.000=-15.000
σ0.000
min2588.000-2603.000=-15.000
max2588.000-2603.000=-15.000
mean2.950-2.936=0.015
σ0.080-0.280=-0.200
min2.885-2.739=0.146
max3.089-3.424=-0.334
iters=5
new-facts=6402
prior-facts=1
mean4952.343-4951.538=0.804
σ0.884-0.990=-0.106
min4951.850-4950.802=1.048
max4953.920-4953.257=0.663
mean2588.000-2603.000=-15.000
σ0.000
min2588.000-2603.000=-15.000
max2588.000-2603.000=-15.000
mean8.049-7.941=0.108
σ0.327-0.293=0.033
min7.719-7.717=0.002
max8.542-8.413=0.129
iters=5
new-facts=6402
prior-facts=6402
mean5167.071-5166.492=0.580
σ0.014-0.080=-0.066
min5167.060-5166.412=0.648
max5167.094-5166.583=0.512
mean3412.200-3373.200=39.000
σ466.687-459.727=6.960
min2757.000-2832.000=-75.000
max3983.000-4021.000=-38.000
mean9.480-9.257=0.224
σ0.266-0.349=-0.083
min9.038-8.745=0.293
max9.740-9.698=0.042

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.125-1.034=0.091
σ0.167-0.135=0.032
min0.940-0.942=-0.002
max1.348-1.253=0.094

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.256-454.917=5.339
σ572.607-572.576=0.032
min173.951-168.628=5.323
max1319.167-1313.781=5.386
mean79.500
σ7.000
min76.000
max90.000
mean438.000-432.750=5.250
σ0.000-0.500=-0.500
min438.000-432.000=6.000
max438.000-433.000=5.000
mean0.537-0.531=0.006
σ0.531-0.520=0.010
min0.267-0.268=-0.001
max1.333-1.312=0.021
policies=20
mean1740.055-1686.756=53.300
σ0.332-0.298=0.034
min1739.814-1686.536=53.278
max1740.543-1687.192=53.350
mean760.000
σ0.000
min760.000
max760.000
mean447.750-444.000=3.750
σ9.605-6.928=2.676
min438.000
max456.000-450.000=6.000
mean2.663-2.607=0.056
σ0.014-0.023=-0.009
min2.642-2.576=0.066
max2.672-2.632=0.040
policies=200
mean17409.452-16876.965=532.487
σ0.439-0.059=0.380
min17408.801-16876.935=531.866
max17409.719-16877.054=532.665
mean7600.000
σ0.000
min7600.000
max7600.000
mean490.250-491.500=-1.250
σ2.630-3.697=-1.067
min488.000
max494.000-496.000=-2.000
mean26.959-26.187=0.772
σ0.160-0.104=0.056
min26.819-26.043=0.776
max27.186-26.291=0.895