Compare commits

Home / Compare ffe23884 .. 9fc07f44

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.772=-0.003
σ0.047-0.046=0.001
min30.726-30.748=-0.022
max30.899-30.901=-0.002
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.074-0.072=0.002
σ0.004-0.008=-0.004
min0.070-0.059=0.011
max0.080-0.083=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.061-21.059=0.001
σ0.002-0.003=-0.001
min21.057-21.055=0.002
max21.064-21.064=-0.000
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.061-0.063=-0.002
σ0.003-0.004=-0.000
min0.057-0.057=0.001
max0.068-0.071=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.420-1751.233=0.187
σ0.360-0.366=-0.005
min1750.851-1750.672=0.179
max1752.005-1751.821=0.184
mean1650.450-1648.150=2.300
σ624.593-619.549=5.045
min680.000-682.000=-2.000
max2652.000-2643.000=9.000
mean2.837-2.798=0.039
σ0.127-0.190=-0.063
min2.528-2.299=0.229
max3.081-3.140=-0.058

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.730-275.566=0.165
σ0.009-0.004=0.005
min275.721-275.559=0.162
max275.744-275.569=0.174
mean2652.000-2643.000=9.000
σ0.000
min2652.000-2643.000=9.000
max2652.000-2643.000=9.000
mean0.402-0.392=0.009
σ0.008-0.007=0.000
min0.397-0.387=0.010
max0.415-0.401=0.014
iters=5
new-facts=1
prior-facts=6402
mean2168.274-2168.102=0.173
σ0.021-0.009=0.012
min2168.254-2168.089=0.165
max2168.300-2168.114=0.185
mean2652.000-2643.000=9.000
σ0.000
min2652.000-2643.000=9.000
max2652.000-2643.000=9.000
mean2.970-2.830=0.140
σ0.134-0.119=0.015
min2.757-2.680=0.077
max3.090-2.969=0.122
iters=5
new-facts=6402
prior-facts=1
mean5048.100-5047.894=0.206
σ0.917-0.908=0.009
min5047.515-5047.374=0.141
max5049.709-5049.507=0.202
mean2652.000-2643.000=9.000
σ0.000
min2652.000-2643.000=9.000
max2652.000-2643.000=9.000
mean8.980-8.850=0.130
σ0.557-0.452=0.104
min8.163-8.084=0.079
max9.597-9.284=0.313
iters=5
new-facts=6402
prior-facts=6402
mean5179.097-5179.027=0.071
σ0.341-0.087=0.254
min5178.501-5178.942=-0.441
max5179.328-5179.123=0.204
mean3225.600-3207.600=18.000
σ369.873-485.494=-115.621
min2697.000-2643.000=54.000
max3678.000-3864.000=-186.000
mean9.951-9.609=0.342
σ0.198-0.610=-0.412
min9.610-8.635=0.974
max10.118-10.197=-0.078

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.127-1.182=-0.056
σ0.272-0.270=0.002
min0.936-0.959=-0.024
max1.542-1.606=-0.064

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.576-463.203=0.373
σ572.674-572.663=0.012
min177.236-176.869=0.367
max1322.587-1322.197=0.390
mean79.750-77.500=2.250
σ7.500-7.000=0.500
min76.000-74.000=2.000
max91.000-88.000=3.000
mean2652.000-2643.000=9.000
σ0.000
min2652.000-2643.000=9.000
max2652.000-2643.000=9.000
mean0.548-0.560=-0.012
σ0.532-0.564=-0.032
min0.276-0.277=-0.001
max1.345-1.405=-0.060
policies=20
mean1772.616-1768.973=3.643
σ0.332-0.340=-0.008
min1772.400-1768.759=3.641
max1773.109-1769.480=3.629
mean760.000-740.000=20.000
σ0.000
min760.000-740.000=20.000
max760.000-740.000=20.000
mean2652.000-2643.000=9.000
σ0.000
min2652.000-2643.000=9.000
max2652.000-2643.000=9.000
mean2.754-2.745=0.009
σ0.020-0.030=-0.010
min2.731-2.712=0.018
max2.779-2.772=0.007
policies=200
mean17732.916-17696.254=36.663
σ0.425-0.470=-0.045
min17732.550-17696.014=36.536
max17733.521-17696.958=36.563
mean7600.000-7400.000=200.000
σ0.000
min7600.000-7400.000=200.000
max7600.000-7400.000=200.000
mean2652.000-2643.000=9.000
σ0.000
min2652.000-2643.000=9.000
max2652.000-2643.000=9.000
mean27.743-27.667=0.076
σ0.089-0.136=-0.047
min27.649-27.517=0.132
max27.847-27.836=0.011