Compare commits

Home / Compare 8fa55c06 .. faabdf80

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.773=-0.004
σ0.047-0.046=0.001
min30.726-30.749=-0.023
max30.899-30.904=-0.005
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.074-0.079=-0.005
σ0.004-0.003=0.001
min0.070-0.076=-0.006
max0.080-0.086=-0.006
cache=y
dps=1
iters=10
policies=100
mean21.061-21.060=0.001
σ0.002-0.003=-0.001
min21.057-21.057=-0.000
max21.064-21.065=-0.001
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.061-0.064=-0.004
σ0.003-0.003=0.001
min0.057-0.062=-0.005
max0.068-0.070=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.420-1751.235=0.185
σ0.360-0.364=-0.004
min1750.851-1750.671=0.181
max1752.005-1751.827=0.177
mean1650.450-1661.900=-11.450
σ624.593-627.285=-2.692
min680.000-685.000=-5.000
max2652.000-2769.000=-117.000
mean2.837-2.844=-0.006
σ0.127-0.129=-0.002
min2.528-2.439=0.089
max3.081-3.060=0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.730-267.614=8.116
σ0.009-17.779=-17.770
min275.721-235.810=39.910
max275.744-275.570=0.174
mean2652.000-2769.000=-117.000
σ0.000
min2652.000-2769.000=-117.000
max2652.000-2769.000=-117.000
mean0.402-0.380=0.021
σ0.008-0.031=-0.023
min0.397-0.326=0.071
max0.415-0.399=0.016
iters=5
new-facts=1
prior-facts=6402
mean2168.274-2168.085=0.189
σ0.021-0.015=0.007
min2168.254-2168.067=0.187
max2168.300-2168.103=0.197
mean2652.000-2769.000=-117.000
σ0.000
min2652.000-2769.000=-117.000
max2652.000-2769.000=-117.000
mean2.970-2.935=0.036
σ0.134-0.097=0.037
min2.757-2.810=-0.054
max3.090-3.053=0.038
iters=5
new-facts=6402
prior-facts=1
mean5048.100-5047.909=0.190
σ0.917-0.878=0.039
min5047.515-5047.334=0.181
max5049.709-5049.444=0.266
mean2652.000-2769.000=-117.000
σ0.000
min2652.000-2769.000=-117.000
max2652.000-2769.000=-117.000
mean8.980-8.903=0.077
σ0.557-0.507=0.050
min8.163-8.196=-0.033
max9.597-9.405=0.192
iters=5
new-facts=6402
prior-facts=6402
mean5179.097-5178.975=0.122
σ0.341-0.200=0.141
min5178.501-5178.651=-0.150
max5179.328-5179.159=0.169
mean3225.600-3302.400=-76.800
σ369.873-394.037=-24.164
min2697.000-2769.000=-72.000
max3678.000-3674.000=4.000
mean9.951-9.873=0.078
σ0.198-0.212=-0.014
min9.610-9.534=0.076
max10.118-10.106=0.013

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.127-1.056=0.071
σ0.272-0.184=0.087
min0.936-0.944=-0.009
max1.542-1.373=0.170

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.576-463.203=0.373
σ572.674-572.662=0.012
min177.236-176.869=0.366
max1322.587-1322.197=0.391
mean79.750-77.500=2.250
σ7.500-7.000=0.500
min76.000-74.000=2.000
max91.000-88.000=3.000
mean2652.000-2769.000=-117.000
σ0.000
min2652.000-2769.000=-117.000
max2652.000-2769.000=-117.000
mean0.548-0.440=0.108
σ0.532-0.305=0.227
min0.276-0.286=-0.010
max1.345-0.897=0.448
policies=20
mean1772.616-1768.972=3.644
σ0.332-0.302=0.029
min1772.400-1768.762=3.637
max1773.109-1769.421=3.688
mean760.000-740.000=20.000
σ0.000
min760.000-740.000=20.000
max760.000-740.000=20.000
mean2652.000-2769.000=-117.000
σ0.000
min2652.000-2769.000=-117.000
max2652.000-2769.000=-117.000
mean2.754-2.772=-0.018
σ0.020-0.080=-0.060
min2.731-2.714=0.016
max2.779-2.890=-0.111
policies=200
mean17732.916-17696.272=36.644
σ0.425-0.488=-0.063
min17732.550-17696.005=36.545
max17733.521-17697.004=36.517
mean7600.000-7400.000=200.000
σ0.000
min7600.000-7400.000=200.000
max7600.000-7400.000=200.000
mean2652.000-2769.000=-117.000
σ0.000
min2652.000-2769.000=-117.000
max2652.000-2769.000=-117.000
mean27.743-27.577=0.166
σ0.089-0.148=-0.059
min27.649-27.413=0.236
max27.847-27.762=0.085