Compare commits

Home / Compare 8b549dfc .. d7ab6ca3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.773-30.773=0.000
σ0.046-0.046=-0.000
min30.752-30.750=0.002
max30.903-30.903=-0.001
mean412.900-411.900=1.000
σ0.316
min412.000-411.000=1.000
max413.000-412.000=1.000
mean0.078-0.076=0.002
σ0.003-0.005=-0.002
min0.076-0.069=0.006
max0.084-0.084=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.059-21.059=0.000
σ0.002-0.003=-0.001
min21.055-21.054=0.001
max21.062-21.064=-0.003
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.064-0.063=0.000
σ0.002-0.002=-0.000
min0.061-0.062=-0.000
max0.069-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.235-1751.235=0.000
σ0.364-0.362=0.002
min1750.667-1750.668=-0.001
max1751.825-1751.822=0.004
mean1666.950-1659.300=7.650
σ638.741-638.400=0.341
min681.000-689.000=-8.000
max2697.000-2775.000=-78.000
mean2.820-2.790=0.030
σ0.150-0.162=-0.012
min2.441-2.365=0.077
max3.037-2.994=0.043

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.562-275.570=-0.008
σ0.006-0.004=0.002
min275.558-275.566=-0.008
max275.572-275.575=-0.003
mean2697.000-2775.000=-78.000
σ0.000
min2697.000-2775.000=-78.000
max2697.000-2775.000=-78.000
mean0.399-0.392=0.008
σ0.005-0.008=-0.002
min0.395-0.382=0.013
max0.408-0.399=0.010
iters=5
new-facts=1
prior-facts=6402
mean2168.080-2168.089=-0.009
σ0.013-0.020=-0.007
min2168.072-2168.070=0.001
max2168.102-2168.114=-0.012
mean2697.000-2775.000=-78.000
σ0.000
min2697.000-2775.000=-78.000
max2697.000-2775.000=-78.000
mean3.007-2.980=0.027
σ0.140-0.139=0.001
min2.789-2.752=0.038
max3.176-3.093=0.083
iters=5
new-facts=6402
prior-facts=1
mean5047.898-5047.892=0.006
σ0.907-0.882=0.025
min5047.374-5047.340=0.033
max5049.506-5049.449=0.058
mean2697.000-2775.000=-78.000
σ0.000
min2697.000-2775.000=-78.000
max2697.000-2775.000=-78.000
mean8.982-8.843=0.139
σ0.416-0.479=-0.063
min8.343-8.083=0.260
max9.501-9.295=0.206
iters=5
new-facts=6402
prior-facts=6402
mean5179.047-5179.055=-0.008
σ0.082-0.089=-0.007
min5178.968-5178.968=0.000
max5179.149-5179.150=-0.002
mean3238.200-3326.400=-88.200
σ380.100-393.420=-13.320
min2702.000-2775.000=-73.000
max3699.000-3684.000=15.000
mean9.939-10.120=-0.181
σ0.263-0.331=-0.069
min9.479-9.665=-0.186
max10.134-10.566=-0.432

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.103-1.030=0.073
σ0.119-0.157=-0.039
min0.942-0.932=0.010
max1.252-1.295=-0.043

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.204-463.203=0.001
σ572.659-572.651=0.008
min176.869-176.876=-0.006
max1322.191-1322.179=0.013
mean77.500
σ7.000
min74.000
max88.000
mean2697.000-2775.000=-78.000
σ0.000
min2697.000-2775.000=-78.000
max2697.000-2775.000=-78.000
mean0.523-0.440=0.083
σ0.488-0.301=0.187
min0.277-0.287=-0.010
max1.255-0.892=0.363
policies=20
mean1768.968-1768.983=-0.015
σ0.341-0.348=-0.007
min1768.740-1768.767=-0.027
max1769.476-1769.501=-0.026
mean740.000
σ0.000
min740.000
max740.000
mean2697.000-2775.000=-78.000
σ0.000
min2697.000-2775.000=-78.000
max2697.000-2775.000=-78.000
mean2.758-2.790=-0.032
σ0.023-0.079=-0.057
min2.734-2.727=0.007
max2.781-2.901=-0.120
policies=200
mean17696.106-17696.243=-0.137
σ0.460-0.498=-0.039
min17695.768-17695.970=-0.202
max17696.783-17696.990=-0.207
mean7400.000
σ0.000
min7400.000
max7400.000
mean2697.000-2775.000=-78.000
σ0.000
min2697.000-2775.000=-78.000
max2697.000-2775.000=-78.000
mean27.732-27.590=0.142
σ0.192-0.188=0.004
min27.539-27.402=0.137
max27.910-27.827=0.083