Compare commits

Home / Compare 2a42c5c4 .. 66b43492

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.768=0.001
σ0.046-0.049=-0.003
min30.731-30.725=0.006
max30.894-30.902=-0.008
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.075-0.073=0.002
σ0.005-0.004=0.001
min0.069-0.070=-0.001
max0.084-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean21.061-21.061=-0.001
σ0.002-0.002=0.000
min21.057-21.058=-0.001
max21.064-21.064=-0.000
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.064-0.064=0.001
σ0.003-0.003=0.000
min0.062-0.062=0.000
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.418-1751.420=-0.002
σ0.362-0.361=0.000
min1750.853-1750.854=-0.001
max1751.998-1752.001=-0.004
mean1655.000-1673.950=-18.950
σ617.898-623.148=-5.251
min661.000-662.000=-1.000
max2494.000-2617.000=-123.000
mean2.818-2.803=0.015
σ0.140-0.227=-0.086
min2.397-2.325=0.072
max3.083-3.496=-0.413

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.758-275.755=0.003
σ0.008-0.012=-0.004
min275.751-275.743=0.007
max275.766-275.768=-0.002
mean2494.000-2617.000=-123.000
σ0.000
min2494.000-2617.000=-123.000
max2494.000-2617.000=-123.000
mean0.400-0.392=0.008
σ0.007-0.010=-0.003
min0.395-0.386=0.010
max0.412-0.408=0.004
iters=5
new-facts=1
prior-facts=6402
mean2168.282-2168.280=0.002
σ0.011-0.011=0.001
min2168.263-2168.265=-0.002
max2168.291-2168.292=-0.001
mean2494.000-2617.000=-123.000
σ0.000
min2494.000-2617.000=-123.000
max2494.000-2617.000=-123.000
mean2.991-2.954=0.037
σ0.160-0.156=0.004
min2.793-2.771=0.022
max3.121-3.109=0.012
iters=5
new-facts=6402
prior-facts=1
mean5047.878-5048.104=-0.226
σ0.740-0.896=-0.156
min5047.225-5047.625=-0.400
max5049.148-5049.704=-0.556
mean2494.000-2617.000=-123.000
σ0.000
min2494.000-2617.000=-123.000
max2494.000-2617.000=-123.000
mean8.846-8.630=0.216
σ0.452-0.377=0.075
min8.286-8.037=0.248
max9.392-9.058=0.334
iters=5
new-facts=6402
prior-facts=6402
mean5178.877-5179.161=-0.284
σ0.387-0.204=0.182
min5178.446-5178.814=-0.367
max5179.342-5179.320=0.022
mean3221.800-3268.400=-46.600
σ383.720-375.009=8.710
min2704.000-2737.000=-33.000
max3723.000-3717.000=6.000
mean9.763-9.805=-0.042
σ0.317-0.541=-0.224
min9.414-8.871=0.543
max10.105-10.283=-0.178

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.747-1.273=0.473
σ0.174-0.382=-0.208
min1.517-0.947=0.571
max1.913-1.924=-0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.564-463.570=-0.006
σ572.650-572.661=-0.011
min177.238-177.237=0.001
max1322.539-1322.562=-0.023
mean79.750
σ7.500
min76.000
max91.000
mean2494.000-2617.000=-123.000
σ0.000
min2494.000-2617.000=-123.000
max2494.000-2617.000=-123.000
mean0.569-0.542=0.027
σ0.586-0.525=0.061
min0.275-0.276=-0.001
max1.448-1.330=0.118
policies=20
mean1772.637-1772.614=0.023
σ0.320-0.330=-0.010
min1772.413-1772.391=0.022
max1773.110-1773.103=0.007
mean760.000
σ0.000
min760.000
max760.000
mean2494.000-2617.000=-123.000
σ0.000
min2494.000-2617.000=-123.000
max2494.000-2617.000=-123.000
mean2.730-2.748=-0.019
σ0.012-0.009=0.003
min2.715-2.739=-0.024
max2.742-2.758=-0.016
policies=200
mean17733.056-17732.978=0.079
σ0.497-0.526=-0.028
min17732.778-17732.568=0.210
max17733.801-17733.748=0.053
mean7600.000
σ0.000
min7600.000
max7600.000
mean2494.000-2617.000=-123.000
σ0.000
min2494.000-2617.000=-123.000
max2494.000-2617.000=-123.000
mean27.627-27.755=-0.128
σ0.146-0.112=0.034
min27.519-27.600=-0.081
max27.839-27.849=-0.010