Compare commits

Home / Compare 630add9e .. 3f3070c6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.772-30.771=0.001
σ0.045-0.045=0.000
min30.750-30.748=0.001
max30.900-30.899=0.001
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.076-0.074=0.001
σ0.006-0.005=0.002
min0.069-0.070=-0.001
max0.088-0.085=0.003
cache=y
dps=1
iters=10
policies=100
mean21.058-21.059=-0.001
σ0.002-0.003=-0.001
min21.054-21.056=-0.002
max21.061-21.064=-0.003
mean417.000-412.900=4.100
σ0.000-0.316=-0.316
min417.000-412.000=5.000
max417.000-413.000=4.000
mean0.062-0.062=0.000
σ0.004-0.003=0.001
min0.056-0.057=-0.001
max0.070-0.065=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.235-1751.237=-0.002
σ0.362-0.362=0.001
min1750.670-1750.664=0.006
max1751.821-1751.808=0.013
mean1671.400-1661.150=10.250
σ630.965-635.652=-4.687
min683.000-680.000=3.000
max2651.000-2719.000=-68.000
mean2.816-2.844=-0.028
σ0.104-0.109=-0.006
min2.608-2.500=0.108
max3.056-3.058=-0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.566-275.568=-0.002
σ0.007-0.004=0.002
min275.561-275.563=-0.003
max275.578-275.574=0.004
mean2651.000-2719.000=-68.000
σ0.000
min2651.000-2719.000=-68.000
max2651.000-2719.000=-68.000
mean0.391-0.394=-0.003
σ0.009-0.009=-0.000
min0.386-0.386=-0.001
max0.406-0.406=-0.000
iters=5
new-facts=1
prior-facts=6402
mean2168.099-2168.089=0.010
σ0.007-0.022=-0.015
min2168.091-2168.062=0.029
max2168.109-2168.116=-0.007
mean2651.000-2719.000=-68.000
σ0.000
min2651.000-2719.000=-68.000
max2651.000-2719.000=-68.000
mean2.968-2.826=0.141
σ0.164-0.152=0.012
min2.747-2.668=0.079
max3.153-3.058=0.095
iters=5
new-facts=6402
prior-facts=1
mean5047.550-5047.921=-0.371
σ1.248-0.901=0.347
min5046.167-5047.345=-1.177
max5049.530-5049.521=0.009
mean2651.000-2719.000=-68.000
σ0.000
min2651.000-2719.000=-68.000
max2651.000-2719.000=-68.000
mean8.762-8.738=0.024
σ0.485-0.443=0.041
min8.135-8.239=-0.105
max9.272-9.290=-0.019
iters=5
new-facts=6402
prior-facts=6402
mean5178.989-5178.962=0.027
σ0.207-0.208=-0.001
min5178.648-5178.617=0.031
max5179.172-5179.128=0.043
mean3212.000-3323.200=-111.200
σ386.003-463.013=-77.011
min2680.000-2719.000=-39.000
max3694.000-3937.000=-243.000
mean10.215-9.850=0.365
σ0.278-0.098=0.181
min9.961-9.723=0.237
max10.604-9.953=0.651

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.163-1.118=0.045
σ0.343-0.226=0.117
min0.942-0.946=-0.004
max1.727-1.502=0.225

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.207-463.205=0.002
σ572.671-572.664=0.008
min176.869-176.869=0.000
max1322.214-1322.200=0.014
mean77.500
σ7.000
min74.000
max88.000
mean2651.000-2719.000=-68.000
σ0.000
min2651.000-2719.000=-68.000
max2651.000-2719.000=-68.000
mean0.547-0.549=-0.002
σ0.531-0.542=-0.010
min0.281-0.274=0.007
max1.344-1.362=-0.018
policies=20
mean1768.964-1768.973=-0.008
σ0.331-0.342=-0.011
min1768.754-1768.752=0.002
max1769.459-1769.483=-0.024
mean740.000
σ0.000
min740.000
max740.000
mean2651.000-2719.000=-68.000
σ0.000
min2651.000-2719.000=-68.000
max2651.000-2719.000=-68.000
mean2.735-2.747=-0.013
σ0.012-0.011=0.001
min2.720-2.734=-0.014
max2.749-2.760=-0.011
policies=200
mean17696.132-17696.093=0.039
σ0.501-0.594=-0.093
min17695.772-17695.773=-0.002
max17696.861-17696.984=-0.122
mean7400.000
σ0.000
min7400.000
max7400.000
mean2651.000-2719.000=-68.000
σ0.000
min2651.000-2719.000=-68.000
max2651.000-2719.000=-68.000
mean27.722-27.775=-0.053
σ0.131-0.146=-0.015
min27.584-27.575=0.008
max27.896-27.921=-0.025