Compare commits

Home / Compare 36422f85 .. 87cb616e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.794-35.793=0.001
σ0.109-0.106=0.004
min35.752-35.747=0.005
max36.105-36.093=0.012
mean414.000-412.900=1.100
σ0.000-0.316=-0.316
min414.000-412.000=2.000
max414.000-413.000=1.000
mean0.076-0.076=-0.000
σ0.004-0.003=0.001
min0.074-0.074=-0.000
max0.084-0.081=0.003
cache=y
dps=1
iters=10
policies=100
mean26.064-26.065=-0.001
σ0.003-0.003=-0.000
min26.060-26.061=-0.001
max26.069-26.073=-0.004
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.059-0.061=-0.002
σ0.004-0.003=0.001
min0.056-0.059=-0.003
max0.069-0.068=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.236-1751.238=-0.002
σ0.363-0.362=0.001
min1750.668-1750.677=-0.009
max1751.824-1751.825=-0.002
mean1648.250-1634.350=13.900
σ628.513-616.533=11.980
min631.000-628.000=3.000
max2849.000-2471.000=378.000
mean2.795-2.853=-0.058
σ0.188-0.118=0.069
min2.359-2.541=-0.182
max3.082-3.083=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.545-275.566=-0.022
σ0.009-0.007=0.002
min275.532-275.559=-0.027
max275.553-275.575=-0.022
mean2849.000-2471.000=378.000
σ0.000
min2849.000-2471.000=378.000
max2849.000-2471.000=378.000
mean0.405-0.395=0.009
σ0.009-0.009=-0.000
min0.394-0.388=0.006
max0.417-0.406=0.010
iters=5
new-facts=1
prior-facts=6402
mean2168.089-2168.104=-0.014
σ0.018-0.003=0.015
min2168.060-2168.099=-0.038
max2168.103-2168.107=-0.004
mean2849.000-2471.000=378.000
σ0.000
min2849.000-2471.000=378.000
max2849.000-2471.000=378.000
mean2.955-2.959=-0.004
σ0.173-0.151=0.022
min2.767-2.769=-0.002
max3.203-3.153=0.050
iters=5
new-facts=6402
prior-facts=1
mean5047.708-5047.926=-0.218
σ1.123-0.884=0.238
min5046.748-5047.390=-0.642
max5049.606-5049.500=0.106
mean2849.000-2471.000=378.000
σ0.000
min2849.000-2471.000=378.000
max2849.000-2471.000=378.000
mean8.962-8.781=0.181
σ0.658-0.573=0.085
min8.228-8.069=0.159
max9.670-9.389=0.281
iters=5
new-facts=6402
prior-facts=6402
mean5179.043-5179.037=0.007
σ0.091-0.079=0.011
min5178.947-5178.968=-0.020
max5179.157-5179.124=0.033
mean3265.000-3219.400=45.600
σ360.136-389.498=-29.362
min2849.000-2684.000=165.000
max3625.000-3707.000=-82.000
mean9.688-9.788=-0.100
σ0.610-0.198=0.413
min8.664-9.584=-0.920
max10.195-10.061=0.134

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.072-1.802=-0.730
σ0.148-0.123=0.025
min0.945-1.652=-0.707
max1.308-1.989=-0.681

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.211-463.197=0.013
σ572.658-572.647=0.011
min176.876-176.871=0.006
max1322.197-1322.168=0.029
mean77.500
σ7.000
min74.000
max88.000
mean2849.000-2471.000=378.000
σ0.000
min2849.000-2471.000=378.000
max2849.000-2471.000=378.000
mean0.438-0.561=-0.123
σ0.306-0.559=-0.253
min0.282-0.276=0.006
max0.897-1.400=-0.503
policies=20
mean1769.007-1768.972=0.034
σ0.342-0.344=-0.002
min1768.771-1768.761=0.010
max1769.512-1769.485=0.028
mean740.000
σ0.000
min740.000
max740.000
mean2849.000-2471.000=378.000
σ0.000
min2849.000-2471.000=378.000
max2849.000-2471.000=378.000
mean2.818-2.752=0.066
σ0.012-0.031=-0.019
min2.805-2.723=0.082
max2.833-2.796=0.038
policies=200
mean17696.310-17696.159=0.152
σ0.474-0.404=0.071
min17695.968-17695.863=0.105
max17697.013-17696.753=0.259
mean7400.000
σ0.000
min7400.000
max7400.000
mean2849.000-2471.000=378.000
σ0.000
min2849.000-2471.000=378.000
max2849.000-2471.000=378.000
mean28.114-27.668=0.446
σ0.509-0.186=0.323
min27.623-27.461=0.163
max28.623-27.862=0.760