Compare commits

Home / Compare 5479a1b8 .. a7b6a819

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.379-70.380=-0.000
σ0.045-0.045=-0.001
min70.354-70.351=0.003
max70.504-70.505=-0.001
mean412.000-415.600=-3.600
σ0.000-0.516=-0.516
min412.000-415.000=-3.000
max412.000-416.000=-4.000
mean0.159-0.160=-0.001
σ0.003-0.004=-0.001
min0.156-0.155=0.001
max0.166-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.000
σ0.003-0.002=0.001
min21.139-21.140=-0.001
max21.149-21.149=0.001
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.065-0.066=-0.001
σ0.002-0.002=0.000
min0.063-0.063=-0.000
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.386-1752.386=0.001
σ0.362-0.360=0.002
min1751.820-1751.816=0.005
max1752.970-1752.948=0.022
mean1632.600-1638.300=-5.700
σ609.620-614.647=-5.027
min629.000
max2453.000-2472.000=-19.000
mean2.829-2.812=0.016
σ0.123-0.155=-0.031
min2.612-2.374=0.237
max3.061-3.004=0.058

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.133-270.129=0.004
σ0.006-0.008=-0.002
min270.125-270.118=0.007
max270.139-270.139=-0.001
mean2453.000-2472.000=-19.000
σ0.000
min2453.000-2472.000=-19.000
max2453.000-2472.000=-19.000
mean0.388-0.378=0.010
σ0.008-0.004=0.005
min0.380-0.372=0.008
max0.400-0.381=0.019
iters=5
new-facts=1
prior-facts=6402
mean1930.594-1930.593=0.000
σ0.009-0.003=0.005
min1930.584-1930.590=-0.006
max1930.605-1930.596=0.009
mean2453.000-2472.000=-19.000
σ0.000
min2453.000-2472.000=-19.000
max2453.000-2472.000=-19.000
mean2.587-2.533=0.054
σ0.125-0.100=0.025
min2.452-2.453=-0.001
max2.781-2.681=0.101
iters=5
new-facts=6402
prior-facts=1
mean4751.139-4750.990=0.149
σ0.805-0.970=-0.165
min4750.651-4750.012=0.638
max4752.568-4752.614=-0.046
mean2453.000-2472.000=-19.000
σ0.000
min2453.000-2472.000=-19.000
max2453.000-2472.000=-19.000
mean8.119-8.292=-0.172
σ0.389-0.483=-0.094
min7.746-7.720=0.026
max8.559-8.851=-0.292
iters=5
new-facts=6402
prior-facts=6402
mean4941.530-4941.526=0.005
σ0.087-0.085=0.002
min4941.452-4941.459=-0.007
max4941.629-4941.626=0.004
mean2968.000-2947.400=20.600
σ436.458-415.852=20.606
min2476.000-2472.000=4.000
max3562.000-3513.000=49.000
mean8.590-8.572=0.018
σ0.297-0.207=0.090
min8.345-8.321=0.023
max9.006-8.784=0.223

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.731-1.864=-0.133
σ0.179-0.020=0.159
min1.505-1.839=-0.334
max1.939-1.890=0.048

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.363-466.363=-0.000
σ575.934-575.938=-0.004
min178.390-178.392=-0.002
max1330.264-1330.270=-0.006
mean84.250
σ8.500
min80.000
max97.000
mean2453.000-2472.000=-19.000
σ0.000
min2453.000-2472.000=-19.000
max2453.000-2472.000=-19.000
mean0.568-0.557=0.011
σ0.567-0.549=0.017
min0.281-0.280=0.001
max1.419-1.381=0.037
policies=20
mean1784.202-1784.228=-0.027
σ0.349-0.362=-0.013
min1783.978-1783.997=-0.020
max1784.721-1784.766=-0.045
mean800.000
σ0.000
min800.000
max800.000
mean2453.000-2472.000=-19.000
σ0.000
min2453.000-2472.000=-19.000
max2453.000-2472.000=-19.000
mean2.790-2.786=0.004
σ0.028-0.017=0.012
min2.761-2.764=-0.004
max2.828-2.805=0.023
policies=200
mean17848.876-17848.896=-0.020
σ0.501-0.443=0.058
min17848.475-17848.615=-0.139
max17849.607-17849.553=0.054
mean8000.000
σ0.000
min8000.000
max8000.000
mean2453.000-2472.000=-19.000
σ0.000
min2453.000-2472.000=-19.000
max2453.000-2472.000=-19.000
mean27.995-28.050=-0.054
σ0.041-0.015=0.025
min27.960-28.038=-0.078
max28.054-28.072=-0.018