Compare commits

Home / Compare a24d8e6d .. d548a7af

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.378-70.380=-0.003
σ0.045-0.048=-0.003
min70.349-70.350=-0.001
max70.503-70.516=-0.012
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.157-0.160=-0.003
σ0.006-0.003=0.003
min0.149-0.156=-0.007
max0.168-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=-0.001
σ0.003-0.002=0.000
min21.140-21.141=-0.001
max21.148-21.148=-0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.065-0.064=0.002
σ0.003-0.003=-0.000
min0.063-0.059=0.004
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.387-1752.385=0.002
σ0.361-0.364=-0.003
min1751.816-1751.820=-0.004
max1752.950-1752.977=-0.027
mean1631.600-1659.500=-27.900
σ597.441-636.637=-39.196
min626.000-617.000=9.000
max2420.000-2791.000=-371.000
mean2.767-2.732=0.035
σ0.182-0.209=-0.026
min2.268-2.164=0.104
max2.965-2.954=0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.129-270.127=0.001
σ0.003-0.009=-0.006
min270.125-270.116=0.008
max270.133-270.141=-0.007
mean2420.000-2791.000=-371.000
σ0.000
min2420.000-2791.000=-371.000
max2420.000-2791.000=-371.000
mean0.382-0.370=0.011
σ0.003-0.002=0.001
min0.379-0.368=0.011
max0.387-0.372=0.015
iters=5
new-facts=1
prior-facts=6402
mean1930.596-1930.590=0.006
σ0.013-0.019=-0.006
min1930.584-1930.565=0.019
max1930.616-1930.612=0.004
mean2420.000-2791.000=-371.000
σ0.000
min2420.000-2791.000=-371.000
max2420.000-2791.000=-371.000
mean2.500-2.631=-0.131
σ0.132-0.117=0.014
min2.334-2.449=-0.115
max2.692-2.723=-0.031
iters=5
new-facts=6402
prior-facts=1
mean4750.992-4751.058=-0.066
σ0.553-0.852=-0.299
min4750.671-4750.586=0.085
max4751.978-4752.577=-0.599
mean2420.000-2791.000=-371.000
σ0.000
min2420.000-2791.000=-371.000
max2420.000-2791.000=-371.000
mean8.295-8.715=-0.420
σ0.594-0.499=0.095
min7.586-7.893=-0.306
max8.990-9.212=-0.222
iters=5
new-facts=6402
prior-facts=6402
mean4941.458-4941.461=-0.004
σ0.215-0.207=0.007
min4941.106-4941.116=-0.010
max4941.636-4941.626=0.010
mean2982.800-3040.800=-58.000
σ282.809-297.100=-14.291
min2597.000-2791.000=-194.000
max3319.000-3484.000=-165.000
mean8.622-8.628=-0.006
σ0.292-0.142=0.150
min8.366-8.474=-0.108
max9.082-8.784=0.299

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.805-1.002=0.804
σ0.142-0.133=0.009
min1.576-0.932=0.644
max1.928-1.240=0.688

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.353-466.370=-0.017
σ575.913-575.929=-0.016
min178.394-178.393=0.001
max1330.222-1330.263=-0.042
mean84.000
σ8.000
min80.000
max96.000
mean2420.000-2791.000=-371.000
σ0.000
min2420.000-2791.000=-371.000
max2420.000-2791.000=-371.000
mean0.561-0.442=0.119
σ0.567-0.313=0.254
min0.274-0.285=-0.011
max1.412-0.912=0.501
policies=20
mean1784.225-1784.266=-0.042
σ0.368-0.338=0.030
min1783.986-1784.024=-0.037
max1784.772-1784.765=0.007
mean800.000
σ0.000
min800.000
max800.000
mean2420.000-2791.000=-371.000
σ0.000
min2420.000-2791.000=-371.000
max2420.000-2791.000=-371.000
mean2.791-2.846=-0.056
σ0.005-0.121=-0.116
min2.785-2.753=0.032
max2.797-3.013=-0.216
policies=200
mean17848.855-17848.874=-0.018
σ0.350-0.482=-0.132
min17848.607-17848.578=0.029
max17849.372-17849.594=-0.223
mean8000.000
σ0.000
min8000.000
max8000.000
mean2420.000-2791.000=-371.000
σ0.000
min2420.000-2791.000=-371.000
max2420.000-2791.000=-371.000
mean27.936-27.988=-0.052
σ0.072-0.107=-0.035
min27.842-27.913=-0.072
max28.016-28.147=-0.131