Compare commits

Home / Compare 5920c694 .. 69d336ad

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.373-70.374=-0.001
σ0.045-0.048=-0.003
min70.342-70.345=-0.003
max70.496-70.506=-0.010
mean415.000-410.000=5.000
σ0.000
min415.000-410.000=5.000
max415.000-410.000=5.000
mean0.159-0.159=-0.000
σ0.005-0.003=0.002
min0.151-0.156=-0.005
max0.166-0.165=0.000
cache=y
dps=1
iters=10
policies=100
mean21.141-21.141=-0.000
σ0.001-0.002=-0.001
min21.138-21.138=-0.000
max21.143-21.145=-0.002
mean415.000-410.000=5.000
σ0.000
min415.000-410.000=5.000
max415.000-410.000=5.000
mean0.063-0.064=-0.001
σ0.004-0.002=0.002
min0.058-0.062=-0.004
max0.069-0.069=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.387-1752.386=0.001
σ0.362-0.359=0.003
min1751.817-1751.818=-0.001
max1752.968-1752.954=0.014
mean1639.050-1656.250=-17.200
σ602.601-636.893=-34.293
min625.000-617.000=8.000
max2432.000-2800.000=-368.000
mean2.853-2.830=0.023
σ0.113-0.102=0.011
min2.589-2.607=-0.018
max3.031-3.091=-0.060

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.129-270.126=0.003
σ0.006-0.005=0.000
min270.123-270.120=0.003
max270.137-270.132=0.005
mean2432.000-2800.000=-368.000
σ0.000
min2432.000-2800.000=-368.000
max2432.000-2800.000=-368.000
mean0.380-0.372=0.009
σ0.006-0.001=0.006
min0.372-0.371=0.001
max0.389-0.373=0.017
iters=5
new-facts=1
prior-facts=6402
mean1930.591-1930.588=0.003
σ0.016-0.007=0.009
min1930.564-1930.581=-0.017
max1930.608-1930.596=0.012
mean2432.000-2800.000=-368.000
σ0.000
min2432.000-2800.000=-368.000
max2432.000-2800.000=-368.000
mean2.556-2.519=0.038
σ0.107-0.088=0.019
min2.469-2.438=0.030
max2.676-2.651=0.025
iters=5
new-facts=6402
prior-facts=1
mean4751.129-4750.972=0.157
σ0.949-0.985=-0.037
min4750.492-4750.345=0.147
max4752.789-4752.722=0.067
mean2432.000-2800.000=-368.000
σ0.000
min2432.000-2800.000=-368.000
max2432.000-2800.000=-368.000
mean8.285-8.501=-0.216
σ0.638-0.615=0.023
min7.751-7.602=0.148
max9.052-9.099=-0.048
iters=5
new-facts=6402
prior-facts=6402
mean4941.482-4941.492=-0.010
σ0.225-0.212=0.013
min4941.101-4941.130=-0.029
max4941.629-4941.634=-0.005
mean2971.000-3024.600=-53.600
σ435.568-221.344=214.224
min2480.000-2800.000=-320.000
max3565.000-3319.000=246.000
mean8.403-8.529=-0.126
σ0.096-0.218=-0.123
min8.322-8.335=-0.013
max8.557-8.804=-0.247

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.828-1.034=0.793
σ0.088-0.131=-0.043
min1.736-0.947=0.789
max1.971-1.247=0.724

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.351-466.363=-0.012
σ575.922-575.918=0.004
min178.387-178.394=-0.006
max1330.233-1330.240=-0.007
mean84.000
σ8.000
min80.000
max96.000
mean2432.000-2800.000=-368.000
σ0.000
min2432.000-2800.000=-368.000
max2432.000-2800.000=-368.000
mean0.565-0.443=0.122
σ0.566-0.307=0.259
min0.278-0.285=-0.007
max1.413-0.903=0.510
policies=20
mean1784.208-1784.251=-0.043
σ0.362-0.340=0.022
min1783.967-1784.014=-0.047
max1784.745-1784.751=-0.006
mean800.000
σ0.000
min800.000
max800.000
mean2432.000-2800.000=-368.000
σ0.000
min2432.000-2800.000=-368.000
max2432.000-2800.000=-368.000
mean2.800-2.860=-0.060
σ0.033-0.071=-0.038
min2.763-2.784=-0.021
max2.839-2.955=-0.116
policies=200
mean17848.806-17848.790=0.016
σ0.465-0.465=-0.000
min17848.509-17848.443=0.066
max17849.500-17849.473=0.026
mean8000.000
σ0.000
min8000.000
max8000.000
mean2432.000-2800.000=-368.000
σ0.000
min2432.000-2800.000=-368.000
max2432.000-2800.000=-368.000
mean27.997-27.948=0.049
σ0.044-0.176=-0.131
min27.953-27.738=0.215
max28.059-28.165=-0.106