Compare commits

Home / Compare 80c34bf3 .. aa8e937d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.376=-0.002
σ0.045-0.046=-0.001
min70.347-70.346=0.001
max70.499-70.505=-0.006
mean419.000-413.000=6.000
σ0.000
min419.000-413.000=6.000
max419.000-413.000=6.000
mean0.158-0.160=-0.002
σ0.004-0.003=0.001
min0.150-0.156=-0.005
max0.165-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.141-21.141=0.000
σ0.002-0.003=-0.000
min21.137-21.137=0.001
max21.144-21.145=-0.001
mean419.000-413.000=6.000
σ0.000
min419.000-413.000=6.000
max419.000-413.000=6.000
mean0.064-0.065=-0.001
σ0.003-0.003=-0.000
min0.062-0.062=-0.000
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.387-1752.387=0.000
σ0.362-0.362=0.000
min1751.818-1751.819=-0.001
max1752.968-1752.968=0.000
mean1648.800-1658.900=-10.100
σ628.219-622.914=5.305
min639.000-657.000=-18.000
max2849.000-2504.000=345.000
mean2.805-2.781=0.023
σ0.153-0.220=-0.067
min2.264-2.282=-0.018
max3.008-3.077=-0.069

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.114-270.127=-0.013
σ0.012-0.006=0.006
min270.097-270.117=-0.020
max270.127-270.134=-0.007
mean2849.000-2504.000=345.000
σ0.000
min2849.000-2504.000=345.000
max2849.000-2504.000=345.000
mean0.386-0.381=0.004
σ0.006-0.003=0.003
min0.380-0.379=0.001
max0.395-0.387=0.008
iters=5
new-facts=1
prior-facts=6402
mean1930.593-1930.598=-0.005
σ0.007-0.008=-0.001
min1930.583-1930.588=-0.005
max1930.603-1930.608=-0.005
mean2849.000-2504.000=345.000
σ0.000
min2849.000-2504.000=345.000
max2849.000-2504.000=345.000
mean2.487-2.495=-0.009
σ0.057-0.041=0.016
min2.440-2.463=-0.023
max2.578-2.564=0.014
iters=5
new-facts=6402
prior-facts=1
mean4751.090-4750.860=0.230
σ0.893-1.106=-0.213
min4750.509-4749.966=0.543
max4752.667-4752.783=-0.116
mean2849.000-2504.000=345.000
σ0.000
min2849.000-2504.000=345.000
max2849.000-2504.000=345.000
mean8.558-8.663=-0.104
σ0.465-0.556=-0.091
min7.996-7.710=0.286
max9.077-9.055=0.021
iters=5
new-facts=6402
prior-facts=6402
mean4941.491-4941.561=-0.070
σ0.214-0.076=0.138
min4941.127-4941.475=-0.348
max4941.627-4941.627=0.000
mean3057.000-2988.000=69.000
σ185.451-282.571=-97.120
min2849.000-2600.000=249.000
max3321.000-3323.000=-2.000
mean8.528-8.467=0.061
σ0.133-0.129=0.004
min8.380-8.372=0.008
max8.716-8.681=0.034

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.153-1.697=-0.544
σ0.248-0.200=0.048
min0.945-1.414=-0.469
max1.531-1.937=-0.407

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.359-466.354=0.005
σ575.930-575.919=0.011
min178.390-178.391=-0.000
max1330.255-1330.233=0.022
mean84.000
σ8.000
min80.000
max96.000
mean2849.000-2504.000=345.000
σ0.000
min2849.000-2504.000=345.000
max2849.000-2504.000=345.000
mean0.443-0.557=-0.114
σ0.309-0.548=-0.239
min0.285-0.278=0.007
max0.906-1.378=-0.473
policies=20
mean1784.256-1784.209=0.046
σ0.369-0.351=0.018
min1783.993-1783.987=0.006
max1784.799-1784.732=0.067
mean800.000
σ0.000
min800.000
max800.000
mean2849.000-2504.000=345.000
σ0.000
min2849.000-2504.000=345.000
max2849.000-2504.000=345.000
mean2.861-2.769=0.092
σ0.013-0.016=-0.002
min2.846-2.759=0.088
max2.873-2.792=0.081
policies=200
mean17848.826-17848.689=0.137
σ0.374-0.382=-0.008
min17848.595-17848.416=0.179
max17849.380-17849.252=0.128
mean8000.000
σ0.000
min8000.000
max8000.000
mean2849.000-2504.000=345.000
σ0.000
min2849.000-2504.000=345.000
max2849.000-2504.000=345.000
mean28.431-27.891=0.540
σ0.569-0.040=0.529
min27.917-27.841=0.076
max28.962-27.932=1.030