Compare commits

Home / Compare 01805f58 .. 94583148

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.379-70.379=-0.000
σ0.045-0.044=0.001
min70.353-70.353=0.000
max70.505-70.502=0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.159-0.158=0.002
σ0.005-0.004=0.000
min0.150-0.150=-0.000
max0.168-0.164=0.004
cache=y
dps=1
iters=10
policies=100
mean21.142-21.144=-0.002
σ0.004-0.003=0.001
min21.137-21.140=-0.003
max21.149-21.148=0.001
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.062-0.064=-0.002
σ0.004-0.002=0.001
min0.059-0.062=-0.003
max0.071-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.386-1752.386=0.000
σ0.359-0.359=-0.000
min1751.819-1751.819=-0.001
max1752.967-1752.987=-0.020
mean1661.750-1658.800=2.950
σ641.739-628.920=12.818
min619.000
max2835.000-2773.000=62.000
mean2.799-2.826=-0.027
σ0.189-0.144=0.045
min2.163-2.515=-0.352
max2.949-3.080=-0.131

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.126-270.123=0.003
σ0.011-0.006=0.006
min270.107-270.116=-0.009
max270.136-270.130=0.006
mean2835.000-2773.000=62.000
σ0.000
min2835.000-2773.000=62.000
max2835.000-2773.000=62.000
mean0.376-0.373=0.003
σ0.005-0.004=0.001
min0.372-0.370=0.001
max0.382-0.380=0.002
iters=5
new-facts=1
prior-facts=6402
mean1930.585-1930.585=0.000
σ0.017-0.015=0.002
min1930.560-1930.568=-0.008
max1930.607-1930.605=0.002
mean2835.000-2773.000=62.000
σ0.000
min2835.000-2773.000=62.000
max2835.000-2773.000=62.000
mean2.475-2.636=-0.160
σ0.088-0.254=-0.166
min2.377-2.398=-0.021
max2.576-3.054=-0.478
iters=5
new-facts=6402
prior-facts=1
mean4751.127-4751.036=0.092
σ0.784-0.863=-0.078
min4750.645-4750.258=0.387
max4752.520-4752.515=0.005
mean2835.000-2773.000=62.000
σ0.000
min2835.000-2773.000=62.000
max2835.000-2773.000=62.000
mean8.125-7.967=0.159
σ0.379-0.255=0.124
min7.694-7.752=-0.058
max8.528-8.402=0.126
iters=5
new-facts=6402
prior-facts=6402
mean4941.523-4941.385=0.138
σ0.080-0.276=-0.196
min4941.450-4940.904=0.546
max4941.611-4941.612=-0.000
mean3049.400-3041.200=8.200
σ275.915-325.362=-49.447
min2835.000-2773.000=62.000
max3470.000-3526.000=-56.000
mean8.421-8.433=-0.012
σ0.098-0.084=0.013
min8.349-8.337=0.012
max8.593-8.544=0.049

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.065-1.043=0.023
σ0.129-0.131=-0.003
min0.947-0.952=-0.004
max1.262-1.259=0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.365-466.364=0.001
σ575.938-575.941=-0.003
min178.393-178.391=0.002
max1330.271-1330.275=-0.003
mean84.250
σ8.500
min80.000
max97.000
mean2835.000-2773.000=62.000
σ0.000
min2835.000-2773.000=62.000
max2835.000-2773.000=62.000
mean0.445-0.444=0.000
σ0.310-0.309=0.001
min0.288-0.285=0.002
max0.909-0.907=0.002
policies=20
mean1784.266-1784.249=0.017
σ0.350-0.341=0.009
min1784.027-1784.010=0.017
max1784.783-1784.744=0.040
mean800.000
σ0.000
min800.000
max800.000
mean2835.000-2773.000=62.000
σ0.000
min2835.000-2773.000=62.000
max2835.000-2773.000=62.000
mean2.850-2.838=0.011
σ0.028-0.119=-0.091
min2.809-2.763=0.046
max2.874-3.016=-0.142
policies=200
mean17848.895-17848.774=0.121
σ0.516-0.420=0.096
min17848.603-17848.446=0.157
max17849.668-17849.388=0.280
mean8000.000
σ0.000
min8000.000
max8000.000
mean2835.000-2773.000=62.000
σ0.000
min2835.000-2773.000=62.000
max2835.000-2773.000=62.000
mean28.013-28.012=0.001
σ0.168-0.116=0.052
min27.866-27.931=-0.065
max28.180-28.183=-0.003