Compare commits

Home / Compare 358478e8 .. e84322ca

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.374=0.000
σ0.059-0.059=0.000
min70.331-70.333=-0.003
max70.539-70.538=0.001
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.160-0.159=0.000
σ0.005-0.003=0.001
min0.152-0.155=-0.003
max0.165-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.142=0.002
σ0.002-0.003=-0.001
min21.141-21.139=0.002
max21.147-21.146=0.001
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.063-0.062=0.001
σ0.003-0.003=-0.001
min0.059-0.058=0.001
max0.070-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.200-1752.200=-0.001
σ0.362-0.362=-0.000
min1751.627-1751.629=-0.002
max1752.769-1752.783=-0.014
mean1651.300-1652.850=-1.550
σ645.158-645.010=0.148
min645.000-647.000=-2.000
max2846.000
mean2.869-2.766=0.104
σ0.101-0.204=-0.103
min2.620-2.292=0.327
max3.023-3.139=-0.116

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.935-269.931=0.004
σ0.009-0.010=-0.001
min269.922-269.919=0.003
max269.944-269.945=-0.002
mean2846.000
σ0.000
min2846.000
max2846.000
mean0.380-0.374=0.007
σ0.007-0.007=-0.000
min0.377-0.368=0.009
max0.392-0.386=0.006
iters=5
new-facts=1
prior-facts=6402
mean1930.394-1930.401=-0.007
σ0.010-0.004=0.005
min1930.382-1930.396=-0.014
max1930.409-1930.407=0.002
mean2846.000
σ0.000
min2846.000
max2846.000
mean2.548-2.565=-0.017
σ0.071-0.089=-0.017
min2.482-2.471=0.011
max2.637-2.666=-0.029
iters=5
new-facts=6402
prior-facts=1
mean4750.887-4750.633=0.253
σ0.801-1.078=-0.277
min4750.448-4749.751=0.697
max4752.318-4752.460=-0.143
mean2846.000
σ0.000
min2846.000
max2846.000
mean8.258-8.686=-0.428
σ0.290-0.622=-0.332
min7.892-7.605=0.287
max8.581-9.132=-0.551
iters=5
new-facts=6402
prior-facts=6402
mean4941.332-4941.336=-0.004
σ0.088-0.078=0.009
min4941.253-4941.271=-0.018
max4941.433-4941.431=0.002
mean3102.000-3101.600=0.400
σ298.480-259.112=39.369
min2846.000
max3517.000-3364.000=153.000
mean8.666-8.744=-0.078
σ0.364-0.240=0.124
min8.301-8.436=-0.135
max9.182-8.972=0.211

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.133-1.028=0.105
σ0.171-0.139=0.033
min0.934-0.933=0.001
max1.347-1.257=0.090

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.918-465.914=0.003
σ575.767-575.755=0.012
min178.023-178.029=-0.006
max1329.569-1329.547=0.022
mean81.750
σ7.500
min78.000
max93.000
mean2846.000
σ0.000
min2846.000
max2846.000
mean0.442-0.440=0.002
σ0.302-0.307=-0.005
min0.286-0.283=0.003
max0.895-0.899=-0.005
policies=20
mean1780.508-1780.509=-0.001
σ0.349-0.348=0.000
min1780.252-1780.271=-0.018
max1781.017-1781.024=-0.007
mean780.000
σ0.000
min780.000
max780.000
mean2846.000
σ0.000
min2846.000
max2846.000
mean2.841-2.826=0.015
σ0.015-0.040=-0.025
min2.832-2.768=0.063
max2.863-2.857=0.006
policies=200
mean17811.435-17811.460=-0.025
σ0.525-0.557=-0.032
min17811.034-17810.976=0.058
max17812.185-17812.245=-0.060
mean7800.000
σ0.000
min7800.000
max7800.000
mean2846.000
σ0.000
min2846.000
max2846.000
mean28.241-28.377=-0.136
σ0.452-0.532=-0.080
min27.807-27.790=0.017
max28.665-28.988=-0.323