Compare commits

Home / Compare 87cbb2fe .. 437a61c8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.563=0.001
σ0.046-0.044=0.001
min70.539-70.536=0.003
max70.692-70.687=0.005
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.161-0.158=0.003
σ0.003-0.004=-0.001
min0.157-0.153=0.004
max0.168-0.167=0.001
cache=y
dps=1
iters=10
policies=100
mean21.289-21.288=0.000
σ0.003-0.002=0.000
min21.284-21.285=-0.001
max21.292-21.291=0.000
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.064-0.064=-0.000
σ0.003-0.002=0.000
min0.059-0.062=-0.003
max0.069-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.375=-0.000
σ0.359-0.360=-0.001
min1752.798-1752.801=-0.003
max1753.941-1753.959=-0.017
mean1644.200-1661.100=-16.900
σ636.569-637.988=-1.419
min635.000-685.000=-50.000
max2857.000-2765.000=92.000
mean2.812-2.822=-0.010
σ0.162-0.116=0.046
min2.325-2.561=-0.236
max3.086-3.126=-0.040

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.758-271.756=0.002
σ0.009-0.008=0.000
min271.744-271.743=0.001
max271.767-271.766=0.001
mean2857.000-2765.000=92.000
σ0.000
min2857.000-2765.000=92.000
max2857.000-2765.000=92.000
mean0.386-0.385=0.000
σ0.004-0.011=-0.007
min0.380-0.379=0.001
max0.390-0.405=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1932.177-1932.171=0.006
σ0.009-0.004=0.004
min1932.170-1932.165=0.005
max1932.188-1932.176=0.011
mean2857.000-2765.000=92.000
σ0.000
min2857.000-2765.000=92.000
max2857.000-2765.000=92.000
mean3.059-3.026=0.033
σ0.143-0.060=0.083
min2.930-2.983=-0.053
max3.298-3.115=0.183
iters=5
new-facts=6402
prior-facts=1
mean4752.942-4752.838=0.103
σ0.912-1.022=-0.110
min4752.361-4751.959=0.402
max4754.544-4754.596=-0.052
mean2857.000-2765.000=92.000
σ0.000
min2857.000-2765.000=92.000
max2857.000-2765.000=92.000
mean8.300-8.411=-0.112
σ0.799-0.484=0.315
min7.476-7.980=-0.505
max9.214-9.173=0.041
iters=5
new-facts=6402
prior-facts=6402
mean4943.372-4943.380=-0.009
σ0.028-0.017=0.010
min4943.337-4943.364=-0.028
max4943.398-4943.401=-0.003
mean3060.600-3044.600=16.000
σ263.250-242.451=20.799
min2857.000-2765.000=92.000
max3465.000-3382.000=83.000
mean8.410-8.601=-0.191
σ0.130-0.237=-0.106
min8.253-8.361=-0.107
max8.596-8.894=-0.298

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.993-1.042=-0.049
σ0.131-0.128=0.003
min0.931-0.925=0.006
max1.227-1.237=-0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.865-467.864=0.002
σ575.932-575.922=0.010
min179.891-179.895=-0.004
max1331.763-1331.746=0.017
mean86.250
σ8.500
min82.000
max99.000
mean2857.000-2765.000=92.000
σ0.000
min2857.000-2765.000=92.000
max2857.000-2765.000=92.000
mean0.434-0.470=-0.036
σ0.275-0.255=0.020
min0.292-0.289=0.003
max0.847-0.832=0.014
policies=20
mean1799.176-1799.177=-0.001
σ0.372-0.345=0.027
min1798.924-1798.921=0.003
max1799.723-1799.686=0.038
mean820.000
σ0.000
min820.000
max820.000
mean2857.000-2765.000=92.000
σ0.000
min2857.000-2765.000=92.000
max2857.000-2765.000=92.000
mean2.896-2.804=0.093
σ0.005-0.018=-0.013
min2.890-2.785=0.104
max2.900-2.823=0.077
policies=200
mean17998.514-17998.407=0.107
σ0.502-0.604=-0.102
min17998.245-17998.033=0.212
max17999.266-17999.308=-0.042
mean8200.000
σ0.000
min8200.000
max8200.000
mean2857.000-2765.000=92.000
σ0.000
min2857.000-2765.000=92.000
max2857.000-2765.000=92.000
mean28.597-28.146=0.451
σ0.425-0.100=0.325
min28.202-28.084=0.118
max29.188-28.294=0.894