Compare commits

Home / Compare 6dc96158 .. 1bbb5ee4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.980=-0.000
σ0.049-0.047=0.002
min33.950-33.954=-0.004
max34.114-34.109=0.005
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.085-0.084=0.001
σ0.003-0.003=0.000
min0.083-0.082=0.001
max0.091-0.090=0.002
cache=y
dps=1
iters=10
policies=100
mean23.318-23.316=0.001
σ0.003-0.003=0.000
min23.314-23.313=0.000
max23.321-23.320=0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.065-0.064=0.001
σ0.002-0.005=-0.003
min0.064-0.059=0.005
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.364-1757.303=0.061
σ0.364-0.365=-0.000
min1756.787-1756.729=0.058
max1757.956-1757.890=0.066
mean1651.050-1646.200=4.850
σ630.695-630.783=-0.088
min638.000-624.000=14.000
max2837.000-2710.000=127.000
mean2.371-2.359=0.012
σ0.097-0.101=-0.004
min2.274-2.243=0.031
max2.679-2.626=0.054

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.505-326.443=0.062
σ0.058-0.062=-0.004
min326.402-326.335=0.066
max326.537-326.483=0.054
mean2837.000-2710.000=127.000
σ0.000
min2837.000-2710.000=127.000
max2837.000-2710.000=127.000
mean0.430-0.435=-0.005
σ0.007-0.016=-0.008
min0.424-0.421=0.003
max0.442-0.456=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1988.677-1988.611=0.066
σ0.007-0.010=-0.003
min1988.667-1988.595=0.073
max1988.684-1988.618=0.066
mean2837.000-2710.000=127.000
σ0.000
min2837.000-2710.000=127.000
max2837.000-2710.000=127.000
mean2.759-2.732=0.027
σ0.191-0.187=0.004
min2.651-2.610=0.041
max3.098-3.063=0.035
iters=5
new-facts=6402
prior-facts=1
mean4813.547-4813.502=0.046
σ7.739-7.691=0.048
min4809.973-4809.907=0.066
max4827.390-4827.257=0.134
mean2837.000-2710.000=127.000
σ0.000
min2837.000-2710.000=127.000
max2837.000-2710.000=127.000
mean8.561-8.407=0.154
σ0.489-0.695=-0.206
min7.942-7.743=0.199
max9.312-9.307=0.005
iters=5
new-facts=6402
prior-facts=6402
mean5001.070-5001.010=0.060
σ0.022-0.034=-0.012
min5001.045-5000.970=0.076
max5001.094-5001.059=0.035
mean3072.400-2988.000=84.400
σ312.470-315.048=-2.578
min2837.000-2710.000=127.000
max3558.000-3439.000=119.000
mean9.721-9.666=0.055
σ0.233-0.364=-0.131
min9.375-9.062=0.313
max10.004-10.051=-0.046

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.970-0.972=-0.001
σ0.049-0.072=-0.023
min0.940-0.909=0.032
max1.057-1.056=0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.506-464.436=0.071
σ574.773-574.771=0.002
min177.106-177.049=0.057
max1326.666-1326.592=0.074
mean88.250
σ8.500
min84.000
max101.000
mean2837.000-2710.000=127.000
σ0.000
min2837.000-2710.000=127.000
max2837.000-2710.000=127.000
mean0.440-0.548=-0.108
σ0.311-0.548=-0.237
min0.281-0.272=0.009
max0.908-1.370=-0.463
policies=20
mean1771.412-1770.772=0.640
σ0.359-0.358=0.001
min1771.157-1770.538=0.619
max1771.940-1771.304=0.635
mean840.000
σ0.000
min840.000
max840.000
mean2837.000-2710.000=127.000
σ0.000
min2837.000-2710.000=127.000
max2837.000-2710.000=127.000
mean2.825-2.755=0.070
σ0.019-0.069=-0.050
min2.806-2.702=0.104
max2.847-2.857=-0.010
policies=200
mean17721.057-17714.922=6.135
σ0.383-0.495=-0.112
min17720.749-17714.593=6.157
max17721.606-17715.658=5.948
mean8400.000
σ0.000
min8400.000
max8400.000
mean2837.000-2710.000=127.000
σ0.000
min2837.000-2710.000=127.000
max2837.000-2710.000=127.000
mean28.115-27.466=0.649
σ0.411-0.111=0.300
min27.757-27.339=0.418
max28.613-27.584=1.030