Compare commits

Home / Compare d840204a .. 4ac2da06

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.729-70.732=-0.003
σ0.053-0.053=0.000
min70.699-70.703=-0.004
max70.875-70.878=-0.003
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.158-0.160=-0.003
σ0.006-0.004=0.002
min0.149-0.153=-0.004
max0.167-0.164=0.003
cache=y
dps=1
iters=10
policies=100
mean21.447-21.446=0.002
σ0.003-0.003=-0.000
min21.444-21.441=0.003
max21.451-21.449=0.002
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.066-0.064=0.002
σ0.003-0.003=-0.000
min0.063-0.060=0.003
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.526-1754.528=-0.001
σ0.363-0.361=0.001
min1753.948-1753.961=-0.013
max1755.113-1755.116=-0.002
mean1664.100-1665.400=-1.300
σ631.220-621.107=10.114
min621.000-695.000=-74.000
max2679.000-2841.000=-162.000
mean2.820-2.852=-0.032
σ0.134-0.098=0.036
min2.391-2.672=-0.281
max3.034-3.064=-0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.586-273.613=-0.027
σ0.009-0.006=0.004
min273.572-273.608=-0.036
max273.595-273.622=-0.027
mean2679.000-2841.000=-162.000
σ0.000
min2679.000-2841.000=-162.000
max2679.000-2841.000=-162.000
mean0.388-0.384=0.004
σ0.006-0.002=0.004
min0.384-0.381=0.003
max0.398-0.386=0.013
iters=5
new-facts=1
prior-facts=6402
mean1934.002-1933.990=0.012
σ0.010-0.012=-0.002
min1933.987-1933.973=0.014
max1934.015-1934.002=0.014
mean2679.000-2841.000=-162.000
σ0.000
min2679.000-2841.000=-162.000
max2679.000-2841.000=-162.000
mean3.083-3.011=0.071
σ0.085-0.071=0.014
min3.013-2.939=0.074
max3.212-3.109=0.103
iters=5
new-facts=6402
prior-facts=1
mean4754.844-4754.652=0.192
σ0.825-0.658=0.166
min4754.388-4754.259=0.129
max4756.316-4755.819=0.497
mean2679.000-2841.000=-162.000
σ0.000
min2679.000-2841.000=-162.000
max2679.000-2841.000=-162.000
mean7.984-8.629=-0.645
σ0.356-0.679=-0.322
min7.784-7.432=0.352
max8.615-9.072=-0.457
iters=5
new-facts=6402
prior-facts=6402
mean4945.217-4945.155=0.061
σ0.007-0.165=-0.158
min4945.209-4944.863=0.346
max4945.225-4945.254=-0.029
mean2995.200-3015.800=-20.600
σ361.763-194.172=167.591
min2679.000-2841.000=-162.000
max3523.000-3313.000=210.000
mean8.482-8.503=-0.020
σ0.124-0.079=0.045
min8.373-8.426=-0.053
max8.646-8.597=0.049

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.218-1.036=0.182
σ0.324-0.235=0.089
min0.937-0.928=0.010
max1.574-1.456=0.119

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean469.476-469.482=-0.007
σ574.938-574.935=0.003
min182.005-182.004=0.001
max1331.883-1331.885=-0.001
mean88.250
σ8.500
min84.000
max101.000
mean2679.000-2841.000=-162.000
σ0.000
min2679.000-2841.000=-162.000
max2679.000-2841.000=-162.000
mean0.555-0.449=0.106
σ0.532-0.304=0.228
min0.284-0.295=-0.011
max1.353-0.906=0.448
policies=20
mean1820.344-1820.381=-0.037
σ0.383-0.383=-0.000
min1820.088-1820.098=-0.010
max1820.912-1820.943=-0.031
mean840.000
σ0.000
min840.000
max840.000
mean2679.000-2841.000=-162.000
σ0.000
min2679.000-2841.000=-162.000
max2679.000-2841.000=-162.000
mean2.831-2.915=-0.084
σ0.009-0.005=0.004
min2.820-2.908=-0.087
max2.843-2.919=-0.076
policies=200
mean18210.407-18210.581=-0.174
σ0.567-0.434=0.134
min18210.066-18210.326=-0.260
max18211.253-18211.230=0.023
mean8400.000
σ0.000
min8400.000
max8400.000
mean2679.000-2841.000=-162.000
σ0.000
min2679.000-2841.000=-162.000
max2679.000-2841.000=-162.000
mean28.549-28.875=-0.326
σ0.043-0.458=-0.415
min28.505-28.472=0.034
max28.595-29.426=-0.832