Compare commits

Home / Compare bfeb2be5 .. 00be7bdd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.946-53.947=-0.001
σ0.366-0.368=-0.003
min53.800-53.799=0.001
max54.986-54.995=-0.009
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.139-0.141=-0.002
σ0.004-0.006=-0.002
min0.131-0.136=-0.005
max0.145-0.151=-0.005
cache=y
dps=1
iters=10
policies=100
mean43.323-43.323=0.000
σ0.005-0.007=-0.002
min43.316-43.312=0.004
max43.332-43.336=-0.005
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.122-0.121=0.001
σ0.003-0.003=0.000
min0.119-0.116=0.003
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1010.691-1010.693=-0.002
σ1.185-1.162=0.023
min1010.137-1010.125=0.012
max1015.665-1015.559=0.107
mean1040.750-1052.350=-11.600
σ300.379-309.010=-8.631
min581.000-578.000=3.000
max1584.000-1645.000=-61.000
mean1.492-1.521=-0.029
σ0.117-0.099=0.019
min1.348-1.429=-0.080
max1.801-1.760=0.041

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.033-300.987=0.046
σ0.185-0.216=-0.031
min300.846-300.862=-0.016
max301.497-301.584=-0.087
mean1909.000-1895.000=14.000
σ0.000
min1909.000-1895.000=14.000
max1909.000-1895.000=14.000
mean0.578-0.554=0.024
σ0.046-0.036=0.010
min0.518-0.507=0.011
max0.689-0.608=0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean299.183-299.183=0.000
σ0.034-0.033=0.001
min299.146-299.146=-0.000
max299.225-299.225=0.000
mean1584.000-1645.000=-61.000
σ0.000
min1584.000-1645.000=-61.000
max1584.000-1645.000=-61.000
mean0.388-0.389=-0.001
σ0.007-0.009=-0.002
min0.383-0.382=0.001
max0.399-0.403=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1309.606-1309.617=-0.011
σ0.092-0.101=-0.009
min1309.483-1309.489=-0.006
max1309.717-1309.737=-0.020
mean1584.000-1645.000=-61.000
σ0.000
min1584.000-1645.000=-61.000
max1584.000-1645.000=-61.000
mean1.931-1.882=0.048
σ0.137-0.083=0.054
min1.794-1.801=-0.007
max2.154-1.992=0.162
iters=5
new-facts=6402
prior-facts=1
mean1553.691-1553.693=-0.001
σ6.853-6.852=0.001
min1550.366-1550.421=-0.055
max1565.944-1565.944=0.000
mean1584.000-1645.000=-61.000
σ0.000
min1584.000-1645.000=-61.000
max1584.000-1645.000=-61.000
mean2.192-2.260=-0.067
σ0.205-0.186=0.019
min1.999-2.045=-0.046
max2.430-2.435=-0.005
iters=5
new-facts=6402
prior-facts=6402
mean1871.492-1871.489=0.003
σ0.046-0.044=0.002
min1871.436-1871.433=0.004
max1871.536-1871.530=0.006
mean1770.400-1776.600=-6.200
σ147.317-120.759=26.558
min1584.000-1645.000=-61.000
max1909.000-1895.000=14.000
mean3.038-3.037=0.001
σ0.296-0.248=0.047
min2.781-2.795=-0.013
max3.513-3.450=0.063

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.193-1.225=-0.033
σ0.238-0.397=-0.159
min0.914-0.914=-0.001
max1.544-1.783=-0.238

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.454-444.452=0.003
σ575.147-575.144=0.003
min156.873-156.872=0.001
max1307.174-1307.168=0.007
mean96.250
σ8.500
min92.000
max109.000
mean1584.000-1645.000=-61.000
σ0.000
min1584.000-1645.000=-61.000
max1584.000-1645.000=-61.000
mean0.533-0.533=-0.000
σ0.542-0.540=0.002
min0.259-0.260=-0.002
max1.346-1.343=0.003
policies=20
mean1569.026-1569.015=0.011
σ0.318-0.332=-0.014
min1568.846-1568.827=0.019
max1569.503-1569.513=-0.010
mean920.000
σ0.000
min920.000
max920.000
mean1584.000-1645.000=-61.000
σ0.000
min1584.000-1645.000=-61.000
max1584.000-1645.000=-61.000
mean2.609-2.624=-0.015
σ0.018-0.008=0.009
min2.590-2.614=-0.024
max2.628-2.631=-0.003
policies=200
mean15697.977-15697.769=0.208
σ0.164-0.297=-0.133
min15697.807-15697.357=0.449
max15698.198-15697.991=0.207
mean9200.000
σ0.000
min9200.000
max9200.000
mean1584.000-1645.000=-61.000
σ0.000
min1584.000-1645.000=-61.000
max1584.000-1645.000=-61.000
mean26.493-26.431=0.061
σ0.241-0.153=0.088
min26.280-26.246=0.034
max26.811-26.582=0.229