Compare commits

Home / Compare 735003af .. d7f77afa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.979=-0.001
σ0.050-0.051=-0.001
min33.950-33.942=0.007
max34.119-34.121=-0.002
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.083-0.084=-0.001
σ0.005-0.003=0.002
min0.075-0.082=-0.006
max0.092-0.091=0.001
cache=y
dps=1
iters=10
policies=100
mean23.316-23.318=-0.002
σ0.003-0.004=-0.001
min23.314-23.313=0.001
max23.323-23.328=-0.005
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.065-0.064=0.001
σ0.003-0.005=-0.001
min0.063-0.060=0.004
max0.074-0.073=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.427-1757.302=0.125
σ0.365-0.364=0.000
min1756.852-1756.730=0.123
max1758.019-1757.893=0.126
mean1651.200-1643.850=7.350
σ624.362-624.447=-0.085
min676.000-634.000=42.000
max2590.000-2829.000=-239.000
mean2.373-2.346=0.026
σ0.116-0.088=0.028
min2.220-2.251=-0.031
max2.674-2.595=0.078

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.563-326.456=0.107
σ0.065-0.031=0.034
min326.448-326.402=0.046
max326.604-326.475=0.129
mean2590.000-2829.000=-239.000
σ0.000
min2590.000-2829.000=-239.000
max2590.000-2829.000=-239.000
mean0.426-0.433=-0.007
σ0.010-0.012=-0.002
min0.420-0.423=-0.003
max0.444-0.452=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1988.706-1988.609=0.096
σ0.041-0.020=0.021
min1988.648-1988.576=0.072
max1988.748-1988.625=0.123
mean2590.000-2829.000=-239.000
σ0.000
min2590.000-2829.000=-239.000
max2590.000-2829.000=-239.000
mean2.668-2.669=-0.001
σ0.060-0.039=0.021
min2.615-2.621=-0.006
max2.764-2.730=0.034
iters=5
new-facts=6402
prior-facts=1
mean4813.507-4813.329=0.178
σ7.764-7.790=-0.026
min4809.700-4809.483=0.217
max4827.390-4827.259=0.131
mean2590.000-2829.000=-239.000
σ0.000
min2590.000-2829.000=-239.000
max2590.000-2829.000=-239.000
mean8.441-8.811=-0.370
σ0.533-0.215=0.318
min7.708-8.535=-0.827
max9.107-8.984=0.122
iters=5
new-facts=6402
prior-facts=6402
mean5001.128-5000.890=0.237
σ0.014-0.191=-0.177
min5001.113-5000.674=0.439
max5001.146-5001.047=0.099
mean2921.000-3031.600=-110.600
σ253.447-205.247=48.200
min2590.000-2829.000=-239.000
max3266.000-3312.000=-46.000
mean9.471-9.874=-0.403
σ0.642-0.539=0.102
min8.343-8.930=-0.587
max9.848-10.253=-0.404

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.246-0.946=0.300
σ0.395-0.060=0.334
min0.917-0.910=0.007
max1.784-1.052=0.733

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.566-464.433=0.133
σ574.790-574.774=0.016
min177.163-177.042=0.121
max1326.751-1326.594=0.158
mean88.250
σ8.500
min84.000
max101.000
mean2590.000-2829.000=-239.000
σ0.000
min2590.000-2829.000=-239.000
max2590.000-2829.000=-239.000
mean0.556-0.433=0.123
σ0.569-0.301=0.268
min0.269-0.279=-0.010
max1.409-0.884=0.525
policies=20
mean1772.014-1770.797=1.217
σ0.345-0.363=-0.018
min1771.779-1770.548=1.231
max1772.525-1771.333=1.192
mean840.000
σ0.000
min840.000
max840.000
mean2590.000-2829.000=-239.000
σ0.000
min2590.000-2829.000=-239.000
max2590.000-2829.000=-239.000
mean2.702-2.802=-0.100
σ0.012-0.018=-0.006
min2.687-2.783=-0.096
max2.714-2.818=-0.104
policies=200
mean17727.458-17714.834=12.624
σ0.477-0.593=-0.116
min17727.185-17714.347=12.838
max17728.173-17715.688=12.485
mean8400.000
σ0.000
min8400.000
max8400.000
mean2590.000-2829.000=-239.000
σ0.000
min2590.000-2829.000=-239.000
max2590.000-2829.000=-239.000
mean27.467-27.886=-0.420
σ0.153-0.685=-0.532
min27.302-27.234=0.068
max27.661-28.767=-1.106