Compare commits

Home / Compare 4bfedf92 .. 3c30c61a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.980=-0.001
σ0.050-0.048=0.002
min33.952-33.955=-0.003
max34.119-34.111=0.007
mean412.900-412.000=0.900
σ0.316-0.000=0.316
min412.000
max413.000-412.000=1.000
mean0.082-0.082=0.000
σ0.005-0.005=-0.001
min0.076-0.077=-0.001
max0.088-0.092=-0.004
cache=y
dps=1
iters=10
policies=100
mean23.318-23.318=0.000
σ0.003-0.002=0.000
min23.314-23.314=0.001
max23.323-23.321=0.002
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.066-0.065=0.000
σ0.003-0.003=-0.000
min0.064-0.064=0.000
max0.073-0.073=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.430-1757.428=0.003
σ0.365-0.364=0.001
min1756.853-1756.854=-0.001
max1758.017-1758.016=0.001
mean1663.450-1648.300=15.150
σ627.322-612.222=15.100
min669.000-677.000=-8.000
max2611.000-2630.000=-19.000
mean2.349-2.367=-0.018
σ0.129-0.093=0.035
min2.154-2.255=-0.101
max2.751-2.595=0.156

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.577-326.575=0.002
σ0.031-0.043=-0.012
min326.523-326.503=0.020
max326.597-326.616=-0.019
mean2611.000-2630.000=-19.000
σ0.000
min2611.000-2630.000=-19.000
max2611.000-2630.000=-19.000
mean0.422-0.424=-0.003
σ0.001-0.007=-0.006
min0.421-0.420=0.001
max0.423-0.436=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1988.742-1988.727=0.015
σ0.009-0.018=-0.008
min1988.728-1988.707=0.022
max1988.752-1988.749=0.003
mean2611.000-2630.000=-19.000
σ0.000
min2611.000-2630.000=-19.000
max2611.000-2630.000=-19.000
mean2.716-2.803=-0.088
σ0.053-0.283=-0.230
min2.657-2.632=0.025
max2.798-3.305=-0.506
iters=5
new-facts=6402
prior-facts=1
mean4813.402-4813.458=-0.057
σ7.183-7.778=-0.595
min4810.043-4809.613=0.430
max4826.250-4827.367=-1.117
mean2611.000-2630.000=-19.000
σ0.000
min2611.000-2630.000=-19.000
max2611.000-2630.000=-19.000
mean8.227-8.985=-0.758
σ0.552-0.192=0.360
min7.806-8.674=-0.869
max9.112-9.173=-0.061
iters=5
new-facts=6402
prior-facts=6402
mean5001.138-5001.146=-0.008
σ0.026-0.034=-0.008
min5001.105-5001.112=-0.007
max5001.160-5001.200=-0.040
mean2980.400-2989.800=-9.400
σ406.012-275.427=130.585
min2611.000-2630.000=-19.000
max3554.000-3317.000=237.000
mean9.807-9.752=0.054
σ0.174-0.388=-0.214
min9.574-9.113=0.461
max10.000-10.125=-0.125

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.252-1.118=0.134
σ0.409-0.304=0.104
min0.919-0.913=0.005
max1.824-1.652=0.172

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.566-464.571=-0.005
σ574.789-574.780=0.009
min177.168-177.172=-0.004
max1326.749-1326.741=0.008
mean88.250
σ8.500
min84.000
max101.000
mean2611.000-2630.000=-19.000
σ0.000
min2611.000-2630.000=-19.000
max2611.000-2630.000=-19.000
mean0.546-0.556=-0.011
σ0.544-0.568=-0.024
min0.271-0.270=0.001
max1.361-1.409=-0.047
policies=20
mean1772.028-1772.012=0.016
σ0.343-0.353=-0.010
min1771.799-1771.785=0.015
max1772.538-1772.538=-0.000
mean840.000
σ0.000
min840.000
max840.000
mean2611.000-2630.000=-19.000
σ0.000
min2611.000-2630.000=-19.000
max2611.000-2630.000=-19.000
mean2.711-2.728=-0.018
σ0.017-0.018=-0.001
min2.687-2.704=-0.017
max2.725-2.747=-0.022
policies=200
mean17727.642-17727.390=0.253
σ0.517-0.544=-0.027
min17727.343-17727.085=0.258
max17728.416-17728.205=0.211
mean8400.000
σ0.000
min8400.000
max8400.000
mean2611.000-2630.000=-19.000
σ0.000
min2611.000-2630.000=-19.000
max2611.000-2630.000=-19.000
mean27.497-27.481=0.016
σ0.128-0.093=0.035
min27.332-27.390=-0.058
max27.641-27.577=0.064