Compare commits

Home / Compare 2eaa3c56 .. 7fcef0d5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.977-33.980=-0.003
σ0.048-0.048=0.000
min33.953-33.955=-0.001
max34.112-34.111=0.000
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.080-0.082=-0.002
σ0.004-0.005=-0.001
min0.076-0.077=-0.001
max0.087-0.092=-0.004
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.004-0.002=0.001
min23.311-23.314=-0.002
max23.323-23.321=0.002
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.064-0.065=-0.002
σ0.004-0.003=0.002
min0.059-0.064=-0.005
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.426-1757.428=-0.002
σ0.364-0.364=0.000
min1756.855-1756.854=0.001
max1758.013-1758.016=-0.004
mean1655.650-1648.300=7.350
σ643.387-612.222=31.165
min620.000-677.000=-57.000
max2739.000-2630.000=109.000
mean2.401-2.367=0.034
σ0.235-0.093=0.142
min2.191-2.255=-0.064
max3.335-2.595=0.739

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.540-326.575=-0.035
σ0.051-0.043=0.009
min326.448-326.503=-0.055
max326.570-326.616=-0.046
mean2739.000-2630.000=109.000
σ0.000
min2739.000-2630.000=109.000
max2739.000-2630.000=109.000
mean0.430-0.424=0.005
σ0.007-0.007=0.000
min0.421-0.420=0.001
max0.437-0.436=0.001
iters=5
new-facts=1
prior-facts=6402
mean1988.734-1988.727=0.007
σ0.007-0.018=-0.010
min1988.726-1988.707=0.020
max1988.745-1988.749=-0.005
mean2739.000-2630.000=109.000
σ0.000
min2739.000-2630.000=109.000
max2739.000-2630.000=109.000
mean2.768-2.803=-0.035
σ0.146-0.283=-0.138
min2.564-2.632=-0.068
max2.932-3.305=-0.373
iters=5
new-facts=6402
prior-facts=1
mean4813.358-4813.458=-0.100
σ7.847-7.778=0.069
min4809.515-4809.613=-0.098
max4827.386-4827.367=0.019
mean2739.000-2630.000=109.000
σ0.000
min2739.000-2630.000=109.000
max2739.000-2630.000=109.000
mean8.475-8.985=-0.510
σ0.606-0.192=0.414
min7.727-8.674=-0.948
max9.206-9.173=0.033
iters=5
new-facts=6402
prior-facts=6402
mean5001.063-5001.146=-0.083
σ0.165-0.034=0.130
min5000.771-5001.112=-0.341
max5001.160-5001.200=-0.040
mean2983.000-2989.800=-6.800
σ295.019-275.427=19.592
min2739.000-2630.000=109.000
max3423.000-3317.000=106.000
mean9.592-9.752=-0.160
σ0.562-0.388=0.174
min8.598-9.113=-0.515
max9.938-10.125=-0.187

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.005-1.118=-0.113
σ0.142-0.304=-0.162
min0.912-0.913=-0.002
max1.239-1.652=-0.414

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.566-464.571=-0.005
σ574.768-574.780=-0.012
min177.173-177.172=0.002
max1326.718-1326.741=-0.023
mean88.250
σ8.500
min84.000
max101.000
mean2739.000-2630.000=109.000
σ0.000
min2739.000-2630.000=109.000
max2739.000-2630.000=109.000
mean0.552-0.556=-0.005
σ0.556-0.568=-0.012
min0.272-0.270=0.002
max1.386-1.409=-0.023
policies=20
mean1772.015-1772.012=0.003
σ0.339-0.353=-0.014
min1771.794-1771.785=0.010
max1772.519-1772.538=-0.019
mean840.000
σ0.000
min840.000
max840.000
mean2739.000-2630.000=109.000
σ0.000
min2739.000-2630.000=109.000
max2739.000-2630.000=109.000
mean2.712-2.728=-0.017
σ0.014-0.018=-0.003
min2.696-2.704=-0.008
max2.731-2.747=-0.016
policies=200
mean17727.531-17727.390=0.141
σ0.520-0.544=-0.025
min17727.220-17727.085=0.135
max17728.303-17728.205=0.098
mean8400.000
σ0.000
min8400.000
max8400.000
mean2739.000-2630.000=109.000
σ0.000
min2739.000-2630.000=109.000
max2739.000-2630.000=109.000
mean27.606-27.481=0.124
σ0.062-0.093=-0.031
min27.515-27.390=0.125
max27.648-27.577=0.072