Compare commits

Home / Compare 11d33ee9 .. e71b1ace

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.431-54.431=-0.000
σ0.050-0.050=-0.000
min54.393-54.392=0.002
max54.567-54.569=-0.003
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.134-0.135=-0.001
σ0.003-0.006=-0.003
min0.132-0.128=0.004
max0.140-0.147=-0.007
cache=y
dps=1
iters=10
policies=100
mean43.760-43.762=-0.002
σ0.006-0.004=0.002
min43.749-43.755=-0.007
max43.771-43.770=0.002
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.116-0.114=0.002
σ0.004-0.003=0.001
min0.111-0.110=0.001
max0.123-0.122=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1764.849-1764.852=-0.002
σ0.364-0.365=-0.001
min1764.274-1764.272=0.002
max1765.434-1765.430=0.004
mean1650.750-1636.050=14.700
σ615.100-622.371=-7.271
min639.000-628.000=11.000
max2480.000-2764.000=-284.000
mean2.531-2.656=-0.125
σ0.212-0.321=-0.109
min2.303-2.301=0.002
max2.890-3.449=-0.559

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean345.202-345.188=0.014
σ0.068-0.066=0.002
min345.080-345.071=0.010
max345.241-345.226=0.015
mean2480.000-2764.000=-284.000
σ0.000
min2480.000-2764.000=-284.000
max2480.000-2764.000=-284.000
mean0.444-0.447=-0.004
σ0.006-0.006=0.001
min0.440-0.443=-0.003
max0.455-0.457=-0.002
iters=5
new-facts=1
prior-facts=6402
mean2007.357-2007.370=-0.014
σ0.013-0.010=0.004
min2007.342-2007.357=-0.014
max2007.374-2007.382=-0.008
mean2480.000-2764.000=-284.000
σ0.000
min2480.000-2764.000=-284.000
max2480.000-2764.000=-284.000
mean2.722-2.737=-0.015
σ0.148-0.162=-0.014
min2.595-2.612=-0.017
max2.979-2.956=0.023
iters=5
new-facts=6402
prior-facts=1
mean4832.258-4832.270=-0.012
σ7.727-7.742=-0.015
min4828.709-4828.664=0.045
max4846.079-4846.118=-0.039
mean2480.000-2764.000=-284.000
σ0.000
min2480.000-2764.000=-284.000
max2480.000-2764.000=-284.000
mean8.800-8.585=0.215
σ0.617-0.658=-0.040
min7.741-7.677=0.064
max9.301-9.301=-0.001
iters=5
new-facts=6402
prior-facts=6402
mean5019.768-5019.699=0.069
σ0.015-0.151=-0.136
min5019.752-5019.431=0.321
max5019.784-5019.788=-0.004
mean2982.600-3009.600=-27.000
σ284.341-234.295=50.046
min2590.000-2764.000=-174.000
max3318.000
mean9.690-9.874=-0.184
σ0.141-0.152=-0.012
min9.531-9.700=-0.169
max9.826-10.077=-0.251

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.627-1.024=0.603
σ0.151-0.177=-0.026
min1.419-0.918=0.500
max1.813-1.330=0.482

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.704-466.719=-0.015
σ574.763-574.778=-0.015
min179.320-179.313=0.008
max1328.848-1328.886=-0.038
mean90.250
σ8.500
min86.000
max103.000
mean2480.000-2764.000=-284.000
σ0.000
min2480.000-2764.000=-284.000
max2480.000-2764.000=-284.000
mean0.556-0.591=-0.036
σ0.556-0.501=0.055
min0.274-0.285=-0.011
max1.390-1.333=0.057
policies=20
mean1793.474-1793.486=-0.012
σ0.388-0.322=0.066
min1793.208-1793.221=-0.013
max1794.050-1793.954=0.095
mean860.000
σ0.000
min860.000
max860.000
mean2480.000-2764.000=-284.000
σ0.000
min2480.000-2764.000=-284.000
max2480.000-2764.000=-284.000
mean2.747-2.752=-0.005
σ0.008-0.021=-0.013
min2.739-2.726=0.014
max2.756-2.770=-0.014
policies=200
mean17942.019-17942.146=-0.127
σ0.548-0.528=0.020
min17941.694-17941.858=-0.164
max17942.838-17942.937=-0.099
mean8600.000
σ0.000
min8600.000
max8600.000
mean2480.000-2764.000=-284.000
σ0.000
min2480.000-2764.000=-284.000
max2480.000-2764.000=-284.000
mean27.734-27.755=-0.021
σ0.152-0.143=0.009
min27.620-27.623=-0.003
max27.958-27.900=0.058