Compare commits

Home / Compare be95ccd1 .. fc371add

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.001
σ0.048-0.051=-0.003
min33.952-33.942=0.010
max34.111-34.118=-0.007
mean413.000-418.900=-5.900
σ0.000-0.316=-0.316
min413.000-418.000=-5.000
max413.000-419.000=-6.000
mean0.083-0.085=-0.001
σ0.005-0.003=0.002
min0.077-0.082=-0.005
max0.090-0.091=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=-0.000
σ0.003-0.003=0.001
min23.311-23.314=-0.003
max23.325-23.323=0.002
mean413.000-420.000=-7.000
σ0.000
min413.000-420.000=-7.000
max413.000-420.000=-7.000
mean0.064-0.065=-0.001
σ0.002-0.002=0.000
min0.059-0.063=-0.005
max0.067-0.071=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.301-1757.302=-0.001
σ0.364-0.365=-0.001
min1756.726-1756.728=-0.002
max1757.892-1757.887=0.005
mean1655.300-1652.750=2.550
σ618.147-624.382=-6.234
min661.000-641.000=20.000
max2588.000-2830.000=-242.000
mean2.397-2.395=0.002
σ0.151-0.115=0.037
min2.237-2.267=-0.030
max2.710-2.694=0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.455-326.453=0.002
σ0.029-0.039=-0.010
min326.405-326.385=0.020
max326.477-326.481=-0.005
mean2588.000-2830.000=-242.000
σ0.000
min2588.000-2830.000=-242.000
max2588.000-2830.000=-242.000
mean0.421-0.427=-0.006
σ0.001-0.004=-0.003
min0.420-0.423=-0.004
max0.423-0.433=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1988.621-1988.617=0.004
σ0.003-0.007=-0.004
min1988.617-1988.610=0.007
max1988.625-1988.626=-0.001
mean2588.000-2830.000=-242.000
σ0.000
min2588.000-2830.000=-242.000
max2588.000-2830.000=-242.000
mean2.637-2.674=-0.037
σ0.129-0.121=0.008
min2.453-2.528=-0.076
max2.805-2.856=-0.051
iters=5
new-facts=6402
prior-facts=1
mean4813.132-4813.457=-0.325
σ7.909-7.642=0.267
min4809.387-4809.965=-0.578
max4827.266-4827.127=0.139
mean2588.000-2830.000=-242.000
σ0.000
min2588.000-2830.000=-242.000
max2588.000-2830.000=-242.000
mean8.570-8.835=-0.265
σ0.628-0.312=0.316
min7.656-8.383=-0.727
max9.308-9.142=0.167
iters=5
new-facts=6402
prior-facts=6402
mean5001.011-5000.945=0.067
σ0.024-0.166=-0.142
min5000.987-5000.649=0.338
max5001.042-5001.035=0.007
mean2989.400-3084.000=-94.600
σ308.546-253.010=55.536
min2588.000-2830.000=-242.000
max3389.000-3336.000=53.000
mean9.661-9.714=-0.053
σ0.169-0.376=-0.206
min9.421-9.081=0.340
max9.840-10.023=-0.183

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.384-1.000=0.384
σ0.294-0.068=0.226
min0.916-0.919=-0.003
max1.715-1.053=0.662

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.431-464.439=-0.009
σ574.775-574.771=0.004
min177.037-177.044=-0.007
max1326.593-1326.596=-0.003
mean88.250
σ8.500
min84.000
max101.000
mean2588.000-2830.000=-242.000
σ0.000
min2588.000-2830.000=-242.000
max2588.000-2830.000=-242.000
mean0.565-0.436=0.129
σ0.583-0.306=0.276
min0.272-0.282=-0.010
max1.439-0.896=0.543
policies=20
mean1770.757-1770.797=-0.040
σ0.350-0.362=-0.012
min1770.523-1770.550=-0.026
max1771.278-1771.332=-0.054
mean840.000
σ0.000
min840.000
max840.000
mean2588.000-2830.000=-242.000
σ0.000
min2588.000-2830.000=-242.000
max2588.000-2830.000=-242.000
mean2.712-2.800=-0.089
σ0.007-0.008=-0.000
min2.704-2.793=-0.088
max2.719-2.811=-0.092
policies=200
mean17714.821-17714.857=-0.036
σ0.623-0.560=0.063
min17714.474-17714.324=0.150
max17715.752-17715.646=0.106
mean8400.000
σ0.000
min8400.000
max8400.000
mean2588.000-2830.000=-242.000
σ0.000
min2588.000-2830.000=-242.000
max2588.000-2830.000=-242.000
mean27.494-28.022=-0.528
σ0.217-0.468=-0.251
min27.305-27.482=-0.176
max27.706-28.581=-0.875