Compare commits

Home / Compare c60914ab .. ad4e3be8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=-0.000
σ0.050-0.049=0.001
min33.953-33.951=0.002
max34.119-34.114=0.005
mean418.000
σ0.000
min418.000
max418.000
mean0.084-0.085=-0.000
σ0.003-0.003=-0.000
min0.082-0.082=0.000
max0.090-0.090=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.003-0.003=0.000
min23.313-23.312=0.001
max23.322-23.323=-0.001
mean418.000
σ0.000
min418.000
max418.000
mean0.066-0.065=0.002
σ0.003-0.004=-0.001
min0.064-0.059=0.005
max0.073-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1757.304=-0.001
σ0.364-0.365=-0.001
min1756.730-1756.728=0.002
max1757.890-1757.891=-0.001
mean1650.450-1662.600=-12.150
σ624.285-620.488=3.797
min640.000-673.000=-33.000
max2833.000-2591.000=242.000
mean2.352-2.359=-0.008
σ0.091-0.103=-0.012
min2.261-2.268=-0.008
max2.657-2.714=-0.057

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.451-326.448=0.003
σ0.048-0.042=0.006
min326.366-326.375=-0.009
max326.481-326.488=-0.007
mean2833.000-2591.000=242.000
σ0.000
min2833.000-2591.000=242.000
max2833.000-2591.000=242.000
mean0.424-0.430=-0.007
σ0.002-0.006=-0.005
min0.422-0.427=-0.005
max0.426-0.442=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1988.619-1988.618=0.001
σ0.009-0.004=0.005
min1988.608-1988.613=-0.005
max1988.633-1988.622=0.011
mean2833.000-2591.000=242.000
σ0.000
min2833.000-2591.000=242.000
max2833.000-2591.000=242.000
mean2.667-2.735=-0.068
σ0.142-0.206=-0.063
min2.498-2.570=-0.072
max2.867-3.093=-0.226
iters=5
new-facts=6402
prior-facts=1
mean4813.346-4813.457=-0.112
σ7.792-7.752=0.040
min4809.488-4809.912=-0.424
max4827.280-4827.325=-0.045
mean2833.000-2591.000=242.000
σ0.000
min2833.000-2591.000=242.000
max2833.000-2591.000=242.000
mean8.836-8.610=0.225
σ0.409-0.550=-0.141
min8.254-7.847=0.407
max9.147-9.395=-0.248
iters=5
new-facts=6402
prior-facts=6402
mean5001.018-5001.010=0.008
σ0.025-0.019=0.005
min5000.990-5000.990=0.000
max5001.044-5001.037=0.007
mean3044.800-2947.400=97.400
σ206.408-360.576=-154.168
min2833.000-2591.000=242.000
max3304.000-3423.000=-119.000
mean9.780-9.647=0.133
σ0.171-0.179=-0.008
min9.624-9.362=0.262
max10.041-9.811=0.229

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.924-1.257=-0.334
σ0.015-0.399=-0.385
min0.913-0.917=-0.004
max0.949-1.745=-0.797

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.432-464.437=-0.006
σ574.767-574.792=-0.025
min177.044-177.037=0.006
max1326.583-1326.626=-0.043
mean88.250
σ8.500
min84.000
max101.000
mean2833.000-2591.000=242.000
σ0.000
min2833.000-2591.000=242.000
max2833.000-2591.000=242.000
mean0.437-0.549=-0.112
σ0.306-0.548=-0.242
min0.280-0.272=0.008
max0.895-1.370=-0.475
policies=20
mean1770.763-1770.764=-0.001
σ0.352-0.368=-0.016
min1770.537-1770.524=0.013
max1771.286-1771.310=-0.024
mean840.000
σ0.000
min840.000
max840.000
mean2833.000-2591.000=242.000
σ0.000
min2833.000-2591.000=242.000
max2833.000-2591.000=242.000
mean2.792-2.741=0.051
σ0.005-0.008=-0.003
min2.784-2.733=0.051
max2.796-2.750=0.046
policies=200
mean17714.755-17714.923=-0.168
σ0.520-0.510=0.010
min17714.402-17714.608=-0.206
max17715.528-17715.683=-0.155
mean8400.000
σ0.000
min8400.000
max8400.000
mean2833.000-2591.000=242.000
σ0.000
min2833.000-2591.000=242.000
max2833.000-2591.000=242.000
mean27.995-27.555=0.440
σ0.430-0.100=0.330
min27.626-27.455=0.172
max28.511-27.679=0.832