Compare commits

Home / Compare 02f770cd .. b975978e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.769=-0.000
σ0.048-0.047=0.000
min30.726-30.728=-0.002
max30.900-30.899=0.000
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.077-0.078=-0.001
σ0.002-0.003=-0.001
min0.075-0.075=0.000
max0.082-0.084=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.061-21.061=-0.000
σ0.003-0.002=0.001
min21.057-21.057=-0.000
max21.065-21.064=0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.062-0.063=-0.001
σ0.003-0.005=-0.002
min0.058-0.058=-0.000
max0.068-0.072=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.618-1751.420=0.198
σ0.361-0.361=-0.001
min1751.057-1750.846=0.211
max1752.200-1752.001=0.199
mean1666.150-1666.650=-0.500
σ637.298-639.738=-2.441
min620.000-680.000=-60.000
max2650.000-2697.000=-47.000
mean2.837-2.827=0.009
σ0.125-0.176=-0.051
min2.580-2.284=0.295
max3.108-3.111=-0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean276.025-275.758=0.267
σ0.010-0.010=0.000
min276.014-275.748=0.266
max276.038-275.770=0.268
mean2650.000-2697.000=-47.000
σ0.000
min2650.000-2697.000=-47.000
max2650.000-2697.000=-47.000
mean0.391-0.399=-0.009
σ0.008-0.007=0.001
min0.387-0.390=-0.003
max0.405-0.408=-0.004
iters=5
new-facts=1
prior-facts=6402
mean2168.563-2168.272=0.292
σ0.005-0.011=-0.007
min2168.555-2168.257=0.298
max2168.567-2168.284=0.283
mean2650.000-2697.000=-47.000
σ0.000
min2650.000-2697.000=-47.000
max2650.000-2697.000=-47.000
mean2.869-2.859=0.009
σ0.155-0.156=-0.001
min2.743-2.637=0.105
max3.058-3.024=0.035
iters=5
new-facts=6402
prior-facts=1
mean5048.091-5047.865=0.226
σ1.216-1.174=0.042
min5046.797-5046.452=0.345
max5050.022-5049.714=0.308
mean2650.000-2697.000=-47.000
σ0.000
min2650.000-2697.000=-47.000
max2650.000-2697.000=-47.000
mean8.357-8.849=-0.492
σ0.410-0.471=-0.062
min8.054-8.116=-0.062
max9.064-9.385=-0.322
iters=5
new-facts=6402
prior-facts=6402
mean5179.499-5179.097=0.402
σ0.084-0.212=-0.129
min5179.422-5178.808=0.613
max5179.594-5179.343=0.250
mean3215.400-3285.800=-70.400
σ493.366-497.323=-3.957
min2650.000-2697.000=-47.000
max3888.000-3962.000=-74.000
mean9.959-9.988=-0.029
σ0.270-0.323=-0.053
min9.526-9.582=-0.056
max10.262-10.364=-0.102

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.199-1.182=0.017
σ0.249-0.226=0.023
min0.951-0.945=0.006
max1.598-1.519=0.080

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.803-463.574=0.229
σ572.665-572.664=0.001
min177.467-177.238=0.229
max1322.800-1322.570=0.230
mean79.750
σ7.500
min76.000
max91.000
mean2650.000-2697.000=-47.000
σ0.000
min2650.000-2697.000=-47.000
max2650.000-2697.000=-47.000
mean0.557-0.551=0.006
σ0.560-0.547=0.013
min0.275-0.276=-0.001
max1.396-1.371=0.025
policies=20
mean1774.934-1772.641=2.294
σ0.326-0.327=-0.001
min1774.713-1772.424=2.289
max1775.418-1773.127=2.291
mean760.000
σ0.000
min760.000
max760.000
mean2650.000-2697.000=-47.000
σ0.000
min2650.000-2697.000=-47.000
max2650.000-2697.000=-47.000
mean2.733-2.736=-0.003
σ0.006-0.013=-0.007
min2.729-2.717=0.012
max2.741-2.748=-0.006
policies=200
mean17756.105-17732.948=23.157
σ0.461-0.563=-0.102
min17755.834-17732.500=23.334
max17756.793-17733.768=23.025
mean7600.000
σ0.000
min7600.000
max7600.000
mean2650.000-2697.000=-47.000
σ0.000
min2650.000-2697.000=-47.000
max2650.000-2697.000=-47.000
mean27.611-27.777=-0.166
σ0.128-0.161=-0.034
min27.490-27.682=-0.193
max27.791-28.019=-0.228