Compare commits

Home / Compare 499e1dcd .. 18bf9a2f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.978=0.002
σ0.047-0.051=-0.003
min33.954-33.952=0.002
max34.111-34.119=-0.007
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.085-0.083=0.002
σ0.003-0.005=-0.002
min0.083-0.074=0.009
max0.092-0.090=0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.002-0.003=-0.001
min23.313-23.313=0.000
max23.320-23.322=-0.002
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.066-0.065=0.000
σ0.002-0.003=-0.000
min0.064-0.063=0.000
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.429-1757.428=0.001
σ0.366-0.364=0.002
min1756.855
max1758.021-1758.020=0.001
mean1646.250-1667.150=-20.900
σ625.394-621.317=4.078
min636.000-663.000=-27.000
max2835.000-2677.000=158.000
mean2.360-2.373=-0.013
σ0.093-0.105=-0.012
min2.267-2.260=0.008
max2.673-2.654=0.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.571-326.565=0.006
σ0.056-0.059=-0.003
min326.473-326.460=0.014
max326.609-326.598=0.012
mean2835.000-2677.000=158.000
σ0.000
min2835.000-2677.000=158.000
max2835.000-2677.000=158.000
mean0.424-0.425=-0.000
σ0.005-0.005=-0.000
min0.421-0.422=-0.000
max0.433-0.434=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1988.745-1988.730=0.014
σ0.008-0.016=-0.008
min1988.737-1988.711=0.026
max1988.755-1988.754=0.001
mean2835.000-2677.000=158.000
σ0.000
min2835.000-2677.000=158.000
max2835.000-2677.000=158.000
mean2.668-2.754=-0.086
σ0.134-0.130=0.004
min2.511-2.609=-0.098
max2.857-2.944=-0.087
iters=5
new-facts=6402
prior-facts=1
mean4813.466-4813.568=-0.102
σ7.787-7.712=0.075
min4809.657-4810.040=-0.383
max4827.391-4827.363=0.028
mean2835.000-2677.000=158.000
σ0.000
min2835.000-2677.000=158.000
max2835.000-2677.000=158.000
mean8.777-8.450=0.328
σ0.345-0.457=-0.112
min8.270-7.803=0.467
max9.177-9.049=0.128
iters=5
new-facts=6402
prior-facts=6402
mean5001.136-5001.005=0.132
σ0.020-0.321=-0.301
min5001.109-5000.434=0.676
max5001.157-5001.191=-0.034
mean3054.600-2959.000=95.600
σ188.957-315.851=-126.894
min2835.000-2677.000=158.000
max3318.000-3412.000=-94.000
mean9.764-9.934=-0.169
σ0.097-0.281=-0.184
min9.670-9.748=-0.079
max9.910-10.413=-0.503

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.941-1.031=-0.089
σ0.059-0.119=-0.060
min0.908-0.917=-0.008
max1.045-1.219=-0.173

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.562-464.571=-0.009
σ574.767-574.781=-0.014
min177.175-177.172=0.002
max1326.713-1326.743=-0.030
mean88.250
σ8.500
min84.000
max101.000
mean2835.000-2677.000=158.000
σ0.000
min2835.000-2677.000=158.000
max2835.000-2677.000=158.000
mean0.434-0.557=-0.123
σ0.300-0.562=-0.262
min0.279-0.273=0.006
max0.884-1.400=-0.516
policies=20
mean1772.082-1772.030=0.052
σ0.355-0.345=0.009
min1771.832-1771.804=0.027
max1772.604-1772.544=0.061
mean840.000
σ0.000
min840.000
max840.000
mean2835.000-2677.000=158.000
σ0.000
min2835.000-2677.000=158.000
max2835.000-2677.000=158.000
mean2.800-2.712=0.088
σ0.011-0.036=-0.025
min2.787-2.684=0.103
max2.815-2.764=0.050
policies=200
mean17727.556-17727.373=0.182
σ0.338-0.391=-0.053
min17727.252-17727.115=0.138
max17728.037-17727.945=0.093
mean8400.000
σ0.000
min8400.000
max8400.000
mean2835.000-2677.000=158.000
σ0.000
min2835.000-2677.000=158.000
max2835.000-2677.000=158.000
mean27.872-27.395=0.477
σ0.403-0.053=0.350
min27.517-27.353=0.164
max28.300-27.470=0.830