Compare commits

Home / Compare 490c3709 .. 5edf41c3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.978=0.001
σ0.048-0.050=-0.003
min33.955-33.950=0.005
max34.111-34.119=-0.007
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.082-0.083=-0.001
σ0.005-0.005=0.000
min0.077-0.075=0.001
max0.092-0.092=0.000
cache=y
dps=1
iters=10
policies=100
mean23.318-23.316=0.001
σ0.002-0.003=-0.000
min23.314-23.314=-0.000
max23.321-23.323=-0.002
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.065-0.065=-0.000
σ0.003-0.003=-0.001
min0.064-0.063=0.000
max0.073-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.428-1757.427=0.001
σ0.364-0.365=-0.001
min1756.854-1756.852=0.001
max1758.016-1758.019=-0.003
mean1648.300-1651.200=-2.900
σ612.222-624.362=-12.140
min677.000-676.000=1.000
max2630.000-2590.000=40.000
mean2.367-2.373=-0.006
σ0.093-0.116=-0.023
min2.255-2.220=0.035
max2.595-2.674=-0.078

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.575-326.563=0.012
σ0.043-0.065=-0.022
min326.503-326.448=0.055
max326.616-326.604=0.012
mean2630.000-2590.000=40.000
σ0.000
min2630.000-2590.000=40.000
max2630.000-2590.000=40.000
mean0.424-0.426=-0.002
σ0.007-0.010=-0.003
min0.420-0.420=-0.000
max0.436-0.444=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1988.727-1988.706=0.022
σ0.018-0.041=-0.024
min1988.707-1988.648=0.058
max1988.749-1988.748=0.001
mean2630.000-2590.000=40.000
σ0.000
min2630.000-2590.000=40.000
max2630.000-2590.000=40.000
mean2.803-2.668=0.136
σ0.283-0.060=0.223
min2.632-2.615=0.016
max3.305-2.764=0.541
iters=5
new-facts=6402
prior-facts=1
mean4813.458-4813.507=-0.049
σ7.778-7.764=0.015
min4809.613-4809.700=-0.087
max4827.367-4827.390=-0.023
mean2630.000-2590.000=40.000
σ0.000
min2630.000-2590.000=40.000
max2630.000-2590.000=40.000
mean8.985-8.441=0.544
σ0.192-0.533=-0.341
min8.674-7.708=0.966
max9.173-9.107=0.067
iters=5
new-facts=6402
prior-facts=6402
mean5001.146-5001.128=0.018
σ0.034-0.014=0.020
min5001.112-5001.113=-0.001
max5001.200-5001.146=0.054
mean2989.800-2921.000=68.800
σ275.427-253.447=21.980
min2630.000-2590.000=40.000
max3317.000-3266.000=51.000
mean9.752-9.471=0.281
σ0.388-0.642=-0.254
min9.113-8.343=0.769
max10.125-9.848=0.277

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.118-1.246=-0.128
σ0.304-0.395=-0.090
min0.913-0.917=-0.004
max1.652-1.784=-0.132

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.571-464.566=0.005
σ574.780-574.790=-0.010
min177.172-177.163=0.008
max1326.741-1326.751=-0.010
mean88.250
σ8.500
min84.000
max101.000
mean2630.000-2590.000=40.000
σ0.000
min2630.000-2590.000=40.000
max2630.000-2590.000=40.000
mean0.556-0.556=0.000
σ0.568-0.569=-0.000
min0.270-0.269=0.001
max1.409-1.409=-0.000
policies=20
mean1772.012-1772.014=-0.002
σ0.353-0.345=0.008
min1771.785-1771.779=0.006
max1772.538-1772.525=0.013
mean840.000
σ0.000
min840.000
max840.000
mean2630.000-2590.000=40.000
σ0.000
min2630.000-2590.000=40.000
max2630.000-2590.000=40.000
mean2.728-2.702=0.026
σ0.018-0.012=0.006
min2.704-2.687=0.017
max2.747-2.714=0.033
policies=200
mean17727.390-17727.458=-0.068
σ0.544-0.477=0.067
min17727.085-17727.185=-0.099
max17728.205-17728.173=0.032
mean8400.000
σ0.000
min8400.000
max8400.000
mean2630.000-2590.000=40.000
σ0.000
min2630.000-2590.000=40.000
max2630.000-2590.000=40.000
mean27.481-27.467=0.014
σ0.093-0.153=-0.060
min27.390-27.302=0.088
max27.577-27.661=-0.084