Compare commits

Home / Compare 398ad502 .. ad0652a0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.979=-0.001
σ0.047-0.049=-0.002
min33.947-33.949=-0.002
max34.106-34.113=-0.006
mean411.000-417.000=-6.000
σ0.000
min411.000-417.000=-6.000
max411.000-417.000=-6.000
mean0.081-0.085=-0.004
σ0.005-0.004=0.001
min0.076-0.082=-0.006
max0.089-0.092=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.316-23.317=-0.001
σ0.002-0.002=-0.000
min23.313-23.315=-0.002
max23.319-23.323=-0.004
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.063-0.064=-0.001
σ0.005-0.003=0.003
min0.059-0.061=-0.002
max0.075-0.069=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.364-1757.303=0.061
σ0.364-0.364=-0.000
min1756.787-1756.729=0.058
max1757.952-1757.888=0.063
mean1663.350-1656.700=6.650
σ624.225-626.104=-1.878
min618.000-636.000=-18.000
max2715.000-2828.000=-113.000
mean2.335-2.374=-0.039
σ0.098-0.109=-0.011
min2.190-2.253=-0.063
max2.639-2.733=-0.094

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.512-326.443=0.069
σ0.030-0.055=-0.025
min326.459-326.346=0.113
max326.531-326.473=0.058
mean2715.000-2828.000=-113.000
σ0.000
min2715.000-2828.000=-113.000
max2715.000-2828.000=-113.000
mean0.424-0.428=-0.004
σ0.001-0.006=-0.004
min0.422-0.423=-0.001
max0.426-0.437=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1988.673-1988.613=0.059
σ0.009-0.012=-0.003
min1988.660-1988.593=0.067
max1988.685-1988.624=0.061
mean2715.000-2828.000=-113.000
σ0.000
min2715.000-2828.000=-113.000
max2715.000-2828.000=-113.000
mean2.667-2.707=-0.039
σ0.038-0.139=-0.101
min2.633-2.597=0.036
max2.731-2.947=-0.216
iters=5
new-facts=6402
prior-facts=1
mean4813.506-4813.457=0.049
σ7.732-7.740=-0.008
min4809.979-4809.944=0.035
max4827.336-4827.302=0.034
mean2715.000-2828.000=-113.000
σ0.000
min2715.000-2828.000=-113.000
max2715.000-2828.000=-113.000
mean8.820-8.887=-0.068
σ0.217-0.328=-0.111
min8.632-8.414=0.218
max9.145-9.174=-0.029
iters=5
new-facts=6402
prior-facts=6402
mean5001.080-5000.873=0.207
σ0.037-0.190=-0.153
min5001.046-5000.636=0.410
max5001.139-5001.022=0.117
mean3005.200-3054.000=-48.800
σ262.305-192.395=69.909
min2715.000-2828.000=-113.000
max3369.000-3322.000=47.000
mean9.915-9.743=0.172
σ0.335-0.248=0.088
min9.707-9.318=0.389
max10.509-9.962=0.547

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.949-1.016=-0.067
σ0.055-0.065=-0.010
min0.915-0.937=-0.022
max1.045-1.065=-0.020

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.502-464.435=0.067
σ574.771-574.772=-0.001
min177.108-177.044=0.063
max1326.659-1326.594=0.065
mean88.250
σ8.500
min84.000
max101.000
mean2715.000-2828.000=-113.000
σ0.000
min2715.000-2828.000=-113.000
max2715.000-2828.000=-113.000
mean0.549-0.441=0.108
σ0.552-0.313=0.239
min0.269-0.282=-0.013
max1.377-0.910=0.466
policies=20
mean1771.393-1770.787=0.606
σ0.349-0.369=-0.021
min1771.165-1770.533=0.631
max1771.912-1771.333=0.579
mean840.000
σ0.000
min840.000
max840.000
mean2715.000-2828.000=-113.000
σ0.000
min2715.000-2828.000=-113.000
max2715.000-2828.000=-113.000
mean2.720-2.800=-0.081
σ0.012-0.016=-0.004
min2.704-2.787=-0.083
max2.732-2.824=-0.093
policies=200
mean17721.106-17715.015=6.091
σ0.506-0.471=0.035
min17720.843-17714.613=6.230
max17721.865-17715.690=6.175
mean8400.000
σ0.000
min8400.000
max8400.000
mean2715.000-2828.000=-113.000
σ0.000
min2715.000-2828.000=-113.000
max2715.000-2828.000=-113.000
mean27.535-27.933=-0.398
σ0.082-0.525=-0.443
min27.436-27.369=0.067
max27.627-28.549=-0.922