Compare commits

Home / Compare 226fc47b .. 4cab834e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.728-70.721=0.007
σ0.044-0.045=-0.001
min70.701-70.697=0.003
max70.853-70.848=0.004
mean413.000-410.000=3.000
σ0.000
min413.000-410.000=3.000
max413.000-410.000=3.000
mean0.159-0.159=-0.001
σ0.005-0.003=0.002
min0.153-0.156=-0.004
max0.169-0.165=0.004
cache=y
dps=1
iters=10
policies=100
mean21.445-21.445=-0.001
σ0.002-0.003=-0.001
min21.440
max21.447-21.449=-0.001
mean413.000-410.000=3.000
σ0.000
min413.000-410.000=3.000
max413.000-410.000=3.000
mean0.062-0.065=-0.003
σ0.004-0.002=0.001
min0.059-0.063=-0.004
max0.071-0.071=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.525-1754.528=-0.003
σ0.361-0.360=0.002
min1753.955-1753.965=-0.009
max1755.111-1755.104=0.007
mean1654.600-1636.100=18.500
σ625.595-629.813=-4.218
min625.000-634.000=-9.000
max2848.000-2839.000=9.000
mean2.768-2.791=-0.023
σ0.196-0.215=-0.018
min2.317-2.314=0.003
max3.023-3.230=-0.207

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.612-273.609=0.003
σ0.009-0.006=0.002
min273.602-273.599=0.002
max273.624-273.615=0.009
mean2848.000-2839.000=9.000
σ0.000
min2848.000-2839.000=9.000
max2848.000-2839.000=9.000
mean0.384-0.385=-0.002
σ0.001-0.009=-0.008
min0.382-0.379=0.003
max0.386-0.402=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1933.999-1934.007=-0.008
σ0.007-0.013=-0.006
min1933.988-1933.989=-0.000
max1934.006-1934.021=-0.015
mean2848.000-2839.000=9.000
σ0.000
min2848.000-2839.000=9.000
max2848.000-2839.000=9.000
mean2.991-2.994=-0.002
σ0.058-0.343=-0.285
min2.949-2.632=0.317
max3.092-3.446=-0.355
iters=5
new-facts=6402
prior-facts=1
mean4754.790-4754.664=0.126
σ0.854-0.907=-0.053
min4754.343-4753.950=0.394
max4756.314-4756.249=0.064
mean2848.000-2839.000=9.000
σ0.000
min2848.000-2839.000=9.000
max2848.000-2839.000=9.000
mean8.406-8.509=-0.103
σ0.364-0.541=-0.178
min7.982-7.617=0.365
max8.739-8.960=-0.221
iters=5
new-facts=6402
prior-facts=6402
mean4945.226-4945.224=0.002
σ0.024-0.017=0.007
min4945.199-4945.208=-0.009
max4945.259-4945.244=0.015
mean3046.600-3059.600=-13.000
σ204.925-189.629=15.296
min2848.000-2839.000=9.000
max3335.000-3325.000=10.000
mean8.514-8.605=-0.091
σ0.149-0.209=-0.059
min8.368-8.430=-0.063
max8.727-8.923=-0.196

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.050-1.101=-0.051
σ0.129-0.163=-0.034
min0.932-0.935=-0.002
max1.250-1.375=-0.124

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.843-472.845=-0.002
σ574.929-574.937=-0.008
min185.367-185.365=0.002
max1335.236-1335.250=-0.014
mean88.250
σ8.500
min84.000
max101.000
mean2848.000-2839.000=9.000
σ0.000
min2848.000-2839.000=9.000
max2848.000-2839.000=9.000
mean0.446-0.486=-0.040
σ0.304-0.378=-0.074
min0.290-0.295=-0.005
max0.902-1.052=-0.150
policies=20
mean1854.015-1854.024=-0.009
σ0.372-0.373=-0.001
min1853.730-1853.747=-0.017
max1854.552-1854.566=-0.014
mean840.000
σ0.000
min840.000
max840.000
mean2848.000-2839.000=9.000
σ0.000
min2848.000-2839.000=9.000
max2848.000-2839.000=9.000
mean2.955-2.957=-0.002
σ0.005-0.016=-0.011
min2.948-2.939=0.010
max2.959-2.977=-0.018
policies=200
mean18546.579-18546.613=-0.035
σ0.579-0.542=0.037
min18546.218-18546.129=0.089
max18547.443-18547.345=0.098
mean8400.000
σ0.000
min8400.000
max8400.000
mean2848.000-2839.000=9.000
σ0.000
min2848.000-2839.000=9.000
max2848.000-2839.000=9.000
mean29.258-29.114=0.144
σ0.423-0.459=-0.036
min28.877-28.854=0.023
max29.773-29.802=-0.029