Compare commits

Home / Compare 7e717818 .. caab7252

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.709-53.711=-0.002
σ0.362-0.364=-0.002
min53.573-53.582=-0.008
max54.739-54.746=-0.007
mean413.800-413.600=0.200
σ0.422-0.516=-0.095
min413.000
max414.000
mean0.137-0.140=-0.003
σ0.004-0.004=0.000
min0.131-0.136=-0.005
max0.144-0.146=-0.003
cache=y
dps=1
iters=10
policies=100
mean42.979-42.979=0.000
σ0.005-0.006=-0.001
min42.972-42.970=0.003
max42.988-42.989=-0.000
mean414.000
σ0.000
min414.000
max414.000
mean0.121-0.119=0.002
σ0.005-0.005=-0.000
min0.113-0.114=-0.001
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.223-995.219=0.003
σ1.174-1.195=-0.020
min994.690-994.686=0.004
max1000.149-1000.227=-0.078
mean1056.150-1066.350=-10.200
σ311.901-315.371=-3.470
min593.000-603.000=-10.000
max1513.000-1612.000=-99.000
mean1.503-1.485=0.018
σ0.163-0.075=0.089
min1.340-1.375=-0.035
max2.118-1.662=0.457

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.318-297.316=0.002
σ0.004-0.006=-0.002
min297.312-297.308=0.003
max297.323-297.323=-0.001
mean1513.000-1612.000=-99.000
σ0.000
min1513.000-1612.000=-99.000
max1513.000-1612.000=-99.000
mean0.386-0.386=-0.000
σ0.002-0.001=0.001
min0.384-0.385=-0.001
max0.389-0.387=0.001
iters=5
new-facts=1
prior-facts=6402
mean1298.999-1298.985=0.014
σ0.094-0.084=0.010
min1298.842-1298.837=0.005
max1299.084-1299.048=0.036
mean1513.000-1612.000=-99.000
σ0.000
min1513.000-1612.000=-99.000
max1513.000-1612.000=-99.000
mean2.029-1.941=0.089
σ0.262-0.058=0.204
min1.842-1.863=-0.021
max2.488-2.017=0.471
iters=5
new-facts=6402
prior-facts=1
mean1719.186-1719.180=0.007
σ6.929-6.879=0.049
min1715.999-1715.995=0.003
max1731.578-1731.482=0.095
mean1513.000-1612.000=-99.000
σ0.000
min1513.000-1612.000=-99.000
max1513.000-1612.000=-99.000
mean2.963-2.911=0.052
σ0.463-0.263=0.200
min2.520-2.604=-0.084
max3.749-3.271=0.477
iters=5
new-facts=6402
prior-facts=6402
mean1981.946-1981.931=0.015
σ0.005-0.025=-0.019
min1981.940-1981.887=0.053
max1981.952-1981.945=0.007
mean1780.000-1820.600=-40.600
σ200.407-154.975=45.432
min1513.000-1612.000=-99.000
max1963.000-1957.000=6.000
mean3.138-3.143=-0.006
σ0.112-0.129=-0.017
min2.958-2.941=0.018
max3.251-3.253=-0.002

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.526-1.213=0.313
σ0.271-0.275=-0.004
min1.188-0.917=0.271
max1.782-1.622=0.159

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.450-440.460=-0.010
σ573.028-573.035=-0.007
min153.932-153.937=-0.005
max1299.992-1300.012=-0.020
mean94.250
σ8.500
min90.000
max107.000
mean1513.000-1612.000=-99.000
σ0.000
min1513.000-1612.000=-99.000
max1513.000-1612.000=-99.000
mean0.535-0.548=-0.013
σ0.534-0.557=-0.023
min0.265-0.265=0.001
max1.336-1.384=-0.048
policies=20
mean1539.589-1539.576=0.013
σ0.299-0.301=-0.002
min1539.389-1539.385=0.004
max1540.034-1540.025=0.009
mean900.000
σ0.000
min900.000
max900.000
mean1513.000-1612.000=-99.000
σ0.000
min1513.000-1612.000=-99.000
max1513.000-1612.000=-99.000
mean2.562-2.568=-0.007
σ0.010-0.031=-0.021
min2.552-2.537=0.015
max2.572-2.612=-0.040
policies=200
mean15404.005-15403.726=0.279
σ0.260-0.092=0.169
min15403.619-15403.606=0.012
max15404.186-15403.804=0.382
mean9000.000
σ0.000
min9000.000
max9000.000
mean1513.000-1612.000=-99.000
σ0.000
min1513.000-1612.000=-99.000
max1513.000-1612.000=-99.000
mean25.930-25.912=0.018
σ0.107-0.174=-0.068
min25.831-25.745=0.086
max26.034-26.106=-0.073