Compare commits

Home / Compare 4e39b3d3 .. 01356c08

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.709-53.711=-0.002
σ0.364-0.364=0.000
min53.576-53.582=-0.006
max54.744-54.746=-0.002
mean415.000-413.600=1.400
σ0.000-0.516=-0.516
min415.000-413.000=2.000
max415.000-414.000=1.000
mean0.139-0.140=-0.001
σ0.003-0.004=-0.000
min0.135-0.136=-0.000
max0.145-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean42.978-42.979=-0.001
σ0.005-0.006=-0.001
min42.970-42.970=-0.000
max42.986-42.989=-0.003
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.119-0.119=0.001
σ0.004-0.005=-0.000
min0.114-0.114=0.001
max0.126-0.127=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.220-995.219=0.000
σ1.188-1.195=-0.007
min994.684-994.686=-0.002
max1000.192-1000.227=-0.035
mean1058.200-1066.350=-8.150
σ312.309-315.371=-3.061
min608.000-603.000=5.000
max1629.000-1612.000=17.000
mean1.494-1.485=0.008
σ0.077-0.075=0.002
min1.401-1.375=0.026
max1.691-1.662=0.029

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.314-297.316=-0.001
σ0.014-0.006=0.008
min297.292-297.308=-0.016
max297.325-297.323=0.002
mean1629.000-1612.000=17.000
σ0.000
min1629.000-1612.000=17.000
max1629.000-1612.000=17.000
mean0.399-0.386=0.013
σ0.013-0.001=0.012
min0.386-0.385=0.002
max0.416-0.387=0.029
iters=5
new-facts=1
prior-facts=6402
mean1299.033-1298.985=0.048
σ0.050-0.084=-0.034
min1298.961-1298.837=0.124
max1299.070-1299.048=0.022
mean1629.000-1612.000=17.000
σ0.000
min1629.000-1612.000=17.000
max1629.000-1612.000=17.000
mean1.872-1.941=-0.069
σ0.031-0.058=-0.027
min1.819-1.863=-0.044
max1.897-2.017=-0.120
iters=5
new-facts=6402
prior-facts=1
mean1719.186-1719.180=0.006
σ6.918-6.879=0.038
min1715.993-1715.995=-0.002
max1731.557-1731.482=0.075
mean1629.000-1612.000=17.000
σ0.000
min1629.000-1612.000=17.000
max1629.000-1612.000=17.000
mean2.918-2.911=0.007
σ0.408-0.263=0.145
min2.509-2.604=-0.095
max3.575-3.271=0.304
iters=5
new-facts=6402
prior-facts=6402
mean1981.947-1981.931=0.016
σ0.007-0.025=-0.017
min1981.938-1981.887=0.051
max1981.957-1981.945=0.012
mean1817.600-1820.600=-3.000
σ155.103-154.975=0.127
min1629.000-1612.000=17.000
max2038.000-1957.000=81.000
mean3.209-3.143=0.066
σ0.059-0.129=-0.070
min3.139-2.941=0.198
max3.291-3.253=0.038

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.293-1.213=0.080
σ0.339-0.275=0.064
min0.911-0.917=-0.006
max1.779-1.622=0.156

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.466-440.460=0.005
σ573.044-573.035=0.009
min153.931-153.937=-0.006
max1300.031-1300.012=0.019
mean94.250
σ8.500
min90.000
max107.000
mean1629.000-1612.000=17.000
σ0.000
min1629.000-1612.000=17.000
max1629.000-1612.000=17.000
mean0.544-0.548=-0.003
σ0.578-0.557=0.020
min0.254-0.265=-0.010
max1.411-1.384=0.027
policies=20
mean1539.597-1539.576=0.020
σ0.309-0.301=0.008
min1539.396-1539.385=0.011
max1540.056-1540.025=0.031
mean900.000
σ0.000
min900.000
max900.000
mean1629.000-1612.000=17.000
σ0.000
min1629.000-1612.000=17.000
max1629.000-1612.000=17.000
mean2.572-2.568=0.003
σ0.012-0.031=-0.019
min2.559-2.537=0.021
max2.585-2.612=-0.027
policies=200
mean15404.028-15403.726=0.301
σ0.062-0.092=-0.030
min15403.972-15403.606=0.366
max15404.098-15403.804=0.293
mean9000.000
σ0.000
min9000.000
max9000.000
mean1629.000-1612.000=17.000
σ0.000
min1629.000-1612.000=17.000
max1629.000-1612.000=17.000
mean25.955-25.912=0.043
σ0.098-0.174=-0.077
min25.837-25.745=0.093
max26.048-26.106=-0.058