Compare commits

Home / Compare b9b2af76 .. f625ad97

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.731-70.734=-0.004
σ0.052-0.055=-0.003
min70.699-70.701=-0.002
max70.877-70.888=-0.012
mean416.000-413.900=2.100
σ0.000-0.316=-0.316
min416.000-413.000=3.000
max416.000-414.000=2.000
mean0.157-0.169=-0.012
σ0.004-0.012=-0.008
min0.149-0.151=-0.002
max0.164-0.187=-0.023
cache=y
dps=1
iters=10
policies=100
mean21.446-21.446=-0.000
σ0.002-0.002=0.000
min21.442-21.441=0.000
max21.448-21.448=0.000
mean416.700-414.000=2.700
σ0.483-0.000=0.483
min416.000-414.000=2.000
max417.000-414.000=3.000
mean0.065-0.065=0.000
σ0.003-0.003=-0.000
min0.063-0.061=0.002
max0.073-0.073=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.602-1755.604=-0.002
σ0.361-0.361=-0.000
min1755.029-1755.027=0.002
max1756.193-1756.185=0.008
mean1651.100-1650.450=0.650
σ608.338-651.693=-43.355
min632.000-628.000=4.000
max2472.000-2750.000=-278.000
mean2.783-2.853=-0.070
σ0.140-0.160=-0.020
min2.414-2.471=-0.057
max2.914-3.061=-0.147

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean274.688-274.690=-0.002
σ0.008-0.004=0.004
min274.680-274.686=-0.006
max274.701-274.696=0.005
mean2472.000-2750.000=-278.000
σ0.000
min2472.000-2750.000=-278.000
max2472.000-2750.000=-278.000
mean0.387-0.385=0.002
σ0.004-0.001=0.003
min0.384-0.384=0.000
max0.394-0.387=0.007
iters=5
new-facts=1
prior-facts=6402
mean1935.081-1935.087=-0.005
σ0.008-0.017=-0.009
min1935.069-1935.065=0.004
max1935.091-1935.111=-0.020
mean2472.000-2750.000=-278.000
σ0.000
min2472.000-2750.000=-278.000
max2472.000-2750.000=-278.000
mean3.005-3.098=-0.094
σ0.335-0.337=-0.001
min2.599-2.733=-0.134
max3.481-3.607=-0.127
iters=5
new-facts=6402
prior-facts=1
mean4755.889-4755.835=0.055
σ0.882-0.860=0.022
min4755.372-4755.374=-0.002
max4757.462-4757.371=0.091
mean2472.000-2750.000=-278.000
σ0.000
min2472.000-2750.000=-278.000
max2472.000-2750.000=-278.000
mean8.374-8.526=-0.152
σ0.409-0.303=0.107
min7.990-8.070=-0.080
max8.970-8.912=0.058
iters=5
new-facts=6402
prior-facts=6402
mean4946.158-4946.302=-0.144
σ0.205-0.019=0.186
min4945.922-4946.286=-0.363
max4946.319-4946.328=-0.009
mean2929.800-3046.600=-116.800
σ397.341-217.245=180.096
min2473.000-2750.000=-277.000
max3447.000-3321.000=126.000
mean8.451-8.573=-0.122
σ0.098-0.131=-0.032
min8.356-8.400=-0.044
max8.615-8.690=-0.075

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.725-1.050=0.674
σ0.105-0.131=-0.026
min1.589-0.935=0.654
max1.824-1.254=0.569

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean474.989-474.997=-0.007
σ574.927-574.936=-0.009
min187.519-187.520=-0.002
max1337.380-1337.400=-0.021
mean90.250
σ8.500
min86.000
max103.000
mean2472.000-2750.000=-278.000
σ0.000
min2472.000-2750.000=-278.000
max2472.000-2750.000=-278.000
mean0.559-0.568=-0.009
σ0.527-0.546=-0.019
min0.291-0.292=-0.001
max1.349-1.387=-0.038
policies=20
mean1875.540-1875.533=0.007
σ0.386-0.392=-0.007
min1875.255-1875.256=-0.001
max1876.101-1876.108=-0.007
mean860.000
σ0.000
min860.000
max860.000
mean2472.000-2750.000=-278.000
σ0.000
min2472.000-2750.000=-278.000
max2472.000-2750.000=-278.000
mean2.961-2.920=0.040
σ0.054-0.020=0.033
min2.906-2.900=0.006
max3.023-2.948=0.075
policies=200
mean18762.182-18762.195=-0.013
σ0.445-0.491=-0.046
min18761.918-18761.900=0.018
max18762.847-18762.928=-0.081
mean8600.000
σ0.000
min8600.000
max8600.000
mean2472.000-2750.000=-278.000
σ0.000
min2472.000-2750.000=-278.000
max2472.000-2750.000=-278.000
mean29.292-29.388=-0.096
σ0.088-0.039=0.049
min29.208-29.337=-0.129
max29.371-29.430=-0.059