Compare commits

Home / Compare c5e8e912 .. e0fadaa5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean1448.764-1448.765=-0.000
σ0.412-0.411=0.001
min1448.576-1448.585=-0.009
max1449.919-1449.920=-0.001
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean2.230-2.252=-0.022
σ0.026-0.024=0.003
min2.178-2.191=-0.013
max2.267-2.270=-0.002
cache=y
dps=1
iters=10
policies=100
mean1437.936-1437.940=-0.005
σ0.013-0.013=0.000
min1437.918-1437.926=-0.008
max1437.958-1437.967=-0.009
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean2.222-2.251=-0.030
σ0.032-0.030=0.002
min2.171-2.189=-0.017
max2.258-2.308=-0.050

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1030.063-1030.058=0.005
σ1.110-1.115=-0.005
min1029.533-1029.538=-0.006
max1034.726-1034.739=-0.014
mean1063.650-1070.300=-6.650
σ315.940-332.455=-16.515
min613.000-555.000=58.000
max1617.000-1625.000=-8.000
mean1.574-1.555=0.019
σ0.130-0.134=-0.004
min1.491-1.429=0.063
max1.981-2.091=-0.110

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean394.163-394.162=0.001
σ0.082-0.090=-0.008
min394.030-394.029=0.002
max394.217-394.228=-0.011
mean1617.000-1625.000=-8.000
σ0.000
min1617.000-1625.000=-8.000
max1617.000-1625.000=-8.000
mean0.490-0.497=-0.007
σ0.010-0.010=-0.001
min0.480-0.486=-0.007
max0.502-0.512=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1395.761-1395.750=0.012
σ0.060-0.035=0.025
min1395.728-1395.726=0.001
max1395.867-1395.811=0.057
mean1617.000-1625.000=-8.000
σ0.000
min1617.000-1625.000=-8.000
max1617.000-1625.000=-8.000
mean2.070-2.062=0.008
σ0.149-0.075=0.074
min1.962-2.004=-0.042
max2.330-2.194=0.136
iters=5
new-facts=6402
prior-facts=1
mean1917.938-1917.929=0.009
σ7.121-7.126=-0.005
min1914.620-1914.609=0.011
max1930.669-1930.671=-0.001
mean1617.000-1625.000=-8.000
σ0.000
min1617.000-1625.000=-8.000
max1617.000-1625.000=-8.000
mean4.337-4.281=0.056
σ0.226-0.200=0.026
min4.056-4.016=0.039
max4.673-4.531=0.142
iters=5
new-facts=6402
prior-facts=6402
mean2180.561-2180.559=0.002
σ0.022-0.014=0.007
min2180.544-2180.550=-0.006
max2180.599-2180.584=0.014
mean1853.800-1855.800=-2.000
σ202.768-197.993=4.775
min1617.000-1625.000=-8.000
max2082.000-2076.000=6.000
mean4.757-4.638=0.119
σ0.062-0.051=0.011
min4.672-4.588=0.084
max4.816-4.711=0.105

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.242-1.338=-0.096
σ0.353-0.372=-0.020
min0.907-0.997=-0.089
max1.825-1.744=0.081

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean457.271-457.271=0.001
σ573.361-573.366=-0.006
min170.584-170.582=0.003
max1317.313-1317.321=-0.008
mean98.250
σ8.500
min94.000
max111.000
mean1617.000-1625.000=-8.000
σ0.000
min1617.000-1625.000=-8.000
max1617.000-1625.000=-8.000
mean0.554-0.545=0.009
σ0.542-0.522=0.020
min0.279-0.281=-0.002
max1.367-1.328=0.039
policies=20
mean1706.089-1706.091=-0.002
σ0.393-0.402=-0.009
min1705.804-1705.816=-0.012
max1706.665-1706.682=-0.017
mean940.000
σ0.000
min940.000
max940.000
mean1617.000-1625.000=-8.000
σ0.000
min1617.000-1625.000=-8.000
max1617.000-1625.000=-8.000
mean2.816-2.819=-0.003
σ0.005-0.018=-0.013
min2.809-2.802=0.008
max2.822-2.842=-0.020
policies=200
mean17068.647-17068.645=0.002
σ0.070-0.151=-0.080
min17068.548-17068.437=0.111
max17068.715-17068.776=-0.061
mean9400.000
σ0.000
min9400.000
max9400.000
mean1617.000-1625.000=-8.000
σ0.000
min1617.000-1625.000=-8.000
max1617.000-1625.000=-8.000
mean28.431-28.548=-0.117
σ0.143-0.133=0.011
min28.306-28.439=-0.133
max28.585-28.732=-0.147