Compare commits

Home / Compare c695bc1f .. a05cc6d6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.731=0.050
σ0.045-0.052=-0.008
min70.756-70.702=0.054
max70.906-70.878=0.028
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.160-0.161=-0.000
σ0.003-0.004=-0.001
min0.154-0.157=-0.002
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.492-21.445=0.046
σ0.004-0.003=0.001
min21.486-21.442=0.045
max21.496-21.450=0.046
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.064-0.065=-0.002
σ0.004-0.003=0.002
min0.059-0.063=-0.004
max0.073-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1755.286=-1.193
σ0.361-0.359=0.002
min1753.522-1754.716=-1.194
max1754.696-1755.865=-1.169
mean1660.650-1626.550=34.100
σ632.228-594.181=38.047
min629.000-638.000=-9.000
max2714.000-2419.000=295.000
mean2.840-2.838=0.002
σ0.123-0.112=0.012
min2.545-2.642=-0.097
max3.091-3.089=0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.929-273.121=-1.193
σ0.006-0.004=0.002
min271.920-273.117=-1.197
max271.935-273.125=-1.191
mean2714.000-2419.000=295.000
σ0.000
min2714.000-2419.000=295.000
max2714.000-2419.000=295.000
mean0.385-0.384=0.001
σ0.009-0.009=0.000
min0.377-0.379=-0.002
max0.396-0.400=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.321-1933.510=-1.189
σ0.005-0.003=0.001
min1932.317-1933.507=-1.190
max1932.329-1933.515=-1.186
mean2714.000-2419.000=295.000
σ0.000
min2714.000-2419.000=295.000
max2714.000-2419.000=295.000
mean2.963-3.076=-0.113
σ0.063-0.062=0.001
min2.879-3.027=-0.148
max3.011-3.162=-0.150
iters=5
new-facts=6402
prior-facts=1
mean4753.072-4754.320=-1.248
σ0.929-0.870=0.059
min4752.557-4753.776=-1.219
max4754.730-4755.867=-1.137
mean2714.000-2419.000=295.000
σ0.000
min2714.000-2419.000=295.000
max2714.000-2419.000=295.000
mean8.624-8.304=0.320
σ0.456-0.475=-0.020
min7.900-7.914=-0.014
max9.109-9.042=0.066
iters=5
new-facts=6402
prior-facts=6402
mean4943.344-4944.736=-1.392
σ0.316-0.019=0.297
min4942.852-4944.712=-1.859
max4943.585-4944.761=-1.177
mean2982.200-2916.600=65.600
σ230.829-413.483=-182.654
min2714.000-2419.000=295.000
max3310.000-3446.000=-136.000
mean8.474-8.454=0.019
σ0.101-0.114=-0.012
min8.370-8.353=0.018
max8.620-8.607=0.013

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.024-1.655=-0.631
σ0.134-0.153=-0.019
min0.934-1.477=-0.543
max1.239-1.816=-0.578

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.642-472.833=-4.191
σ574.939-574.927=0.012
min181.164-185.368=-4.204
max1331.051-1335.223=-4.173
mean88.250
σ8.500
min84.000
max101.000
mean2714.000-2419.000=295.000
σ0.000
min2714.000-2419.000=295.000
max2714.000-2419.000=295.000
mean0.571-0.569=0.003
σ0.567-0.551=0.016
min0.283-0.292=-0.009
max1.422-1.395=0.027
policies=20
mean1811.960-1853.962=-42.002
σ0.373-0.373=0.000
min1811.709-1853.708=-41.999
max1812.513-1854.513=-42.000
mean840.000
σ0.000
min840.000
max840.000
mean2714.000-2419.000=295.000
σ0.000
min2714.000-2419.000=295.000
max2714.000-2419.000=295.000
mean2.826-2.853=-0.027
σ0.012-0.004=0.007
min2.812-2.847=-0.035
max2.838-2.857=-0.019
policies=200
mean18126.588-18546.600=-420.012
σ0.474-0.376=0.099
min18126.139-18546.296=-420.158
max18127.253-18547.148=-419.895
mean8400.000
σ0.000
min8400.000
max8400.000
mean2714.000-2419.000=295.000
σ0.000
min2714.000-2419.000=295.000
max2714.000-2419.000=295.000
mean28.523-28.744=-0.221
σ0.071-0.137=-0.066
min28.437-28.541=-0.103
max28.583-28.836=-0.253