Compare commits

Home / Compare e4b7c9c8 .. 4ac22939

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.783-70.782=0.001
σ0.047-0.047=0.000
min70.753-70.748=0.004
max70.914-70.911=0.002
mean420.000-412.000=8.000
σ0.000
min420.000-412.000=8.000
max420.000-412.000=8.000
mean0.161-0.160=0.001
σ0.003-0.004=-0.001
min0.157-0.157=0.000
max0.165-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.493-21.492=0.000
σ0.002-0.002=0.000
min21.490-21.489=0.000
max21.496-21.495=0.001
mean420.000-412.000=8.000
σ0.000
min420.000-412.000=8.000
max420.000-412.000=8.000
mean0.065-0.063=0.002
σ0.003-0.003=-0.000
min0.063-0.060=0.003
max0.073-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.095=-0.001
σ0.361-0.360=0.001
min1753.529-1753.528=0.000
max1754.692-1754.679=0.013
mean1668.500-1647.150=21.350
σ634.292-610.366=23.926
min637.000-640.000=-3.000
max2782.000-2467.000=315.000
mean2.829-2.834=-0.005
σ0.146-0.120=0.026
min2.471-2.472=-0.001
max3.106-3.083=0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.956-271.954=0.002
σ0.007-0.006=0.000
min271.950-271.947=0.004
max271.967-271.960=0.007
mean2782.000-2467.000=315.000
σ0.000
min2782.000-2467.000=315.000
max2782.000-2467.000=315.000
mean0.385-0.379=0.005
σ0.006-0.002=0.004
min0.379-0.378=0.001
max0.395-0.384=0.011
iters=5
new-facts=1
prior-facts=6402
mean1932.322-1932.329=-0.007
σ0.008-0.011=-0.003
min1932.312-1932.315=-0.004
max1932.331-1932.341=-0.011
mean2782.000-2467.000=315.000
σ0.000
min2782.000-2467.000=315.000
max2782.000-2467.000=315.000
mean3.050-3.049=0.001
σ0.035-0.091=-0.056
min3.018-2.929=0.089
max3.100-3.143=-0.044
iters=5
new-facts=6402
prior-facts=1
mean4752.851-4752.978=-0.127
σ1.060-1.008=0.052
min4752.030-4752.056=-0.027
max4754.695-4754.699=-0.004
mean2782.000-2467.000=315.000
σ0.000
min2782.000-2467.000=315.000
max2782.000-2467.000=315.000
mean8.703-8.639=0.065
σ0.501-0.382=0.119
min7.815-8.019=-0.205
max8.987-8.976=0.011
iters=5
new-facts=6402
prior-facts=6402
mean4943.565-4943.416=0.149
σ0.022-0.311=-0.290
min4943.540-4942.859=0.680
max4943.594-4943.568=0.026
mean3011.600-3000.000=11.600
σ290.820-278.951=11.869
min2782.000-2606.000=176.000
max3460.000-3345.000=115.000
mean8.700-8.554=0.145
σ0.440-0.192=0.248
min8.331-8.330=0.001
max9.411-8.857=0.555

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.985-1.823=-0.838
σ0.141-0.121=0.020
min0.914-1.627=-0.713
max1.236-1.929=-0.693

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.661-468.655=0.006
σ574.928-574.927=0.001
min181.193-181.190=0.004
max1331.053-1331.046=0.008
mean88.250
σ8.500
min84.000
max101.000
mean2782.000-2467.000=315.000
σ0.000
min2782.000-2467.000=315.000
max2782.000-2467.000=315.000
mean0.451-0.557=-0.106
σ0.304-0.530=-0.226
min0.295-0.285=0.010
max0.907-1.352=-0.445
policies=20
mean1812.246-1812.166=0.080
σ0.379-0.362=0.017
min1811.968-1811.940=0.028
max1812.791-1812.705=0.086
mean840.000
σ0.000
min840.000
max840.000
mean2782.000-2467.000=315.000
σ0.000
min2782.000-2467.000=315.000
max2782.000-2467.000=315.000
mean2.945-2.839=0.106
σ0.107-0.016=0.091
min2.815-2.819=-0.004
max3.076-2.857=0.218
policies=200
mean18129.054-18129.090=-0.036
σ0.611-0.617=-0.006
min18128.645-18128.653=-0.008
max18129.945-18129.986=-0.041
mean8400.000
σ0.000
min8400.000
max8400.000
mean2782.000-2467.000=315.000
σ0.000
min2782.000-2467.000=315.000
max2782.000-2467.000=315.000
mean28.518-28.531=-0.013
σ0.023-0.039=-0.015
min28.492-28.498=-0.006
max28.549-28.575=-0.026