Compare commits

Home / Compare f5d2e267 .. 4fa314be

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.780=0.003
σ0.047-0.046=0.001
min70.750-70.749=0.001
max70.911-70.907=0.004
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.160-0.156=0.005
σ0.003-0.006=-0.003
min0.158-0.149=0.009
max0.165-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.493-21.492=0.000
σ0.002-0.003=-0.001
min21.489-21.489=-0.000
max21.496-21.500=-0.004
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.065-0.061=0.004
σ0.003-0.003=0.000
min0.063-0.059=0.004
max0.074-0.066=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.126-1754.126=-0.001
σ0.363-0.361=0.002
min1753.559-1753.563=-0.004
max1754.711-1754.698=0.013
mean1664.050-1638.600=25.450
σ632.627-609.343=23.284
min665.000-637.000=28.000
max2617.000-2457.000=160.000
mean2.733-2.823=-0.090
σ0.194-0.180=0.014
min2.300-2.264=0.035
max2.990-3.192=-0.203

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.951-271.951=0.000
σ0.008-0.008=-0.000
min271.943-271.938=0.006
max271.963-271.956=0.006
mean2617.000-2457.000=160.000
σ0.000
min2617.000-2457.000=160.000
max2617.000-2457.000=160.000
mean0.377-0.376=0.001
σ0.000-0.001=-0.000
min0.376-0.375=0.001
max0.377-0.377=0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.355-1932.365=-0.011
σ0.018-0.010=0.008
min1932.332-1932.353=-0.021
max1932.377-1932.378=-0.001
mean2617.000-2457.000=160.000
σ0.000
min2617.000-2457.000=160.000
max2617.000-2457.000=160.000
mean3.001-2.943=0.058
σ0.148-0.261=-0.113
min2.754-2.636=0.119
max3.137-3.339=-0.202
iters=5
new-facts=6402
prior-facts=1
mean4756.084-4756.101=-0.017
σ7.631-7.585=0.046
min4752.627-4752.639=-0.012
max4769.735-4769.670=0.065
mean2617.000-2457.000=160.000
σ0.000
min2617.000-2457.000=160.000
max2617.000-2457.000=160.000
mean8.810-8.666=0.144
σ0.218-0.317=-0.099
min8.470-8.342=0.129
max9.075-9.051=0.023
iters=5
new-facts=6402
prior-facts=6402
mean4943.591-4943.521=0.069
σ0.015-0.152=-0.137
min4943.574-4943.251=0.324
max4943.606-4943.606=-0.000
mean2945.600-2989.000=-43.400
σ347.484-283.036=64.448
min2617.000-2598.000=19.000
max3443.000-3326.000=117.000
mean8.369-8.530=-0.161
σ0.041-0.139=-0.098
min8.306-8.407=-0.101
max8.408-8.745=-0.337

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.193-1.584=-0.391
σ0.298-0.089=0.209
min0.916-1.469=-0.553
max1.636-1.689=-0.052

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.977-467.978=-0.001
σ573.576-573.569=0.007
min181.186-181.187=-0.001
max1328.341-1328.332=0.009
mean88.250
σ8.500
min84.000
max101.000
mean2617.000-2457.000=160.000
σ0.000
min2617.000-2457.000=160.000
max2617.000-2457.000=160.000
mean0.555-0.569=-0.014
σ0.544-0.563=-0.019
min0.282-0.281=0.001
max1.370-1.413=-0.043
policies=20
mean1812.149-1812.180=-0.031
σ0.381-0.388=-0.007
min1811.903-1811.919=-0.015
max1812.716-1812.754=-0.039
mean840.000
σ0.000
min840.000
max840.000
mean2617.000-2457.000=160.000
σ0.000
min2617.000-2457.000=160.000
max2617.000-2457.000=160.000
mean2.815-2.803=0.012
σ0.017-0.013=0.004
min2.790-2.784=0.006
max2.828-2.816=0.012
policies=200
mean18129.042-18129.081=-0.039
σ0.547-0.495=0.052
min18128.593-18128.808=-0.215
max18129.838-18129.823=0.015
mean8400.000
σ0.000
min8400.000
max8400.000
mean2617.000-2457.000=160.000
σ0.000
min2617.000-2457.000=160.000
max2617.000-2457.000=160.000
mean28.291-28.319=-0.028
σ0.137-0.078=0.058
min28.159-28.246=-0.087
max28.480-28.411=0.068