Compare commits

Home / Compare 8879c055 .. 4b92d31d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.702=-0.002
σ0.048-0.046=0.002
min70.663-70.672=-0.009
max70.831-70.829=0.002
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.158-0.159=-0.001
σ0.003-0.004=-0.001
min0.152-0.156=-0.003
max0.166-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.407-21.409=-0.001
σ0.002-0.003=-0.001
min21.405-21.404=0.000
max21.410-21.414=-0.004
mean415.500-412.000=3.500
σ0.527-0.000=0.527
min415.000-412.000=3.000
max416.000-412.000=4.000
mean0.062-0.064=-0.002
σ0.004-0.003=0.001
min0.058-0.060=-0.001
max0.069-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.897-1754.897=0.001
σ0.361-0.360=0.001
min1754.338-1754.331=0.008
max1755.488-1755.463=0.025
mean1631.700-1629.400=2.300
σ607.970-606.430=1.540
min633.000-631.000=2.000
max2447.000-2442.000=5.000
mean2.817-2.768=0.049
σ0.134-0.192=-0.058
min2.439-2.272=0.167
max2.991-2.951=0.040

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.756-272.755=0.001
σ0.007-0.007=-0.000
min272.748-272.748=-0.000
max272.767-272.765=0.002
mean2447.000-2442.000=5.000
σ0.000
min2447.000-2442.000=5.000
max2447.000-2442.000=5.000
mean0.392-0.383=0.009
σ0.009-0.011=-0.002
min0.383-0.369=0.014
max0.402-0.401=0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.132-1933.127=0.006
σ0.014-0.013=0.001
min1933.117-1933.117=0.000
max1933.148-1933.149=-0.001
mean2447.000-2442.000=5.000
σ0.000
min2447.000-2442.000=5.000
max2447.000-2442.000=5.000
mean2.991-3.100=-0.108
σ0.145-0.070=0.074
min2.765-3.020=-0.255
max3.168-3.182=-0.014
iters=5
new-facts=6402
prior-facts=1
mean4753.926-4753.742=0.184
σ1.012-1.023=-0.010
min4753.331-4752.891=0.441
max4755.731-4755.522=0.208
mean2447.000-2442.000=5.000
σ0.000
min2447.000-2442.000=5.000
max2447.000-2442.000=5.000
mean8.687-8.894=-0.207
σ0.733-0.089=0.644
min7.850-8.742=-0.892
max9.872-8.973=0.899
iters=5
new-facts=6402
prior-facts=6402
mean4944.291-4944.287=0.004
σ0.147-0.165=-0.018
min4944.030-4943.992=0.038
max4944.385-4944.374=0.011
mean2919.600-2964.200=-44.600
σ384.168-417.253=-33.085
min2447.000-2442.000=5.000
max3440.000-3521.000=-81.000
mean8.398-8.390=0.008
σ0.021-0.133=-0.112
min8.383-8.273=0.110
max8.435-8.594=-0.158

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.821-1.762=0.059
σ0.126-0.073=0.053
min1.634-1.670=-0.036
max1.984-1.847=0.136

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.999-468.998=0.001
σ575.613-575.610=0.002
min181.187-181.187=-0.000
max1332.418-1332.413=0.005
mean88.250
σ8.500
min84.000
max101.000
mean2447.000-2442.000=5.000
σ0.000
min2447.000-2442.000=5.000
max2447.000-2442.000=5.000
mean0.555-0.567=-0.011
σ0.524-0.551=-0.027
min0.288-0.288=0.000
max1.341-1.392=-0.051
policies=20
mean1812.206-1812.191=0.015
σ0.386-0.384=0.002
min1811.942-1811.947=-0.005
max1812.774-1812.758=0.015
mean840.000
σ0.000
min840.000
max840.000
mean2447.000-2442.000=5.000
σ0.000
min2447.000-2442.000=5.000
max2447.000-2442.000=5.000
mean2.872-2.836=0.035
σ0.035-0.020=0.016
min2.848-2.822=0.026
max2.924-2.864=0.059
policies=200
mean18129.224-18129.236=-0.012
σ0.457-0.465=-0.008
min18128.943-18128.937=0.005
max18129.907-18129.929=-0.022
mean8400.000
σ0.000
min8400.000
max8400.000
mean2447.000-2442.000=5.000
σ0.000
min2447.000-2442.000=5.000
max2447.000-2442.000=5.000
mean28.740-28.598=0.142
σ0.160-0.091=0.069
min28.620-28.470=0.150
max28.974-28.672=0.302