Compare commits

Home / Compare b7891eff .. 3dff75cb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.729-70.732=-0.002
σ0.052-0.051=0.001
min70.693-70.702=-0.009
max70.873-70.873=-0.000
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.159-0.162=-0.003
σ0.003-0.003=0.001
min0.154-0.159=-0.005
max0.166-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.445-21.446=-0.001
σ0.003-0.003=0.000
min21.440-21.443=-0.003
max21.448-21.450=-0.002
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.062-0.065=-0.002
σ0.003-0.002=0.001
min0.059-0.063=-0.004
max0.069-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.287-1755.288=-0.001
σ0.360-0.361=-0.001
min1754.717-1754.722=-0.005
max1755.867-1755.876=-0.009
mean1657.700-1639.400=18.300
σ643.937-628.664=15.274
min623.000-619.000=4.000
max2851.000-2771.000=80.000
mean2.848-2.877=-0.029
σ0.121-0.220=-0.099
min2.656-2.165=0.490
max3.073-3.169=-0.096

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean274.368-274.363=0.005
σ0.009-0.008=0.002
min274.357-274.353=0.004
max274.381-274.371=0.010
mean2851.000-2771.000=80.000
σ0.000
min2851.000-2771.000=80.000
max2851.000-2771.000=80.000
mean0.387-0.383=0.004
σ0.004-0.001=0.004
min0.384-0.382=0.002
max0.394-0.384=0.010
iters=5
new-facts=1
prior-facts=6402
mean1934.752-1934.751=0.001
σ0.016-0.017=-0.000
min1934.725-1934.729=-0.003
max1934.767-1934.774=-0.008
mean2851.000-2771.000=80.000
σ0.000
min2851.000-2771.000=80.000
max2851.000-2771.000=80.000
mean3.057-3.051=0.006
σ0.073-0.105=-0.031
min3.000-2.926=0.074
max3.176-3.192=-0.016
iters=5
new-facts=6402
prior-facts=1
mean4755.509-4755.480=0.029
σ0.904-0.949=-0.045
min4754.967-4754.976=-0.009
max4757.119-4757.174=-0.055
mean2851.000-2771.000=80.000
σ0.000
min2851.000-2771.000=80.000
max2851.000-2771.000=80.000
mean8.751-8.797=-0.046
σ0.370-0.541=-0.171
min8.385-7.925=0.460
max9.268-9.266=0.002
iters=5
new-facts=6402
prior-facts=6402
mean4945.979-4945.915=0.065
σ0.020-0.167=-0.147
min4945.957-4945.619=0.338
max4946.011-4946.021=-0.011
mean3021.400-2992.400=29.000
σ191.359-207.535=-16.176
min2851.000-2771.000=80.000
max3317.000-3288.000=29.000
mean8.697-8.559=0.138
σ0.232-0.068=0.164
min8.459-8.491=-0.033
max9.063-8.645=0.418

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.048-1.045=0.003
σ0.240-0.171=0.069
min0.936-0.935=0.002
max1.478-1.332=0.146

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.842-472.856=-0.015
σ574.933-574.967=-0.034
min185.365-185.367=-0.002
max1335.241-1335.307=-0.066
mean88.250
σ8.500
min84.000
max101.000
mean2851.000-2771.000=80.000
σ0.000
min2851.000-2771.000=80.000
max2851.000-2771.000=80.000
mean0.489-0.608=-0.118
σ0.382-0.616=-0.234
min0.295-0.289=0.005
max1.062-1.532=-0.470
policies=20
mean1853.996-1853.968=0.028
σ0.368-0.362=0.006
min1853.715-1853.711=0.003
max1854.530-1854.502=0.028
mean840.000
σ0.000
min840.000
max840.000
mean2851.000-2771.000=80.000
σ0.000
min2851.000-2771.000=80.000
max2851.000-2771.000=80.000
mean2.957-2.883=0.074
σ0.004-0.038=-0.035
min2.952-2.849=0.103
max2.960-2.937=0.023
policies=200
mean18546.761-18546.596=0.165
σ0.479-0.376=0.103
min18546.453-18546.287=0.167
max18547.475-18547.130=0.344
mean8400.000
σ0.000
min8400.000
max8400.000
mean2851.000-2771.000=80.000
σ0.000
min2851.000-2771.000=80.000
max2851.000-2771.000=80.000
mean29.363-28.815=0.549
σ0.436-0.117=0.318
min28.917-28.663=0.254
max29.784-28.947=0.837