Compare commits

Home / Compare 2197643f .. 56e61771

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.784-70.773=0.010
σ0.047-0.053=-0.006
min70.748-70.740=0.008
max70.914-70.919=-0.005
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.158-0.159=-0.001
σ0.005-0.004=0.001
min0.150-0.155=-0.004
max0.165-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.493-21.490=0.003
σ0.002-0.002=0.000
min21.490-21.487=0.002
max21.496-21.493=0.003
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.065-0.065=0.001
σ0.002-0.003=-0.000
min0.064-0.063=0.001
max0.072-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.895-1755.286=-0.391
σ0.360-0.357=0.003
min1754.322-1754.724=-0.403
max1755.486-1755.851=-0.366
mean1665.700-1629.400=36.300
σ642.651-593.982=48.669
min678.000-640.000=38.000
max2704.000-2421.000=283.000
mean2.798-2.820=-0.021
σ0.254-0.219=0.035
min2.150-2.277=-0.127
max3.503-3.182=0.321

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.759-272.769=-0.010
σ0.006-0.008=-0.002
min272.754-272.758=-0.004
max272.767-272.778=-0.011
mean2704.000-2421.000=283.000
σ0.000
min2704.000-2421.000=283.000
max2704.000-2421.000=283.000
mean0.383-0.383=0.000
σ0.004-0.005=-0.001
min0.379-0.379=0.000
max0.390-0.390=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1933.130-1933.158=-0.028
σ0.011-0.021=-0.011
min1933.121-1933.124=-0.004
max1933.146-1933.177=-0.032
mean2704.000-2421.000=283.000
σ0.000
min2704.000-2421.000=283.000
max2704.000-2421.000=283.000
mean3.103-3.127=-0.024
σ0.094-0.152=-0.058
min2.990-2.953=0.036
max3.189-3.352=-0.163
iters=5
new-facts=6402
prior-facts=1
mean4753.838-4753.937=-0.100
σ0.938-0.824=0.114
min4753.128-4753.521=-0.393
max4755.479-4755.409=0.070
mean2704.000-2421.000=283.000
σ0.000
min2704.000-2421.000=283.000
max2704.000-2421.000=283.000
mean8.480-8.342=0.138
σ0.498-0.336=0.162
min7.962-7.765=0.197
max9.063-8.557=0.506
iters=5
new-facts=6402
prior-facts=6402
mean4944.357-4944.317=0.040
σ0.018-0.163=-0.144
min4944.332-4944.027=0.304
max4944.375-4944.409=-0.034
mean2996.000-2906.800=89.200
σ328.917-406.809=-77.892
min2704.000-2438.000=266.000
max3465.000-3461.000=4.000
mean8.433-8.498=-0.065
σ0.095-0.168=-0.073
min8.327-8.343=-0.016
max8.564-8.781=-0.217

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.104-1.756=-0.652
σ0.142-0.226=-0.084
min0.930-1.362=-0.432
max1.257-1.913=-0.656

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.644-472.833=-4.190
σ574.894-574.920=-0.026
min181.186-185.368=-4.181
max1330.985-1335.213=-4.228
mean88.250
σ8.500
min84.000
max101.000
mean2704.000-2421.000=283.000
σ0.000
min2704.000-2421.000=283.000
max2704.000-2421.000=283.000
mean0.583-0.583=0.000
σ0.594-0.593=0.001
min0.284-0.284=-0.000
max1.475-1.473=0.002
policies=20
mean1812.172-1853.967=-41.796
σ0.379-0.372=0.007
min1811.926-1853.719=-41.793
max1812.733-1854.518=-41.785
mean840.000
σ0.000
min840.000
max840.000
mean2704.000-2421.000=283.000
σ0.000
min2704.000-2421.000=283.000
max2704.000-2421.000=283.000
mean2.833-2.851=-0.018
σ0.022-0.016=0.005
min2.804-2.827=-0.023
max2.856-2.864=-0.008
policies=200
mean18129.190-18546.668=-417.478
σ0.528-0.418=0.110
min18128.806-18546.378=-417.572
max18129.970-18547.287=-417.317
mean8400.000
σ0.000
min8400.000
max8400.000
mean2704.000-2421.000=283.000
σ0.000
min2704.000-2421.000=283.000
max2704.000-2421.000=283.000
mean28.500-28.819=-0.319
σ0.071-0.072=-0.001
min28.413-28.732=-0.319
max28.563-28.882=-0.319