Compare commits

Home / Compare 184ae2ac .. 26c9d4e2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.701=0.000
σ0.047-0.049=-0.001
min70.672-70.663=0.008
max70.831-70.835=-0.003
mean415.000-412.600=2.400
σ0.000-0.516=-0.516
min415.000-412.000=3.000
max415.000-413.000=2.000
mean0.159-0.157=0.002
σ0.010-0.007=0.004
min0.136-0.149=-0.014
max0.177-0.169=0.008
cache=y
dps=1
iters=10
policies=100
mean21.408-21.408=-0.000
σ0.003-0.002=0.001
min21.404-21.406=-0.001
max21.412-21.412=0.000
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.064-0.064=0.000
σ0.004-0.003=0.001
min0.060-0.058=0.001
max0.072-0.067=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.929=0.001
σ0.361-0.362=-0.000
min1754.363-1754.354=0.009
max1755.515-1755.513=0.003
mean1645.450-1660.750=-15.300
σ632.353-622.538=9.815
min623.000-632.000=-9.000
max2772.000-2503.000=269.000
mean2.810-2.802=0.008
σ0.224-0.171=0.053
min2.284-2.347=-0.063
max3.267-3.129=0.138

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.791-272.791=-0.001
σ0.006-0.005=0.001
min272.784-272.787=-0.003
max272.795-272.798=-0.003
mean2772.000-2503.000=269.000
σ0.000
min2772.000-2503.000=269.000
max2772.000-2503.000=269.000
mean0.379-0.379=-0.000
σ0.001-0.002=-0.001
min0.377-0.376=0.001
max0.380-0.382=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1933.215-1933.221=-0.007
σ0.013-0.019=-0.006
min1933.193-1933.195=-0.003
max1933.225-1933.236=-0.011
mean2772.000-2503.000=269.000
σ0.000
min2772.000-2503.000=269.000
max2772.000-2503.000=269.000
mean3.030-3.004=0.026
σ0.028-0.324=-0.296
min2.997-2.473=0.523
max3.066-3.350=-0.283
iters=5
new-facts=6402
prior-facts=1
mean4756.926-4756.945=-0.018
σ7.598-7.592=0.006
min4753.445-4753.443=0.002
max4770.518-4770.525=-0.007
mean2772.000-2503.000=269.000
σ0.000
min2772.000-2503.000=269.000
max2772.000-2503.000=269.000
mean8.716-8.642=0.074
σ0.323-0.302=0.021
min8.306-8.378=-0.072
max9.176-9.092=0.083
iters=5
new-facts=6402
prior-facts=6402
mean4944.385-4944.455=-0.070
σ0.160-0.044=0.116
min4944.100-4944.419=-0.319
max4944.476-4944.526=-0.050
mean2987.800-2973.800=14.000
σ211.143-397.020=-185.878
min2772.000-2503.000=269.000
max3298.000-3518.000=-220.000
mean8.602-8.433=0.170
σ0.193-0.079=0.114
min8.437-8.334=0.103
max8.913-8.553=0.360

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.980-1.533=-0.553
σ0.137-0.181=-0.043
min0.911-1.295=-0.384
max1.225-1.757=-0.532

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.323-468.307=0.016
σ574.231-574.232=-0.001
min181.203-181.185=0.018
max1329.669-1329.654=0.015
mean88.250
σ8.500
min84.000
max101.000
mean2772.000-2503.000=269.000
σ0.000
min2772.000-2503.000=269.000
max2772.000-2503.000=269.000
mean0.444-0.552=-0.108
σ0.299-0.540=-0.241
min0.291-0.277=0.014
max0.892-1.361=-0.470
policies=20
mean1812.375-1812.178=0.198
σ0.389-0.401=-0.011
min1812.108-1811.913=0.195
max1812.949-1812.773=0.176
mean840.000
σ0.000
min840.000
max840.000
mean2772.000-2503.000=269.000
σ0.000
min2772.000-2503.000=269.000
max2772.000-2503.000=269.000
mean2.863-2.827=0.036
σ0.010-0.038=-0.028
min2.852-2.784=0.068
max2.876-2.876=-0.001
policies=200
mean18129.113-18129.040=0.073
σ0.477-0.458=0.019
min18128.783-18128.750=0.032
max18129.809-18129.722=0.087
mean8400.000
σ0.000
min8400.000
max8400.000
mean2772.000-2503.000=269.000
σ0.000
min2772.000-2503.000=269.000
max2772.000-2503.000=269.000
mean28.438-28.242=0.196
σ0.149-0.059=0.089
min28.268-28.157=0.110
max28.567-28.285=0.282