Compare commits

Home / Compare 709d0a8a .. edab06e5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-70.704=-35.459
σ0.053-0.046=0.008
min35.212-70.672=-35.460
max35.394-70.830=-35.435
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.084-0.162=-0.077
σ0.003-0.003=-0.001
min0.082-0.158=-0.076
max0.091-0.169=-0.078
cache=y
dps=1
iters=10
policies=100
mean23.769-21.408=2.361
σ0.003-0.003=-0.000
min23.763-21.402=2.360
max23.773-21.415=2.358
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.067-0.065=0.002
σ0.004-0.002=0.001
min0.062-0.063=-0.001
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.363-1754.929=1.434
σ0.366-0.360=0.005
min1755.790-1754.356=1.434
max1756.958-1755.510=1.448
mean1659.300-1645.150=14.150
σ621.593-632.787=-11.193
min667.000-619.000=48.000
max2643.000-2770.000=-127.000
mean2.328-2.829=-0.501
σ0.113-0.135=-0.023
min2.178-2.534=-0.357
max2.561-3.125=-0.564

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean316.677-272.758=43.920
σ17.686-0.006=17.680
min285.040-272.751=12.289
max324.608-272.766=51.842
mean2643.000-2770.000=-127.000
σ0.000
min2643.000-2770.000=-127.000
max2643.000-2770.000=-127.000
mean0.411-0.382=0.029
σ0.027-0.005=0.021
min0.363-0.376=-0.012
max0.424-0.388=0.036
iters=5
new-facts=1
prior-facts=6402
mean1985.147-1933.157=51.990
σ0.007-0.016=-0.009
min1985.137-1933.131=52.006
max1985.156-1933.173=51.983
mean2643.000-2770.000=-127.000
σ0.000
min2643.000-2770.000=-127.000
max2643.000-2770.000=-127.000
mean2.620-3.116=-0.495
σ0.095-0.235=-0.140
min2.520-2.768=-0.248
max2.730-3.386=-0.655
iters=5
new-facts=6402
prior-facts=1
mean4808.749-4756.922=51.828
σ7.674-7.558=0.116
min4805.267-4753.482=51.785
max4822.477-4770.441=52.036
mean2643.000-2770.000=-127.000
σ0.000
min2643.000-2770.000=-127.000
max2643.000-2770.000=-127.000
mean8.979-8.534=0.445
σ0.227-0.293=-0.066
min8.812-8.269=0.542
max9.376-8.903=0.473
iters=5
new-facts=6402
prior-facts=6402
mean4996.276-4944.317=51.959
σ0.145-0.153=-0.009
min4996.017-4944.046=51.971
max4996.349-4944.413=51.936
mean2986.200-3031.200=-45.000
σ273.258-322.532=-49.274
min2643.000-2770.000=-127.000
max3328.000-3518.000=-190.000
mean8.622-8.448=0.174
σ0.138-0.146=-0.008
min8.465-8.261=0.204
max8.829-8.669=0.160

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.126-0.970=0.157
σ0.294-0.132=0.162
min0.931-0.900=0.031
max1.641-1.205=0.436

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.957-468.341=-5.384
σ574.261-574.256=0.005
min175.820-181.203=-5.382
max1324.349-1329.725=-5.376
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2643.000-2770.000=-127.000
σ0.000
min2643.000-2770.000=-127.000
max2643.000-2770.000=-127.000
mean0.546-0.447=0.099
σ0.545-0.302=0.243
min0.272-0.295=-0.023
max1.363-0.900=0.463
policies=20
mean1758.509-1812.375=-53.866
σ0.351-0.387=-0.036
min1758.264-1812.106=-53.842
max1759.029-1812.943=-53.914
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2643.000-2770.000=-127.000
σ0.000
min2643.000-2770.000=-127.000
max2643.000-2770.000=-127.000
mean2.701-2.898=-0.198
σ0.006-0.012=-0.006
min2.694-2.891=-0.196
max2.709-2.917=-0.208
policies=200
mean17592.160-18128.910=-536.750
σ0.473-0.632=-0.159
min17591.812-18128.456=-536.644
max17592.850-18129.844=-536.994
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2643.000-2770.000=-127.000
σ0.000
min2643.000-2770.000=-127.000
max2643.000-2770.000=-127.000
mean27.338-28.490=-1.153
σ0.125-0.251=-0.126
min27.224-28.257=-1.033
max27.459-28.798=-1.339