Compare commits

Home / Compare e15ce9e8 .. bd6dfead

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-70.702=-35.084
σ0.056-0.047=0.008
min35.588-70.666=-35.078
max35.775-70.831=-35.057
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.083-0.160=-0.077
σ0.006-0.003=0.003
min0.076-0.157=-0.081
max0.094-0.166=-0.072
cache=y
dps=1
iters=10
policies=100
mean24.048-21.408=2.639
σ0.004-0.003=0.001
min24.042-21.403=2.638
max24.053-21.412=2.641
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.066-0.065=0.000
σ0.003-0.003=-0.001
min0.061-0.061=0.000
max0.067-0.074=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1754.931=1.558
σ0.364-0.360=0.004
min1755.916-1754.358=1.558
max1757.082-1755.503=1.579
mean1650.700-1627.000=23.700
σ641.545-593.618=47.927
min634.000-624.000=10.000
max2834.000-2413.000=421.000
mean2.371-2.782=-0.412
σ0.144-0.192=-0.048
min2.265-2.286=-0.021
max2.903-3.024=-0.121

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.764-272.757=52.007
σ0.046-0.003=0.043
min324.683-272.752=51.931
max324.794-272.761=52.033
mean2834.000-2413.000=421.000
σ0.000
min2834.000-2413.000=421.000
max2834.000-2413.000=421.000
mean0.422-0.385=0.037
σ0.001-0.006=-0.004
min0.421-0.380=0.041
max0.424-0.393=0.031
iters=5
new-facts=1
prior-facts=6402
mean1985.327-1933.157=52.171
σ0.004-0.018=-0.014
min1985.322-1933.132=52.190
max1985.330-1933.180=52.150
mean2834.000-2413.000=421.000
σ0.000
min2834.000-2413.000=421.000
max2834.000-2413.000=421.000
mean2.691-2.837=-0.145
σ0.176-0.244=-0.067
min2.543-2.504=0.040
max2.905-3.152=-0.248
iters=5
new-facts=6402
prior-facts=1
mean4809.078-4756.724=52.354
σ7.694-7.714=-0.020
min4805.584-4752.877=52.707
max4822.842-4770.512=52.330
mean2834.000-2413.000=421.000
σ0.000
min2834.000-2413.000=421.000
max2834.000-2413.000=421.000
mean8.797-8.636=0.161
σ0.144-0.385=-0.242
min8.591-8.082=0.510
max8.944-9.026=-0.082
iters=5
new-facts=6402
prior-facts=6402
mean4996.624-4944.254=52.371
σ0.021-0.193=-0.173
min4996.596-4944.026=52.570
max4996.647-4944.403=52.243
mean3035.000-2894.800=140.200
σ207.434-388.802=-181.368
min2834.000-2413.000=421.000
max3327.000-3400.000=-73.000
mean8.692-8.422=0.269
σ0.191-0.068=0.122
min8.476-8.366=0.110
max8.994-8.517=0.478

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.009-1.775=-0.765
σ0.134-0.106=0.028
min0.921-1.607=-0.686
max1.226-1.887=-0.662

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.214-468.313=-5.099
σ574.770-574.253=0.516
min175.819-181.184=-5.365
max1325.369-1329.693=-4.324
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2834.000-2413.000=421.000
σ0.000
min2834.000-2413.000=421.000
max2834.000-2413.000=421.000
mean0.434-0.546=-0.112
σ0.307-0.531=-0.224
min0.278-0.272=0.006
max0.895-1.342=-0.447
policies=20
mean1758.503-1812.169=-53.666
σ0.339-0.397=-0.058
min1758.274-1811.908=-53.634
max1759.006-1812.756=-53.750
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2834.000-2413.000=421.000
σ0.000
min2834.000-2413.000=421.000
max2834.000-2413.000=421.000
mean2.786-2.823=-0.037
σ0.004-0.009=-0.004
min2.780-2.814=-0.034
max2.791-2.834=-0.043
policies=200
mean17592.146-18128.879=-536.733
σ0.515-0.395=0.120
min17591.826-18128.596=-536.770
max17592.910-18129.447=-536.537
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2834.000-2413.000=421.000
σ0.000
min2834.000-2413.000=421.000
max2834.000-2413.000=421.000
mean27.868-28.407=-0.540
σ0.344-0.017=0.327
min27.550-28.387=-0.837
max28.272-28.426=-0.154