Compare commits

Home / Compare ef5ea6ed .. 90b0b974

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.245=-0.001
σ0.054-0.051=0.003
min35.217-35.219=-0.002
max35.397-35.389=0.008
mean415.000-415.300=-0.300
σ0.000-0.483=-0.483
min415.000
max415.000-416.000=-1.000
mean0.083-0.083=-0.000
σ0.005-0.004=0.001
min0.078-0.075=0.002
max0.092-0.092=0.000
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.002
σ0.004-0.003=0.001
min23.762-23.767=-0.005
max23.775-23.778=-0.003
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.065-0.067=-0.002
σ0.004-0.001=0.003
min0.062-0.065=-0.004
max0.072-0.067=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.364=0.122
σ0.366-0.365=0.001
min1755.910-1755.786=0.123
max1757.075-1756.949=0.126
mean1626.800-1643.000=-16.200
σ591.338-629.371=-38.033
min645.000-653.000=-8.000
max2413.000-2838.000=-425.000
mean2.354-2.315=0.039
σ0.104-0.080=0.024
min2.176-2.146=0.030
max2.649-2.482=0.168

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.710-324.581=0.129
σ0.032-0.063=-0.030
min324.653-324.470=0.183
max324.729-324.622=0.107
mean2413.000-2838.000=-425.000
σ0.000
min2413.000-2838.000=-425.000
max2413.000-2838.000=-425.000
mean0.423-0.431=-0.008
σ0.001-0.009=-0.008
min0.422-0.421=0.001
max0.424-0.442=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1985.266-1985.146=0.120
σ0.010-0.008=0.002
min1985.248-1985.140=0.108
max1985.272-1985.161=0.111
mean2413.000-2838.000=-425.000
σ0.000
min2413.000-2838.000=-425.000
max2413.000-2838.000=-425.000
mean2.611-2.602=0.008
σ0.104-0.056=0.048
min2.502-2.552=-0.050
max2.776-2.667=0.108
iters=5
new-facts=6402
prior-facts=1
mean4808.867-4808.535=0.332
σ7.655-7.834=-0.179
min4805.387-4804.140=1.247
max4822.560-4822.517=0.044
mean2413.000-2838.000=-425.000
σ0.000
min2413.000-2838.000=-425.000
max2413.000-2838.000=-425.000
mean8.928-8.639=0.289
σ0.150-0.476=-0.327
min8.766-7.817=0.949
max9.070-9.053=0.017
iters=5
new-facts=6402
prior-facts=6402
mean4996.467-4996.348=0.119
σ0.013-0.019=-0.006
min4996.452-4996.327=0.125
max4996.481-4996.368=0.113
mean2949.400-3049.800=-100.400
σ447.286-184.333=262.953
min2413.000-2838.000=-425.000
max3541.000-3310.000=231.000
mean8.553-8.617=-0.065
σ0.216-0.136=0.080
min8.404-8.463=-0.059
max8.918-8.790=0.128

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.647-1.052=0.595
σ0.167-0.150=0.017
min1.359-0.918=0.441
max1.772-1.297=0.475

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.944-462.975=-0.031
σ574.247-574.252=-0.004
min175.819-175.836=-0.017
max1324.314-1324.352=-0.038
mean86.250
σ8.500
min82.000
max99.000
mean2413.000-2838.000=-425.000
σ0.000
min2413.000-2838.000=-425.000
max2413.000-2838.000=-425.000
mean0.543-0.432=0.111
σ0.535-0.301=0.234
min0.273-0.278=-0.005
max1.345-0.884=0.462
policies=20
mean1758.479-1758.710=-0.231
σ0.267-0.359=-0.092
min1758.284-1758.459=-0.175
max1758.871-1759.239=-0.368
mean820.000
σ0.000
min820.000
max820.000
mean2413.000-2838.000=-425.000
σ0.000
min2413.000-2838.000=-425.000
max2413.000-2838.000=-425.000
mean2.716-2.830=-0.115
σ0.014-0.063=-0.049
min2.701-2.757=-0.056
max2.728-2.902=-0.175
policies=200
mean17592.324-17593.346=-1.022
σ0.463-0.606=-0.143
min17591.899-17592.546=-0.646
max17592.983-17593.822=-0.839
mean8200.000
σ0.000
min8200.000
max8200.000
mean2413.000-2838.000=-425.000
σ0.000
min2413.000-2838.000=-425.000
max2413.000-2838.000=-425.000
mean27.527-27.804=-0.277
σ0.079-0.397=-0.318
min27.411-27.411=0.000
max27.588-28.255=-0.668