Compare commits

Home / Compare 520ad2a2 .. 777e40ca

grey: no significant change wrt stddev

red: change exceeding max stddev

purple: some change, not seemingly significant

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	53.913
σ	0.366
min	53.777
max	54.954

*mean*	413.000
σ	0.000
min	413.000
max	413.000

*mean*	0.135
σ	0.005
min	0.128
max	0.143

cache=y

dps=1

iters=10

policies=100

*mean*	43.144
σ	0.013
min	43.128
max	43.174

*mean*	413.000
σ	0.000
min	413.000
max	413.000

*mean*	0.121
σ	0.004
min	0.113
max	0.126

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	991.810
σ	1.266
min	991.249
max	997.141

*mean*	1065.950
σ	322.618
min	572.000
max	1630.000

*mean*	1.523
σ	0.076
min	1.388
max	1.749

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	285.408
σ	0.011
min	285.390
max	285.418

*mean*	1630.000
σ	0.000
min	1630.000
max	1630.000

*mean*	0.371
σ	0.006
min	0.368
max	0.382

iters=5

new-facts=1

prior-facts=6402

*mean*	1285.378
σ	0.131
min	1285.313
max	1285.612

*mean*	1630.000
σ	0.000
min	1630.000
max	1630.000

*mean*	1.892
σ	0.133
min	1.791
max	2.121

iters=5

new-facts=6402

prior-facts=1

*mean*	1807.688
σ	7.001
min	1804.326
max	1820.198

*mean*	1630.000
σ	0.000
min	1630.000
max	1630.000

*mean*	4.129
σ	0.238
min	3.845
max	4.381

iters=5

new-facts=6402

prior-facts=6402

*mean*	2070.204
σ	0.017
min	2070.188
max	2070.231

*mean*	1862.800
σ	196.827
min	1630.000
max	2078.000

*mean*	4.642
σ	0.245
min	4.421
max	5.040

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.183
σ	0.318
min	0.907
max	1.718

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	436.780
σ	572.354
min	150.596
max	1295.312

*mean*	90.250
σ	8.500
min	86.000
max	103.000

*mean*	1630.000
σ	0.000
min	1630.000
max	1630.000

*mean*	0.501
σ	0.502
min	0.249
max	1.255

policies=20

*mean*	1506.263
σ	0.228
min	1506.110
max	1506.603

*mean*	860.000
σ	0.000
min	860.000
max	860.000

*mean*	1630.000
σ	0.000
min	1630.000
max	1630.000

*mean*	2.509
σ	0.010
min	2.501
max	2.524

policies=200

*mean*	15070.295
σ	0.073
min	15070.247
max	15070.404

*mean*	8600.000
σ	0.000
min	8600.000
max	8600.000

*mean*	1630.000
σ	0.000
min	1630.000
max	1630.000

*mean*	25.503
σ	0.134
min	25.312
max	25.618