Compare commits

Home / Compare 5bbd50d5 .. 5e19c13a

grey: no significant change wrt stddev

red: change exceeding max stddev

purple: some change, not seemingly significant

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	53.914
σ	0.366
min	53.778
max	54.955

*mean*	415.000
σ	0.000
min	415.000
max	415.000

*mean*	0.140
σ	0.005
min	0.135
max	0.148

cache=y

dps=1

iters=10

policies=100

*mean*	43.144
σ	0.012
min	43.129
max	43.169

*mean*	415.000
σ	0.000
min	415.000
max	415.000

*mean*	0.119
σ	0.004
min	0.114
max	0.126

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	992.085
σ	1.232
min	991.502
max	997.254

*mean*	1064.800
σ	322.441
min	568.000
max	1639.000

*mean*	1.524
σ	0.069
min	1.416
max	1.715

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	285.677
σ	0.015
min	285.652
max	285.694

*mean*	1639.000
σ	0.000
min	1639.000
max	1639.000

*mean*	0.374
σ	0.001
min	0.373
max	0.375

iters=5

new-facts=1

prior-facts=6402

*mean*	1285.646
σ	0.142
min	1285.578
max	1285.899

*mean*	1639.000
σ	0.000
min	1639.000
max	1639.000

*mean*	1.930
σ	0.143
min	1.854
max	2.186

iters=5

new-facts=6402

prior-facts=1

*mean*	1808.003
σ	6.991
min	1804.585
max	1820.492

*mean*	1639.000
σ	0.000
min	1639.000
max	1639.000

*mean*	4.196
σ	0.251
min	3.873
max	4.393

iters=5

new-facts=6402

prior-facts=6402

*mean*	2070.467
σ	0.012
min	2070.453
max	2070.485

*mean*	1843.600
σ	182.410
min	1639.000
max	2081.000

*mean*	4.510
σ	0.020
min	4.481
max	4.535

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.192
σ	0.301
min	0.920
max	1.695

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	437.385
σ	572.361
min	151.198
max	1295.927

*mean*	90.250
σ	8.500
min	86.000
max	103.000

*mean*	1639.000
σ	0.000
min	1639.000
max	1639.000

*mean*	0.506
σ	0.502
min	0.253
max	1.259

policies=20

*mean*	1512.236
σ	0.239
min	1512.085
max	1512.593

*mean*	860.000
σ	0.000
min	860.000
max	860.000

*mean*	1639.000
σ	0.000
min	1639.000
max	1639.000

*mean*	2.533
σ	0.021
min	2.510
max	2.560

policies=200

*mean*	15130.071
σ	0.153
min	15129.954
max	15130.277

*mean*	8600.000
σ	0.000
min	8600.000
max	8600.000

*mean*	1639.000
σ	0.000
min	1639.000
max	1639.000

*mean*	25.592
σ	0.115
min	25.450
max	25.687