Compare commits

Home / Compare 5d06193f .. 57e742c7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.700-70.703=-0.002
σ0.045-0.046=-0.001
min70.675-70.677=-0.001
max70.826-70.832=-0.006
mean417.800-417.500=0.300
σ0.422-0.527=-0.105
min417.000
max418.000
mean0.161-0.160=0.001
σ0.003-0.004=-0.001
min0.157-0.151=0.006
max0.166-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.409-21.409=0.000
σ0.003-0.002=0.000
min21.405-21.404=0.000
max21.413-21.413=0.000
mean418.000
σ0.000
min418.000
max418.000
mean0.065-0.064=0.001
σ0.003-0.003=-0.000
min0.061-0.060=0.001
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.899=0.031
σ0.360-0.360=-0.000
min1754.366-1754.326=0.040
max1755.512-1755.469=0.043
mean1639.900-1641.350=-1.450
σ617.779-619.063=-1.284
min635.000
max2480.000-2482.000=-2.000
mean2.822-2.784=0.038
σ0.148-0.186=-0.038
min2.568-2.344=0.224
max3.309-2.994=0.315

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.759-272.759=0.000
σ0.006-0.006=-0.000
min272.750-272.749=0.002
max272.766-272.765=0.001
mean2480.000-2482.000=-2.000
σ0.000
min2480.000-2482.000=-2.000
max2480.000-2482.000=-2.000
mean0.386-0.387=-0.001
σ0.011-0.007=0.004
min0.378-0.382=-0.004
max0.401-0.399=0.002
iters=5
new-facts=1
prior-facts=6402
mean1933.162-1933.126=0.036
σ0.009-0.008=0.001
min1933.150-1933.114=0.037
max1933.176-1933.136=0.040
mean2480.000-2482.000=-2.000
σ0.000
min2480.000-2482.000=-2.000
max2480.000-2482.000=-2.000
mean3.032-3.074=-0.042
σ0.066-0.134=-0.069
min2.940-2.901=0.039
max3.105-3.239=-0.134
iters=5
new-facts=6402
prior-facts=1
mean4756.897-4753.905=2.992
σ7.617-0.969=6.648
min4753.473-4753.362=0.111
max4770.522-4755.625=14.896
mean2480.000-2482.000=-2.000
σ0.000
min2480.000-2482.000=-2.000
max2480.000-2482.000=-2.000
mean8.639-8.692=-0.054
σ0.442-0.635=-0.193
min7.859-7.718=0.141
max8.937-9.387=-0.450
iters=5
new-facts=6402
prior-facts=6402
mean4944.398-4944.227=0.172
σ0.014-0.191=-0.176
min4944.379-4944.011=0.368
max4944.411-4944.383=0.028
mean3006.800
σ302.480-298.793=3.687
min2611.000-2613.000=-2.000
max3390.000-3383.000=7.000
mean8.496-8.552=-0.056
σ0.118-0.174=-0.056
min8.380-8.349=0.032
max8.685-8.805=-0.120

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.721-1.789=-0.067
σ0.073-0.098=-0.025
min1.602-1.698=-0.096
max1.788-1.899=-0.111

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.316-468.999=-0.683
σ574.257-575.612=-1.355
min181.186-181.185=0.001
max1329.702-1332.417=-2.715
mean88.250
σ8.500
min84.000
max101.000
mean2480.000-2482.000=-2.000
σ0.000
min2480.000-2482.000=-2.000
max2480.000-2482.000=-2.000
mean0.546-0.557=-0.011
σ0.543-0.528=0.014
min0.270-0.286=-0.017
max1.360-1.349=0.010
policies=20
mean1812.187-1812.192=-0.004
σ0.412-0.384=0.028
min1811.925-1811.941=-0.016
max1812.799-1812.758=0.041
mean840.000
σ0.000
min840.000
max840.000
mean2480.000-2482.000=-2.000
σ0.000
min2480.000-2482.000=-2.000
max2480.000-2482.000=-2.000
mean2.849-2.853=-0.004
σ0.063-0.027=0.037
min2.809-2.820=-0.011
max2.942-2.884=0.058
policies=200
mean18129.056-18129.257=-0.201
σ0.501-0.492=0.009
min18128.752-18128.890=-0.138
max18129.805-18129.983=-0.178
mean8400.000
σ0.000
min8400.000
max8400.000
mean2480.000-2482.000=-2.000
σ0.000
min2480.000-2482.000=-2.000
max2480.000-2482.000=-2.000
mean28.297-28.578=-0.282
σ0.086-0.088=-0.002
min28.181-28.454=-0.273
max28.384-28.659=-0.275