Compare commits

Home / Compare 026d5163 .. 5e90aaf7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.568-70.567=0.001
σ0.046-0.045=0.001
min70.537-70.542=-0.005
max70.693-70.690=0.003
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.163-0.159=0.005
σ0.009-0.004=0.005
min0.150-0.150=-0.001
max0.180-0.165=0.015
cache=y
dps=1
iters=10
policies=100
mean21.286-21.287=-0.002
σ0.003-0.003=0.000
min21.282-21.281=0.001
max21.292-21.291=0.001
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.065-0.065=0.000
σ0.003-0.002=0.000
min0.063-0.063=-0.000
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.375=-0.000
σ0.361-0.361=-0.000
min1752.804-1752.799=0.005
max1753.962-1753.946=0.016
mean1657.700-1662.250=-4.550
σ642.274-629.665=12.609
min621.000-681.000=-60.000
max2764.000-2663.000=101.000
mean2.812-2.771=0.041
σ0.172-0.217=-0.045
min2.266-2.358=-0.092
max3.127-3.106=0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.755-271.751=0.004
σ0.007-0.006=0.001
min271.748-271.742=0.006
max271.765-271.757=0.008
mean2764.000-2663.000=101.000
σ0.000
min2764.000-2663.000=101.000
max2764.000-2663.000=101.000
mean0.382-0.379=0.003
σ0.006-0.007=-0.001
min0.376-0.369=0.007
max0.391-0.389=0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.183-1932.172=0.012
σ0.010-0.016=-0.006
min1932.173-1932.148=0.025
max1932.198-1932.190=0.008
mean2764.000-2663.000=101.000
σ0.000
min2764.000-2663.000=101.000
max2764.000-2663.000=101.000
mean2.913-2.933=-0.020
σ0.177-0.254=-0.077
min2.604-2.489=0.115
max3.052-3.107=-0.055
iters=5
new-facts=6402
prior-facts=1
mean4752.771-4752.896=-0.125
σ0.602-1.010=-0.408
min4752.444-4752.354=0.090
max4753.845-4754.700=-0.855
mean2764.000-2663.000=101.000
σ0.000
min2764.000-2663.000=101.000
max2764.000-2663.000=101.000
mean8.588-8.929=-0.341
σ0.305-0.487=-0.182
min8.178-8.396=-0.218
max8.919-9.716=-0.797
iters=5
new-facts=6402
prior-facts=6402
mean4943.377-4943.302=0.075
σ0.018-0.152=-0.134
min4943.350-4943.031=0.319
max4943.399-4943.391=0.008
mean3041.800-2973.600=68.200
σ233.898-244.337=-10.440
min2764.000-2663.000=101.000
max3324.000-3306.000=18.000
mean8.710-8.608=0.102
σ0.373-0.195=0.178
min8.425-8.456=-0.031
max9.332-8.929=0.403

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.052-1.085=-0.033
σ0.124-0.199=-0.075
min0.939-0.939=0.000
max1.241-1.350=-0.109

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.858-467.860=-0.002
σ575.934-575.937=-0.003
min179.883-179.889=-0.006
max1331.759-1331.766=-0.007
mean86.250
σ8.500
min82.000
max99.000
mean2764.000-2663.000=101.000
σ0.000
min2764.000-2663.000=101.000
max2764.000-2663.000=101.000
mean0.478-0.565=-0.086
σ0.386-0.561=-0.175
min0.279-0.281=-0.001
max1.058-1.407=-0.349
policies=20
mean1799.170-1799.141=0.030
σ0.341-0.349=-0.008
min1798.912-1798.917=-0.005
max1799.672-1799.660=0.012
mean820.000
σ0.000
min820.000
max820.000
mean2764.000-2663.000=101.000
σ0.000
min2764.000-2663.000=101.000
max2764.000-2663.000=101.000
mean2.798-2.800=-0.002
σ0.017-0.007=0.009
min2.783-2.792=-0.009
max2.813-2.809=0.004
policies=200
mean17998.413-17998.390=0.023
σ0.464-0.620=-0.155
min17998.001-17997.947=0.054
max17999.080-17999.302=-0.222
mean8200.000
σ0.000
min8200.000
max8200.000
mean2764.000-2663.000=101.000
σ0.000
min2764.000-2663.000=101.000
max2764.000-2663.000=101.000
mean28.124-28.173=-0.049
σ0.108-0.229=-0.121
min28.025-28.033=-0.008
max28.277-28.512=-0.235