Compare commits

Home / Compare 881f98ac .. cc597309

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.396-70.395=0.001
σ0.045-0.045=0.000
min70.373-70.371=0.002
max70.522-70.518=0.004
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.158-0.157=0.002
σ0.004-0.004=-0.000
min0.155-0.149=0.005
max0.164-0.160=0.004
cache=y
dps=1
iters=10
policies=100
mean21.145-21.144=0.001
σ0.003-0.003=-0.000
min21.141-21.139=0.002
max21.148-21.147=0.001
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.063-0.061=0.002
σ0.005-0.004=0.000
min0.058-0.058=0.000
max0.073-0.070=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.698-1752.699=-0.001
σ0.360-0.364=-0.004
min1752.126-1752.125=0.002
max1753.284-1753.283=0.001
mean1659.200-1658.700=0.500
σ639.276-629.708=9.568
min617.000-619.000=-2.000
max2789.000-2774.000=15.000
mean2.836-2.767=0.069
σ0.125-0.197=-0.072
min2.534-2.254=0.280
max3.096-3.064=0.033

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.607-270.609=-0.002
σ0.007-0.005=0.003
min270.597-270.602=-0.004
max270.614-270.613=0.001
mean2789.000-2774.000=15.000
σ0.000
min2789.000-2774.000=15.000
max2789.000-2774.000=15.000
mean0.381-0.380=0.001
σ0.003-0.006=-0.003
min0.378-0.376=0.002
max0.386-0.390=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1931.043-1931.053=-0.010
σ0.003-0.021=-0.019
min1931.040-1931.030=0.009
max1931.046-1931.083=-0.037
mean2789.000-2774.000=15.000
σ0.000
min2789.000-2774.000=15.000
max2789.000-2774.000=15.000
mean2.909-2.876=0.033
σ0.127-0.336=-0.209
min2.713-2.462=0.251
max3.045-3.200=-0.155
iters=5
new-facts=6402
prior-facts=1
mean4751.734-4751.723=0.011
σ0.931-0.900=0.030
min4751.248-4751.300=-0.052
max4753.397-4753.333=0.064
mean2789.000-2774.000=15.000
σ0.000
min2789.000-2774.000=15.000
max2789.000-2774.000=15.000
mean8.764-8.763=0.001
σ0.353-0.168=0.185
min8.227-8.524=-0.297
max9.117-8.930=0.187
iters=5
new-facts=6402
prior-facts=6402
mean4942.236-4942.157=0.078
σ0.020-0.167=-0.148
min4942.212-4941.861=0.351
max4942.262-4942.256=0.006
mean3063.400-3042.800=20.600
σ253.263-257.083=-3.820
min2789.000-2774.000=15.000
max3417.000-3405.000=12.000
mean8.584-8.593=-0.010
σ0.160-0.203=-0.043
min8.394-8.400=-0.005
max8.797-8.896=-0.099

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.118-1.010=0.108
σ0.259-0.125=0.134
min0.940-0.916=0.024
max1.569-1.207=0.362

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.212-467.204=0.008
σ575.933-575.937=-0.004
min179.237-179.231=0.005
max1331.112-1331.110=0.001
mean86.250
σ8.500
min82.000
max99.000
mean2789.000-2774.000=15.000
σ0.000
min2789.000-2774.000=15.000
max2789.000-2774.000=15.000
mean0.443-0.481=-0.038
σ0.306-0.399=-0.092
min0.284-0.280=0.004
max0.902-1.079=-0.177
policies=20
mean1792.622-1792.629=-0.007
σ0.340-0.359=-0.020
min1792.354-1792.378=-0.025
max1793.119-1793.162=-0.044
mean820.000
σ0.000
min820.000
max820.000
mean2789.000-2774.000=15.000
σ0.000
min2789.000-2774.000=15.000
max2789.000-2774.000=15.000
mean2.828-2.795=0.032
σ0.083-0.034=0.049
min2.779-2.767=0.012
max2.952-2.844=0.108
policies=200
mean17932.990-17932.920=0.069
σ0.370-0.596=-0.226
min17932.767-17932.522=0.245
max17933.544-17933.802=-0.259
mean8200.000
σ0.000
min8200.000
max8200.000
mean2789.000-2774.000=15.000
σ0.000
min2789.000-2774.000=15.000
max2789.000-2774.000=15.000
mean28.080-28.012=0.069
σ0.087-0.132=-0.045
min28.017-27.894=0.123
max28.205-28.199=0.006