Compare commits

Home / Compare 2a958ab0 .. 774dfabb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.699-70.695=0.004
σ0.046-0.044=0.002
min70.669-70.671=-0.002
max70.827-70.820=0.007
mean416.000-414.900=1.100
σ0.000-0.316=-0.316
min416.000-414.000=2.000
max416.000-415.000=1.000
mean0.161-0.160=0.001
σ0.004-0.003=0.001
min0.158-0.156=0.002
max0.170-0.165=0.005
cache=y
dps=1
iters=10
policies=100
mean21.420-21.420=0.000
σ0.003-0.003=-0.000
min21.416-21.415=0.001
max21.424-21.425=-0.000
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.065-0.062=0.003
σ0.002-0.003=-0.001
min0.063-0.059=0.004
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.459-1754.461=-0.002
σ0.360-0.360=0.000
min1753.883-1753.885=-0.001
max1755.052-1755.040=0.012
mean1650.800-1674.900=-24.100
σ635.747-652.524=-16.777
min625.000-626.000=-1.000
max2774.000-2870.000=-96.000
mean2.793-2.857=-0.064
σ0.207-0.061=0.147
min2.148-2.750=-0.602
max3.001-2.951=0.050

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.500-273.506=-0.006
σ0.007-0.006=0.001
min273.490-273.500=-0.010
max273.507-273.515=-0.008
mean2774.000-2870.000=-96.000
σ0.000
min2774.000-2870.000=-96.000
max2774.000-2870.000=-96.000
mean0.376-0.385=-0.009
σ0.005-0.005=0.001
min0.371-0.381=-0.010
max0.384-0.393=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1933.891-1793.629=140.262
σ0.006-313.660=-313.654
min1933.886-1232.537=701.349
max1933.901-1933.937=-0.036
mean2774.000-2870.000=-96.000
σ0.000
min2774.000-2870.000=-96.000
max2774.000-2870.000=-96.000
mean2.996-2.905=0.091
σ0.137-0.693=-0.556
min2.800-1.672=1.128
max3.147-3.321=-0.174
iters=5
new-facts=6402
prior-facts=1
mean4754.507-4754.703=-0.196
σ0.639-0.806=-0.167
min4754.141-4754.195=-0.055
max4755.646-4756.135=-0.489
mean2774.000-2870.000=-96.000
σ0.000
min2774.000-2870.000=-96.000
max2774.000-2870.000=-96.000
mean8.778-8.087=0.692
σ0.143-0.484=-0.341
min8.613-7.714=0.899
max8.998-8.823=0.175
iters=5
new-facts=6402
prior-facts=6402
mean4945.044-4945.049=-0.005
σ0.163-0.166=-0.003
min4944.754-4944.754=0.000
max4945.129-4945.138=-0.009
mean3046.200-3032.200=14.000
σ232.357-225.444=6.912
min2774.000-2870.000=-96.000
max3328.000-3354.000=-26.000
mean8.553-8.577=-0.023
σ0.151-0.106=0.045
min8.378-8.438=-0.060
max8.770-8.695=0.075

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.026-1.023=0.003
σ0.137-0.137=-0.000
min0.936-0.932=0.004
max1.246-1.248=-0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.068-473.075=-0.007
σ575.940-575.910=0.029
min185.095-185.113=-0.018
max1336.978-1336.940=0.037
mean88.250
σ8.500
min84.000
max101.000
mean2774.000-2870.000=-96.000
σ0.000
min2774.000-2870.000=-96.000
max2774.000-2870.000=-96.000
mean0.489-0.487=0.002
σ0.394-0.376=0.018
min0.288-0.297=-0.010
max1.079-1.051=0.028
policies=20
mean1851.271-1851.424=-0.153
σ0.373-0.375=-0.003
min1851.011-1851.153=-0.142
max1851.821-1851.973=-0.152
mean840.000
σ0.000
min840.000
max840.000
mean2774.000-2870.000=-96.000
σ0.000
min2774.000-2870.000=-96.000
max2774.000-2870.000=-96.000
mean2.896-2.934=-0.037
σ0.040-0.025=0.015
min2.852-2.897=-0.045
max2.945-2.952=-0.008
policies=200
mean18519.288-18519.886=-0.598
σ0.072-0.750=-0.677
min18519.215-18519.197=0.018
max18519.381-18520.792=-1.411
mean8400.000
σ0.000
min8400.000
max8400.000
mean2774.000-2870.000=-96.000
σ0.000
min2774.000-2870.000=-96.000
max2774.000-2870.000=-96.000
mean28.810-29.162=-0.352
σ0.048-0.503=-0.455
min28.755-28.741=0.015
max28.862-29.836=-0.974