Compare commits

Home / Compare ec3b34a4 .. 921d2f40

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.398-70.393=0.004
σ0.045-0.046=-0.001
min70.369-70.372=-0.002
max70.522-70.523=-0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.159-0.164=-0.005
σ0.003-0.010=-0.007
min0.156-0.156=0.001
max0.163-0.185=-0.022
cache=y
dps=1
iters=10
policies=100
mean21.145-21.148=-0.003
σ0.003-0.012=-0.008
min21.138-21.141=-0.003
max21.149-21.180=-0.031
mean413.000-414.800=-1.800
σ0.000-0.422=-0.422
min413.000-414.000=-1.000
max413.000-415.000=-2.000
mean0.066-0.065=0.001
σ0.002-0.003=-0.001
min0.063-0.062=0.001
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.697-1752.700=-0.002
σ0.360-0.360=-0.000
min1752.126-1752.133=-0.007
max1753.279-1753.286=-0.007
mean1639.250-1661.600=-22.350
σ616.623-638.432=-21.809
min631.000-626.000=5.000
max2476.000-2789.000=-313.000
mean2.789-2.836=-0.046
σ0.181-0.129=0.052
min2.337-2.518=-0.182
max2.997-3.109=-0.112

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.607-270.609=-0.002
σ0.008-0.007=0.001
min270.594-270.598=-0.004
max270.616-270.619=-0.002
mean2476.000-2789.000=-313.000
σ0.000
min2476.000-2789.000=-313.000
max2476.000-2789.000=-313.000
mean0.378-0.378=0.001
σ0.006-0.006=-0.001
min0.370-0.368=0.002
max0.385-0.386=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1931.041-1931.040=0.001
σ0.003-0.005=-0.002
min1931.038-1931.034=0.004
max1931.045-1931.047=-0.003
mean2476.000-2789.000=-313.000
σ0.000
min2476.000-2789.000=-313.000
max2476.000-2789.000=-313.000
mean2.965-3.032=-0.068
σ0.096-0.100=-0.004
min2.842-2.956=-0.114
max3.108-3.189=-0.081
iters=5
new-facts=6402
prior-facts=1
mean4751.806-4751.622=0.183
σ0.820-1.040=-0.220
min4751.265-4750.395=0.871
max4753.256-4753.278=-0.022
mean2476.000-2789.000=-313.000
σ0.000
min2476.000-2789.000=-313.000
max2476.000-2789.000=-313.000
mean8.118-7.940=0.178
σ0.592-0.320=0.272
min7.639-7.692=-0.053
max9.022-8.490=0.532
iters=5
new-facts=6402
prior-facts=6402
mean4942.024-4942.233=-0.209
σ0.194-0.024=0.170
min4941.852-4942.198=-0.347
max4942.245-4942.256=-0.011
mean2906.000-3024.800=-118.800
σ357.200-284.676=72.524
min2476.000-2789.000=-313.000
max3359.000-3454.000=-95.000
mean8.457-8.444=0.014
σ0.168-0.128=0.040
min8.333-8.274=0.059
max8.740-8.609=0.131

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.849-1.081=0.768
σ0.129-0.272=-0.142
min1.677-0.925=0.752
max2.035-1.555=0.481

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.192-467.209=-0.017
σ575.926-575.936=-0.010
min179.227-179.231=-0.004
max1331.081-1331.114=-0.032
mean86.250
σ8.500
min82.000
max99.000
mean2476.000-2789.000=-313.000
σ0.000
min2476.000-2789.000=-313.000
max2476.000-2789.000=-313.000
mean0.576-0.485=0.091
σ0.587-0.288=0.298
min0.282-0.293=-0.011
max1.456-0.904=0.553
policies=20
mean1792.568-1792.622=-0.053
σ0.377-0.330=0.047
min1792.331-1792.363=-0.032
max1793.129-1793.105=0.024
mean820.000
σ0.000
min820.000
max820.000
mean2476.000-2789.000=-313.000
σ0.000
min2476.000-2789.000=-313.000
max2476.000-2789.000=-313.000
mean2.797-2.786=0.011
σ0.016-0.015=0.002
min2.776-2.772=0.004
max2.817-2.800=0.016
policies=200
mean17932.953-17932.999=-0.047
σ0.527-0.362=0.165
min17932.600-17932.800=-0.200
max17933.717-17933.542=0.176
mean8200.000
σ0.000
min8200.000
max8200.000
mean2476.000-2789.000=-313.000
σ0.000
min2476.000-2789.000=-313.000
max2476.000-2789.000=-313.000
mean28.111-28.087=0.025
σ0.073-0.095=-0.021
min28.057-28.001=0.057
max28.219-28.221=-0.002