Compare commits

Home / Compare 5f02ad04 .. 9d0db23d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.609-70.611=-0.003
σ0.046-0.046=-0.000
min70.584-70.585=-0.001
max70.736-70.737=-0.001
mean418.400-413.000=5.400
σ0.516-0.000=0.516
min418.000-413.000=5.000
max419.000-413.000=6.000
mean0.159-0.156=0.003
σ0.003-0.006=-0.003
min0.157-0.148=0.009
max0.166-0.166=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.336-21.333=0.003
σ0.009-0.003=0.006
min21.330-21.327=0.003
max21.361-21.335=0.026
mean419.000-413.000=6.000
σ0.000
min419.000-413.000=6.000
max419.000-413.000=6.000
mean0.065-0.064=0.001
σ0.003-0.002=0.001
min0.063-0.063=-0.000
max0.073-0.071=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.374=-0.001
σ0.361-0.360=0.002
min1752.804-1752.805=-0.000
max1753.959-1753.950=0.009
mean1666.100-1661.600=4.500
σ636.169-638.255=-2.087
min693.000-618.000=75.000
max2772.000-2810.000=-38.000
mean2.780-2.777=0.003
σ0.187-0.205=-0.018
min2.391-2.144=0.247
max3.179-3.046=0.133

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.758-271.754=0.004
σ0.003-0.007=-0.003
min271.754-271.749=0.005
max271.762-271.762=0.000
mean2772.000-2810.000=-38.000
σ0.000
min2772.000-2810.000=-38.000
max2772.000-2810.000=-38.000
mean0.382-0.379=0.003
σ0.006-0.005=0.001
min0.377-0.375=0.002
max0.391-0.388=0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.172-1932.172=-0.000
σ0.009-0.012=-0.003
min1932.159-1932.162=-0.003
max1932.181-1932.192=-0.011
mean2772.000-2810.000=-38.000
σ0.000
min2772.000-2810.000=-38.000
max2772.000-2810.000=-38.000
mean3.024-3.032=-0.007
σ0.046-0.053=-0.007
min2.989-2.996=-0.007
max3.087-3.124=-0.037
iters=5
new-facts=6402
prior-facts=1
mean4752.940-4752.781=0.159
σ0.858-1.020=-0.163
min4752.494-4751.855=0.638
max4754.469-4754.535=-0.066
mean2772.000-2810.000=-38.000
σ0.000
min2772.000-2810.000=-38.000
max2772.000-2810.000=-38.000
mean8.408-8.708=-0.300
σ0.477-0.167=0.310
min7.566-8.505=-0.940
max8.717-8.955=-0.238
iters=5
new-facts=6402
prior-facts=6402
mean4943.309-4943.305=0.004
σ0.151-0.152=-0.001
min4943.040-4943.034=0.006
max4943.397-4943.391=0.005
mean2999.600-2989.600=10.000
σ213.098-204.159=8.939
min2772.000-2810.000=-38.000
max3311.000-3308.000=3.000
mean8.441-8.565=-0.124
σ0.066-0.110=-0.044
min8.367-8.423=-0.056
max8.519-8.697=-0.179

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.081-1.032=0.049
σ0.138-0.218=-0.080
min0.991-0.926=0.064
max1.306-1.421=-0.115

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.857-467.857=0.000
σ575.930-575.931=-0.001
min179.889-179.885=0.004
max1331.752-1331.753=-0.001
mean86.250
σ8.500
min82.000
max99.000
mean2772.000-2810.000=-38.000
σ0.000
min2772.000-2810.000=-38.000
max2772.000-2810.000=-38.000
mean0.448-0.474=-0.025
σ0.320-0.384=-0.064
min0.287-0.279=0.008
max0.928-1.050=-0.122
policies=20
mean1799.171-1799.169=0.003
σ0.326-0.362=-0.036
min1798.942-1798.960=-0.017
max1799.653-1799.710=-0.058
mean820.000
σ0.000
min820.000
max820.000
mean2772.000-2810.000=-38.000
σ0.000
min2772.000-2810.000=-38.000
max2772.000-2810.000=-38.000
mean2.836-2.796=0.040
σ0.094-0.016=0.078
min2.782-2.780=0.002
max2.976-2.815=0.161
policies=200
mean17998.499-17998.476=0.024
σ0.506-0.390=0.116
min17998.200-17998.244=-0.044
max17999.257-17999.058=0.199
mean8200.000
σ0.000
min8200.000
max8200.000
mean2772.000-2810.000=-38.000
σ0.000
min2772.000-2810.000=-38.000
max2772.000-2810.000=-38.000
mean27.935-28.063=-0.128
σ0.023-0.122=-0.099
min27.903-27.981=-0.078
max27.958-28.244=-0.286