Compare commits

Home / Compare a734e2f3 .. e0f8a0a0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.380=0.183
σ0.046-0.049=-0.003
min70.537-70.349=0.188
max70.691-70.515=0.176
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.159-0.160=-0.001
σ0.003-0.003=-0.000
min0.156-0.156=-0.000
max0.164-0.165=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.288-21.144=0.144
σ0.003-0.003=0.000
min21.284-21.141=0.143
max21.292-21.149=0.144
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.062-0.065=-0.002
σ0.004-0.002=0.002
min0.058-0.062=-0.004
max0.067-0.070=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1752.387=0.987
σ0.362-0.363=-0.002
min1752.809-1751.820=0.989
max1753.957-1752.973=0.984
mean1650.000-1648.500=1.500
σ640.124-632.189=7.935
min651.000-626.000=25.000
max2846.000-2773.000=73.000
mean2.860-2.818=0.042
σ0.180-0.199=-0.019
min2.581-2.311=0.270
max3.493-3.172=0.321

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.757-270.125=1.632
σ0.005-0.007=-0.002
min271.751-270.117=1.634
max271.764-270.133=1.631
mean2846.000-2773.000=73.000
σ0.000
min2846.000-2773.000=73.000
max2846.000-2773.000=73.000
mean0.380-0.375=0.006
σ0.006-0.004=0.002
min0.375-0.371=0.004
max0.391-0.382=0.009
iters=5
new-facts=1
prior-facts=6402
mean1932.176-1930.588=1.588
σ0.006-0.019=-0.012
min1932.167-1930.567=1.600
max1932.182-1930.609=1.573
mean2846.000-2773.000=73.000
σ0.000
min2846.000-2773.000=73.000
max2846.000-2773.000=73.000
mean3.065-2.571=0.494
σ0.104-0.158=-0.054
min2.968-2.444=0.524
max3.197-2.795=0.402
iters=5
new-facts=6402
prior-facts=1
mean4752.944-4751.134=1.810
σ0.896-0.802=0.094
min4752.375-4750.661=1.715
max4754.536-4752.558=1.979
mean2846.000-2773.000=73.000
σ0.000
min2846.000-2773.000=73.000
max2846.000-2773.000=73.000
mean8.383-8.141=0.242
σ0.379-0.402=-0.024
min8.048-7.763=0.285
max9.034-8.667=0.368
iters=5
new-facts=6402
prior-facts=6402
mean4943.376-4941.533=1.843
σ0.021-0.082=-0.061
min4943.346-4941.455=1.892
max4943.396-4941.634=1.761
mean3061.600-3028.200=33.400
σ231.380-299.916=-68.536
min2846.000-2773.000=73.000
max3404.000-3470.000=-66.000
mean8.699-8.629=0.070
σ0.176-0.374=-0.198
min8.486-8.264=0.222
max8.968-9.181=-0.213

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.191-1.083=0.108
σ0.223-0.115=0.108
min0.946-0.934=0.012
max1.478-1.257=0.221

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.863-466.356=1.507
σ575.939-575.923=0.016
min179.889-178.388=1.500
max1331.771-1330.240=1.531
mean86.250-84.000=2.250
σ8.500-8.000=0.500
min82.000-80.000=2.000
max99.000-96.000=3.000
mean2846.000-2773.000=73.000
σ0.000
min2846.000-2773.000=73.000
max2846.000-2773.000=73.000
mean0.445-0.421=0.024
σ0.313-0.263=0.050
min0.286-0.285=0.000
max0.914-0.815=0.099
policies=20
mean1799.185-1784.241=14.945
σ0.373-0.319=0.054
min1798.932-1784.012=14.919
max1799.735-1784.702=15.032
mean820.000-800.000=20.000
σ0.000
min820.000-800.000=20.000
max820.000-800.000=20.000
mean2846.000-2773.000=73.000
σ0.000
min2846.000-2773.000=73.000
max2846.000-2773.000=73.000
mean2.861-2.819=0.042
σ0.008-0.087=-0.078
min2.855-2.773=0.082
max2.873-2.949=-0.076
policies=200
mean17998.560-17848.823=149.736
σ0.486-0.429=0.057
min17998.221-17848.513=149.708
max17999.281-17849.459=149.822
mean8200.000-8000.000=200.000
σ0.000
min8200.000-8000.000=200.000
max8200.000-8000.000=200.000
mean2846.000-2773.000=73.000
σ0.000
min2846.000-2773.000=73.000
max2846.000-2773.000=73.000
mean28.493-28.073=0.420
σ0.409-0.130=0.279
min28.156-27.990=0.165
max28.994-28.266=0.728