Compare commits

Home / Compare 1bdc4c2b .. a66cc0ce

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.376-70.374=0.002
σ0.058-0.055=0.002
min70.340-70.339=0.001
max70.538-70.528=0.010
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.163-0.157=0.006
σ0.003-0.003=0.000
min0.157-0.154=0.003
max0.168-0.162=0.006
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.000
σ0.002-0.003=-0.000
min21.140-21.139=0.000
max21.147-21.148=-0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.063-0.062=0.001
σ0.003-0.003=-0.000
min0.059-0.059=0.001
max0.069-0.069=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.201-1752.200=0.001
σ0.362-0.361=0.001
min1751.627-1751.626=0.001
max1752.786-1752.785=0.001
mean1654.050-1651.500=2.550
σ642.594-643.192=-0.598
min622.000-611.000=11.000
max2774.000-2770.000=4.000
mean2.869-2.850=0.018
σ0.116-0.148=-0.032
min2.598-2.563=0.034
max3.139-3.167=-0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.931-269.930=0.001
σ0.006-0.010=-0.005
min269.924-269.918=0.006
max269.940-269.942=-0.002
mean2774.000-2770.000=4.000
σ0.000
min2774.000-2770.000=4.000
max2774.000-2770.000=4.000
mean0.374-0.374=0.001
σ0.007-0.010=-0.003
min0.368-0.368=-0.000
max0.386-0.391=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1930.397-1930.401=-0.004
σ0.016-0.010=0.006
min1930.372-1930.388=-0.016
max1930.411-1930.411=-0.000
mean2774.000-2770.000=4.000
σ0.000
min2774.000-2770.000=4.000
max2774.000-2770.000=4.000
mean2.534-2.583=-0.049
σ0.109-0.161=-0.052
min2.416-2.426=-0.010
max2.710-2.789=-0.079
iters=5
new-facts=6402
prior-facts=1
mean4750.816-4750.921=-0.105
σ0.839-0.772=0.067
min4750.156-4750.444=-0.288
max4752.283-4752.290=-0.007
mean2774.000-2770.000=4.000
σ0.000
min2774.000-2770.000=4.000
max2774.000-2770.000=4.000
mean8.150-8.125=0.025
σ0.314-0.442=-0.128
min7.836-7.677=0.158
max8.529-8.618=-0.089
iters=5
new-facts=6402
prior-facts=6402
mean4941.329-4941.335=-0.006
σ0.078-0.081=-0.003
min4941.254-4941.262=-0.008
max4941.413-4941.430=-0.017
mean3053.400-3016.400=37.000
σ340.142-286.606=53.536
min2774.000-2770.000=4.000
max3565.000-3426.000=139.000
mean8.441-8.392=0.049
σ0.152-0.126=0.026
min8.247-8.260=-0.013
max8.650-8.592=0.058

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.080-1.049=0.031
σ0.110-0.218=-0.108
min0.941-0.913=0.028
max1.249-1.424=-0.175

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.942-465.936=0.006
σ575.821-575.822=-0.002
min178.017-178.016=0.001
max1329.672-1329.669=0.004
mean81.750
σ7.500
min78.000
max93.000
mean2774.000-2770.000=4.000
σ0.000
min2774.000-2770.000=4.000
max2774.000-2770.000=4.000
mean0.484-0.445=0.039
σ0.383-0.309=0.074
min0.290-0.288=0.001
max1.058-0.909=0.150
policies=20
mean1780.469-1780.483=-0.014
σ0.346-0.369=-0.023
min1780.206-1780.218=-0.012
max1780.974-1781.024=-0.050
mean780.000
σ0.000
min780.000
max780.000
mean2774.000-2770.000=4.000
σ0.000
min2774.000-2770.000=4.000
max2774.000-2770.000=4.000
mean2.855-2.843=0.012
σ0.119-0.094=0.025
min2.761-2.766=-0.005
max3.018-2.973=0.045
policies=200
mean17811.291-17811.290=0.001
σ0.514-0.444=0.070
min17810.886-17810.912=-0.026
max17812.035-17811.933=0.102
mean7800.000
σ0.000
min7800.000
max7800.000
mean2774.000-2770.000=4.000
σ0.000
min2774.000-2770.000=4.000
max2774.000-2770.000=4.000
mean27.903-27.889=0.014
σ0.106-0.200=-0.094
min27.813-27.744=0.070
max28.035-28.175=-0.140