Compare commits

Home / Compare 91cf18fe .. 41b5bf12

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-35.973=0.001
σ0.107-0.104=0.003
min35.925-35.926=-0.001
max36.278-36.269=0.009
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.076-0.075=0.000
σ0.004-0.005=-0.000
min0.071-0.070=0.001
max0.084-0.085=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=0.000
σ0.004-0.004=0.000
min26.203-26.201=0.002
max26.215-26.213=0.002
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.061-0.061=-0.001
σ0.003-0.003=0.000
min0.056-0.059=-0.003
max0.069-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.365-1758.365=-0.001
σ0.373-0.370=0.003
min1757.794-1757.787=0.007
max1758.963-1758.963=-0.000
mean1630.350-1660.250=-29.900
σ593.631-624.261=-30.631
min638.000-688.000=-50.000
max2423.000-2768.000=-345.000
mean2.362-2.390=-0.028
σ0.090-0.109=-0.019
min2.280-2.276=0.004
max2.592-2.608=-0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.515-279.511=0.005
σ0.010-0.009=0.001
min279.506-279.499=0.007
max279.529-279.519=0.010
mean2423.000-2768.000=-345.000
σ0.000
min2423.000-2768.000=-345.000
max2423.000-2768.000=-345.000
mean0.413-0.411=0.002
σ0.009-0.007=0.003
min0.406-0.405=0.001
max0.426-0.421=0.006
iters=5
new-facts=1
prior-facts=6402
mean2178.437-2178.425=0.012
σ0.010-0.037=-0.027
min2178.421-2178.359=0.061
max2178.446-2178.449=-0.004
mean2423.000-2768.000=-345.000
σ0.000
min2423.000-2768.000=-345.000
max2423.000-2768.000=-345.000
mean3.465-3.389=0.076
σ0.169-0.117=0.051
min3.214-3.268=-0.053
max3.673-3.530=0.143
iters=5
new-facts=6402
prior-facts=1
mean5056.390-5056.357=0.032
σ1.012-0.973=0.039
min5055.800-5055.766=0.034
max5058.191-5058.083=0.108
mean2423.000-2768.000=-345.000
σ0.000
min2423.000-2768.000=-345.000
max2423.000-2768.000=-345.000
mean8.848-9.034=-0.186
σ0.560-0.490=0.069
min8.376-8.168=0.208
max9.743-9.359=0.384
iters=5
new-facts=6402
prior-facts=6402
mean5193.687-5193.674=0.012
σ0.211-0.125=0.086
min5193.335-5193.505=-0.169
max5193.853-5193.857=-0.004
mean3232.400-3276.200=-43.800
σ368.808-460.996=-92.188
min2713.000-2768.000=-55.000
max3678.000-3914.000=-236.000
mean8.971-8.976=-0.004
σ0.419-0.099=0.320
min8.695-8.861=-0.166
max9.713-9.094=0.619

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.768-0.956=0.812
σ0.220-0.014=0.206
min1.400-0.947=0.454
max1.953-0.979=0.974

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.465-465.474=-0.009
σ572.648-572.659=-0.010
min179.139-179.143=-0.004
max1324.437-1324.461=-0.024
mean79.500
σ7.000
min76.000
max90.000
mean2423.000-2768.000=-345.000
σ0.000
min2423.000-2768.000=-345.000
max2423.000-2768.000=-345.000
mean0.564-0.484=0.080
σ0.558-0.403=0.154
min0.282-0.280=0.002
max1.400-1.089=0.311
policies=20
mean1791.677-1791.705=-0.028
σ0.342-0.330=0.012
min1791.443-1791.511=-0.068
max1792.183-1792.197=-0.014
mean760.000
σ0.000
min760.000
max760.000
mean2423.000-2768.000=-345.000
σ0.000
min2423.000-2768.000=-345.000
max2423.000-2768.000=-345.000
mean2.803-2.804=-0.001
σ0.006-0.008=-0.002
min2.796-2.797=-0.001
max2.809-2.814=-0.004
policies=200
mean17923.507-17923.387=0.121
σ0.520-0.564=-0.044
min17923.220-17923.065=0.156
max17924.286-17924.230=0.056
mean7600.000
σ0.000
min7600.000
max7600.000
mean2423.000-2768.000=-345.000
σ0.000
min2423.000-2768.000=-345.000
max2423.000-2768.000=-345.000
mean28.230-28.250=-0.020
σ0.163-0.112=0.052
min28.075-28.141=-0.065
max28.396-28.367=0.029