Compare commits

Home / Compare 88e8798c .. e2c811f5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.958-30.959=-0.001
σ0.049-0.048=0.001
min30.921-30.921=0.001
max31.096-31.092=0.004
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.078-0.078=0.000
σ0.003-0.003=0.000
min0.072-0.075=-0.003
max0.084-0.083=0.000
cache=y
dps=1
iters=10
policies=100
mean21.061-21.061=0.000
σ0.003-0.002=0.001
min21.057-21.058=-0.001
max21.068-21.063=0.005
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.063-0.062=0.001
σ0.003-0.003=-0.000
min0.061-0.058=0.003
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.411=0.001
σ0.363-0.361=0.002
min1750.846-1750.843=0.003
max1751.981-1751.996=-0.015
mean1636.100-1629.600=6.500
σ615.773-599.632=16.141
min648.000-650.000=-2.000
max2467.000-2413.000=54.000
mean2.701-2.805=-0.104
σ0.257-0.186=0.071
min2.182-2.171=0.011
max3.086-3.116=-0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.380-273.382=-0.002
σ0.013-0.020=-0.007
min273.363-273.363=-0.000
max273.394-273.412=-0.018
mean2467.000-2413.000=54.000
σ0.000
min2467.000-2413.000=54.000
max2467.000-2413.000=54.000
mean0.388-0.383=0.006
σ0.009-0.008=0.000
min0.378-0.376=0.002
max0.402-0.396=0.006
iters=5
new-facts=1
prior-facts=6402
mean1933.840-1933.837=0.002
σ0.010-0.013=-0.003
min1933.829-1933.825=0.004
max1933.851-1933.856=-0.005
mean2467.000-2413.000=54.000
σ0.000
min2467.000-2413.000=54.000
max2467.000-2413.000=54.000
mean3.126-2.959=0.167
σ0.169-0.174=-0.005
min2.941-2.665=0.276
max3.354-3.105=0.249
iters=5
new-facts=6402
prior-facts=1
mean4754.220-4754.282=-0.063
σ0.926-0.917=0.009
min4753.306-4753.450=-0.144
max4755.786-4755.853=-0.067
mean2467.000-2413.000=54.000
σ0.000
min2467.000-2413.000=54.000
max2467.000-2413.000=54.000
mean8.625-8.118=0.507
σ0.432-0.423=0.009
min7.860-7.728=0.132
max8.903-8.821=0.082
iters=5
new-facts=6402
prior-facts=6402
mean4944.810-4944.795=0.015
σ0.086-0.077=0.009
min4944.743-4944.732=0.011
max4944.905-4944.880=0.025
mean3038.600-2947.400=91.200
σ419.760-441.387=-21.627
min2475.000-2413.000=62.000
max3558.000-3528.000=30.000
mean8.726-8.455=0.271
σ0.104-0.099=0.005
min8.636-8.327=0.308
max8.878-8.589=0.288

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.619-1.796=-0.178
σ0.056-0.070=-0.014
min1.563-1.742=-0.180
max1.713-1.918=-0.205

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.333-463.331=0.002
σ572.195-572.194=0.001
min177.231-177.232=-0.001
max1321.625-1321.621=0.004
mean79.750
σ7.500
min76.000
max91.000
mean2467.000-2413.000=54.000
σ0.000
min2467.000-2413.000=54.000
max2467.000-2413.000=54.000
mean0.565-0.548=0.017
σ0.572-0.534=0.038
min0.276-0.276=-0.000
max1.423-1.348=0.074
policies=20
mean1772.576-1772.558=0.018
σ0.325-0.323=0.003
min1772.340-1772.345=-0.005
max1773.057-1773.038=0.019
mean760.000
σ0.000
min760.000
max760.000
mean2467.000-2413.000=54.000
σ0.000
min2467.000-2413.000=54.000
max2467.000-2413.000=54.000
mean2.724-2.731=-0.008
σ0.008-0.038=-0.029
min2.714-2.709=0.005
max2.734-2.788=-0.054
policies=200
mean17732.353-17732.481=-0.128
σ0.371-0.514=-0.143
min17732.108-17732.080=0.028
max17732.891-17733.235=-0.343
mean7600.000
σ0.000
min7600.000
max7600.000
mean2467.000-2413.000=54.000
σ0.000
min2467.000-2413.000=54.000
max2467.000-2413.000=54.000
mean27.602-27.521=0.081
σ0.155-0.113=0.043
min27.448-27.387=0.061
max27.818-27.663=0.155