Compare commits

Home / Compare cf875ca1 .. 9b91fbb0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.783-70.782=0.001
σ0.046-0.046=0.000
min70.754-70.751=0.003
max70.911-70.910=0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.162-0.161=0.001
σ0.007-0.004=0.003
min0.156-0.158=-0.002
max0.174-0.167=0.007
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=0.000
σ0.003-0.003=-0.000
min21.488-21.488=-0.000
max21.498-21.497=0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.066-0.065=0.001
σ0.003-0.003=0.000
min0.064-0.063=0.000
max0.074-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1754.093=-0.001
σ0.359-0.361=-0.002
min1753.531-1753.533=-0.002
max1754.680-1754.666=0.014
mean1667.450-1635.150=32.300
σ633.848-617.575=16.272
min669.000-643.000=26.000
max2725.000-2474.000=251.000
mean2.784-2.777=0.006
σ0.252-0.229=0.023
min2.108-2.253=-0.144
max3.058-3.197=-0.140

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.955-271.595=0.359
σ0.007-0.005=0.002
min271.949-271.588=0.361
max271.966-271.599=0.367
mean2725.000-2474.000=251.000
σ0.000
min2725.000-2474.000=251.000
max2725.000-2474.000=251.000
mean0.383-0.380=0.003
σ0.006-0.003=0.003
min0.378-0.377=0.001
max0.394-0.385=0.009
iters=5
new-facts=1
prior-facts=6402
mean1932.329-1932.000=0.329
σ0.008-0.011=-0.002
min1932.318-1931.987=0.331
max1932.340-1932.012=0.328
mean2725.000-2474.000=251.000
σ0.000
min2725.000-2474.000=251.000
max2725.000-2474.000=251.000
mean2.967-2.496=0.471
σ0.186-0.039=0.146
min2.645-2.454=0.191
max3.123-2.543=0.580
iters=5
new-facts=6402
prior-facts=1
mean4753.120-4752.684=0.436
σ0.905-0.900=0.005
min4752.552-4751.780=0.772
max4754.716-4754.198=0.517
mean2725.000-2474.000=251.000
σ0.000
min2725.000-2474.000=251.000
max2725.000-2474.000=251.000
mean8.518-8.177=0.341
σ0.677-0.376=0.301
min7.600-7.636=-0.036
max9.092-8.526=0.566
iters=5
new-facts=6402
prior-facts=6402
mean4943.560-4943.080=0.480
σ0.017-0.174=-0.157
min4943.542-4942.882=0.660
max4943.580-4943.221=0.359
mean3022.800-2986.400=36.400
σ247.281-275.116=-27.835
min2725.000-2603.000=122.000
max3338.000-3289.000=49.000
mean8.552-8.496=0.056
σ0.191-0.110=0.081
min8.399-8.386=0.013
max8.869-8.629=0.241

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.077-1.723=-0.646
σ0.150-0.159=-0.009
min0.929-1.464=-0.535
max1.252-1.833=-0.581

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.617-468.610=0.007
σ574.894-574.882=0.012
min181.163-181.164=-0.001
max1330.958-1330.933=0.025
mean88.250
σ8.500
min84.000
max101.000
mean2725.000-2474.000=251.000
σ0.000
min2725.000-2474.000=251.000
max2725.000-2474.000=251.000
mean0.555-0.572=-0.017
σ0.530-0.555=-0.025
min0.289-0.286=0.003
max1.350-1.404=-0.054
policies=20
mean1811.960-1811.956=0.005
σ0.389-0.384=0.005
min1811.686-1811.702=-0.016
max1812.533-1812.522=0.011
mean840.000
σ0.000
min840.000
max840.000
mean2725.000-2474.000=251.000
σ0.000
min2725.000-2474.000=251.000
max2725.000-2474.000=251.000
mean2.838-2.844=-0.006
σ0.021-0.021=0.000
min2.813-2.825=-0.013
max2.858-2.870=-0.012
policies=200
mean18126.797-18126.785=0.011
σ0.465-0.480=-0.015
min18126.477-18126.515=-0.038
max18127.486-18127.503=-0.016
mean8400.000
σ0.000
min8400.000
max8400.000
mean2725.000-2474.000=251.000
σ0.000
min2725.000-2474.000=251.000
max2725.000-2474.000=251.000
mean28.584-28.594=-0.010
σ0.070-0.060=0.010
min28.511-28.505=0.006
max28.679-28.634=0.045