Compare commits

Home / Compare 5ea14a0c .. c9ccf23a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.040=0.000
σ0.048-0.050=-0.001
min30.996-31.003=-0.007
max31.174-31.179=-0.004
mean413.000
σ0.000
min413.000
max413.000
mean0.078-0.080=-0.003
σ0.004-0.003=0.001
min0.072-0.077=-0.006
max0.084-0.086=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.000
σ0.002-0.002=-0.000
min21.141-21.141=0.000
max21.146-21.146=-0.000
mean413.000
σ0.000
min413.000
max413.000
mean0.063-0.065=-0.002
σ0.004-0.003=0.001
min0.058-0.063=-0.004
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.411=-0.000
σ0.362-0.360=0.002
min1750.843-1750.847=-0.004
max1751.999-1751.997=0.001
mean1640.050-1660.150=-20.100
σ618.418-621.833=-3.416
min650.000-640.000=10.000
max2476.000-2506.000=-30.000
mean2.811-2.790=0.020
σ0.114-0.190=-0.076
min2.535-2.322=0.213
max2.991-3.073=-0.082

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.400-273.377=0.023
σ0.009-0.007=0.002
min273.393-273.369=0.024
max273.415-273.387=0.028
mean2476.000-2506.000=-30.000
σ0.000
min2476.000-2506.000=-30.000
max2476.000-2506.000=-30.000
mean0.386-0.390=-0.004
σ0.006-0.007=-0.001
min0.379-0.379=0.000
max0.392-0.397=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1933.836-1933.839=-0.003
σ0.004-0.007=-0.003
min1933.829-1933.832=-0.003
max1933.840-1933.850=-0.010
mean2476.000-2506.000=-30.000
σ0.000
min2476.000-2506.000=-30.000
max2476.000-2506.000=-30.000
mean2.978-3.022=-0.044
σ0.128-0.228=-0.101
min2.767-2.689=0.079
max3.110-3.319=-0.209
iters=5
new-facts=6402
prior-facts=1
mean4754.384-4754.106=0.278
σ0.798-1.124=-0.326
min4753.989-4753.175=0.814
max4755.810-4756.036=-0.226
mean2476.000-2506.000=-30.000
σ0.000
min2476.000-2506.000=-30.000
max2476.000-2506.000=-30.000
mean8.148-8.763=-0.614
σ0.497-0.714=-0.217
min7.688-7.755=-0.066
max8.831-9.678=-0.846
iters=5
new-facts=6402
prior-facts=6402
mean4944.728-4944.797=-0.070
σ0.199-0.089=0.110
min4944.393-4944.722=-0.329
max4944.882-4944.899=-0.018
mean2967.000-3013.800=-46.800
σ444.856-311.552=133.304
min2476.000-2585.000=-109.000
max3564.000-3302.000=262.000
mean8.486-9.020=-0.533
σ0.093-0.335=-0.242
min8.383-8.609=-0.226
max8.624-9.369=-0.746

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.785-1.761=0.024
σ0.091-0.142=-0.052
min1.640-1.612=0.028
max1.855-1.913=-0.057

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.331-463.333=-0.002
σ572.193-572.193=-0.000
min177.232-177.233=-0.001
max1321.620-1321.622=-0.002
mean79.750
σ7.500
min76.000
max91.000
mean2476.000-2506.000=-30.000
σ0.000
min2476.000-2506.000=-30.000
max2476.000-2506.000=-30.000
mean0.531-0.557=-0.026
σ0.507-0.550=-0.042
min0.276-0.277=-0.001
max1.292-1.382=-0.090
policies=20
mean1772.583-1772.584=-0.001
σ0.336-0.332=0.003
min1772.356-1772.356=-0.000
max1773.080-1773.076=0.004
mean760.000
σ0.000
min760.000
max760.000
mean2476.000-2506.000=-30.000
σ0.000
min2476.000-2506.000=-30.000
max2476.000-2506.000=-30.000
mean2.741-2.739=0.002
σ0.030-0.014=0.017
min2.704-2.725=-0.022
max2.777-2.757=0.019
policies=200
mean17732.393-17732.410=-0.018
σ0.480-0.395=0.085
min17732.063-17732.125=-0.062
max17733.097-17732.995=0.102
mean7600.000
σ0.000
min7600.000
max7600.000
mean2476.000-2506.000=-30.000
σ0.000
min2476.000-2506.000=-30.000
max2476.000-2506.000=-30.000
mean27.710-27.714=-0.004
σ0.181-0.092=0.089
min27.564-27.635=-0.071
max27.968-27.838=0.130