Compare commits

Home / Compare e23fc4be .. 37f83bb3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-35.264=18.652
σ0.366-0.053=0.312
min53.781-35.239=18.542
max54.956-35.415=19.542
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.137-0.085=0.052
σ0.006-0.003=0.002
min0.129-0.082=0.047
max0.148-0.091=0.056
cache=y
dps=1
iters=10
policies=100
mean43.141-23.770=19.371
σ0.007-0.002=0.004
min43.133-23.768=19.366
max43.156-23.774=19.381
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.122-0.068=0.054
σ0.007-0.003=0.004
min0.118-0.066=0.052
max0.141-0.074=0.067

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.078-1756.485=-764.407
σ1.243-0.366=0.877
min991.498-1755.912=-764.414
max997.306-1757.075=-759.769
mean1061.350-1644.850=-583.500
σ311.910-642.027=-330.117
min605.000-667.000=-62.000
max1598.000-2724.000=-1126.000
mean1.555-2.375=-0.821
σ0.118-0.119=-0.001
min1.470-2.192=-0.721
max1.962-2.581=-0.619

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.675-324.699=-39.023
σ0.015-0.056=-0.041
min285.651-324.600=-38.949
max285.690-324.737=-39.047
mean1598.000-2724.000=-1126.000
σ0.000
min1598.000-2724.000=-1126.000
max1598.000-2724.000=-1126.000
mean0.375-0.424=-0.049
σ0.000-0.002=-0.001
min0.375-0.422=-0.047
max0.376-0.426=-0.051
iters=5
new-facts=1
prior-facts=6402
mean1285.641-1985.266=-699.625
σ0.135-0.014=0.121
min1285.573-1985.242=-699.668
max1285.882-1985.274=-699.393
mean1598.000-2724.000=-1126.000
σ0.000
min1598.000-2724.000=-1126.000
max1598.000-2724.000=-1126.000
mean1.880-2.610=-0.730
σ0.019-0.084=-0.065
min1.863-2.533=-0.670
max1.909-2.727=-0.818
iters=5
new-facts=6402
prior-facts=1
mean1807.983-4808.797=-3000.814
σ7.016-7.735=-0.719
min1804.616-4804.797=-3000.181
max1820.517-4822.622=-3002.105
mean1598.000-2724.000=-1126.000
σ0.000
min1598.000-2724.000=-1126.000
max1598.000-2724.000=-1126.000
mean4.218-8.810=-4.592
σ0.176-0.612=-0.436
min4.000-7.743=-3.744
max4.472-9.263=-4.791
iters=5
new-facts=6402
prior-facts=6402
mean2070.462-4996.393=-2925.931
σ0.010-0.153=-0.143
min2070.448-4996.121=-2925.673
max2070.477-4996.482=-2926.005
mean1844.000-3017.600=-1173.600
σ217.430-345.238=-127.808
min1598.000-2724.000=-1126.000
max2086.000-3528.000=-1442.000
mean4.453-8.504=-4.051
σ0.028-0.119=-0.091
min4.412-8.431=-4.019
max4.488-8.714=-4.226

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.247-0.945=0.302
σ0.314-0.053=0.260
min0.903-0.911=-0.008
max1.594-1.038=0.556

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.386-462.963=-25.577
σ572.364-574.281=-1.917
min151.194-175.818=-24.624
max1295.931-1324.384=-28.453
mean90.250-86.250=4.000
σ8.500
min86.000-82.000=4.000
max103.000-99.000=4.000
mean1598.000-2724.000=-1126.000
σ0.000
min1598.000-2724.000=-1126.000
max1598.000-2724.000=-1126.000
mean0.561-0.541=0.020
σ0.612-0.537=0.074
min0.253-0.270=-0.017
max1.478-1.347=0.131
policies=20
mean1512.195-1758.530=-246.336
σ0.245-0.343=-0.098
min1512.032-1758.298=-246.266
max1512.560-1759.037=-246.478
mean860.000-820.000=40.000
σ0.000
min860.000-820.000=40.000
max860.000-820.000=40.000
mean1598.000-2724.000=-1126.000
σ0.000
min1598.000-2724.000=-1126.000
max1598.000-2724.000=-1126.000
mean2.520-2.712=-0.192
σ0.014-0.017=-0.003
min2.505-2.694=-0.189
max2.539-2.736=-0.197
policies=200
mean15129.570-17592.502=-2462.932
σ0.083-0.460=-0.377
min15129.465-17592.243=-2462.777
max15129.653-17593.191=-2463.538
mean8600.000-8200.000=400.000
σ0.000
min8600.000-8200.000=400.000
max8600.000-8200.000=400.000
mean1598.000-2724.000=-1126.000
σ0.000
min1598.000-2724.000=-1126.000
max1598.000-2724.000=-1126.000
mean25.622-27.403=-1.781
σ0.110-0.115=-0.004
min25.500-27.278=-1.778
max25.747-27.526=-1.779