Compare commits

Home / Compare e0fadaa5 .. 3509c59a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean1448.768-1448.764=0.004
σ0.409-0.412=-0.003
min1448.584-1448.576=0.008
max1449.918-1449.919=-0.001
mean414.000
σ0.000
min414.000
max414.000
mean2.270-2.230=0.040
σ0.022-0.026=-0.005
min2.235-2.178=0.057
max2.308-2.267=0.040
cache=y
dps=1
iters=10
policies=100
mean1437.936-1437.936=0.000
σ0.010-0.013=-0.003
min1437.920-1437.918=0.002
max1437.954-1437.958=-0.004
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean2.232-2.222=0.011
σ0.024-0.032=-0.007
min2.186-2.171=0.014
max2.260-2.258=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1030.064-1030.063=0.001
σ1.115-1.110=0.005
min1029.540-1029.533=0.007
max1034.745-1034.726=0.019
mean1051.650-1063.650=-12.000
σ315.904-315.940=-0.036
min552.000-613.000=-61.000
max1565.000-1617.000=-52.000
mean1.584-1.574=0.010
σ0.163-0.130=0.034
min1.476-1.491=-0.015
max2.067-1.981=0.086

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean394.156-394.163=-0.006
σ0.084-0.082=0.002
min394.028-394.030=-0.002
max394.215-394.217=-0.002
mean1565.000-1617.000=-52.000
σ0.000
min1565.000-1617.000=-52.000
max1565.000-1617.000=-52.000
mean0.490-0.490=-0.000
σ0.006-0.010=-0.004
min0.485-0.480=0.005
max0.498-0.502=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1395.765-1395.761=0.004
σ0.067-0.060=0.007
min1395.726-1395.728=-0.002
max1395.884-1395.867=0.017
mean1565.000-1617.000=-52.000
σ0.000
min1565.000-1617.000=-52.000
max1565.000-1617.000=-52.000
mean2.085-2.070=0.015
σ0.131-0.149=-0.018
min1.992-1.962=0.030
max2.312-2.330=-0.018
iters=5
new-facts=6402
prior-facts=1
mean1917.942-1917.938=0.004
σ7.103-7.121=-0.018
min1914.604-1914.620=-0.016
max1930.640-1930.669=-0.029
mean1565.000-1617.000=-52.000
σ0.000
min1565.000-1617.000=-52.000
max1565.000-1617.000=-52.000
mean4.237-4.337=-0.100
σ0.216-0.226=-0.009
min4.016-4.056=-0.040
max4.568-4.673=-0.105
iters=5
new-facts=6402
prior-facts=6402
mean2180.579-2180.561=0.018
σ0.053-0.022=0.032
min2180.548-2180.544=0.003
max2180.673-2180.599=0.074
mean1848.200-1853.800=-5.600
σ216.392-202.768=13.625
min1575.000-1617.000=-42.000
max2086.000-2082.000=4.000
mean4.671-4.757=-0.086
σ0.060-0.062=-0.002
min4.576-4.672=-0.096
max4.724-4.816=-0.091

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.343-1.242=0.100
σ0.317-0.353=-0.035
min0.919-0.907=0.012
max1.724-1.825=-0.101

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean457.267-457.271=-0.005
σ573.365-573.361=0.004
min170.582-170.584=-0.003
max1317.313-1317.313=0.001
mean98.250
σ8.500
min94.000
max111.000
mean1565.000-1617.000=-52.000
σ0.000
min1565.000-1617.000=-52.000
max1565.000-1617.000=-52.000
mean0.547-0.554=-0.007
σ0.528-0.542=-0.014
min0.279-0.279=0.000
max1.340-1.367=-0.027
policies=20
mean1706.088-1706.089=-0.001
σ0.403-0.393=0.009
min1705.803-1705.804=-0.001
max1706.678-1706.665=0.013
mean940.000
σ0.000
min940.000
max940.000
mean1565.000-1617.000=-52.000
σ0.000
min1565.000-1617.000=-52.000
max1565.000-1617.000=-52.000
mean2.821-2.816=0.006
σ0.011-0.005=0.005
min2.809-2.809=-0.001
max2.832-2.822=0.010
policies=200
mean17068.616-17068.647=-0.031
σ0.081-0.070=0.011
min17068.555-17068.548=0.006
max17068.732-17068.715=0.017
mean9400.000
σ0.000
min9400.000
max9400.000
mean1565.000-1617.000=-52.000
σ0.000
min1565.000-1617.000=-52.000
max1565.000-1617.000=-52.000
mean28.489-28.431=0.058
σ0.067-0.143=-0.077
min28.405-28.306=0.099
max28.547-28.585=-0.038