Compare commits

Home / Compare 3509c59a .. 798b71f3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean1449.379-1448.768=0.611
σ0.406-0.409=-0.002
min1449.210-1448.584=0.625
max1450.520-1449.918=0.602
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean2.271-2.270=0.001
σ0.014-0.022=-0.007
min2.247-2.235=0.012
max2.293-2.308=-0.014
cache=y
dps=1
iters=10
policies=100
mean1438.539-1437.936=0.603
σ0.013-0.010=0.003
min1438.512-1437.920=0.592
max1438.554-1437.954=0.601
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean2.256-2.232=0.024
σ0.044-0.024=0.019
min2.162-2.186=-0.023
max2.334-2.260=0.073

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1031.998-1030.064=1.934
σ1.134-1.115=0.019
min1031.430-1029.540=1.890
max1036.754-1034.745=2.010
mean1055.500-1051.650=3.850
σ318.685-315.904=2.781
min560.000-552.000=8.000
max1569.000-1565.000=4.000
mean1.562-1.584=-0.023
σ0.102-0.163=-0.062
min1.474-1.476=-0.002
max1.909-2.067=-0.157

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean399.354-394.156=5.198
σ0.089-0.084=0.005
min399.223-394.028=5.195
max399.418-394.215=5.203
mean1569.000-1565.000=4.000
σ0.000
min1569.000-1565.000=4.000
max1569.000-1565.000=4.000
mean0.495-0.490=0.005
σ0.005-0.006=-0.001
min0.492-0.485=0.007
max0.503-0.498=0.005
iters=5
new-facts=1
prior-facts=6402
mean1400.855-1395.765=5.090
σ0.031-0.067=-0.036
min1400.835-1395.726=5.109
max1400.907-1395.884=5.023
mean1569.000-1565.000=4.000
σ0.000
min1569.000-1565.000=4.000
max1569.000-1565.000=4.000
mean2.178-2.085=0.093
σ0.235-0.131=0.104
min2.043-1.992=0.051
max2.595-2.312=0.283
iters=5
new-facts=6402
prior-facts=1
mean1923.095-1917.942=5.153
σ7.043-7.103=-0.060
min1919.813-1914.604=5.209
max1935.687-1930.640=5.047
mean1569.000-1565.000=4.000
σ0.000
min1569.000-1565.000=4.000
max1569.000-1565.000=4.000
mean4.361-4.237=0.124
σ0.153-0.216=-0.063
min4.165-4.016=0.149
max4.567-4.568=-0.001
iters=5
new-facts=6402
prior-facts=6402
mean2185.756-2180.579=5.177
σ0.017-0.053=-0.036
min2185.740-2180.548=5.192
max2185.785-2180.673=5.112
mean1841.200-1848.200=-7.000
σ232.977-216.392=16.584
min1569.000-1575.000=-6.000
max2131.000-2086.000=45.000
mean4.707-4.671=0.036
σ0.060-0.060=-0.000
min4.642-4.576=0.066
max4.774-4.724=0.050

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.343-1.343=0.001
σ0.393-0.317=0.076
min0.942-0.919=0.024
max1.791-1.724=0.067

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean458.939-457.267=1.672
σ572.886-573.365=-0.479
min172.489-170.582=1.907
max1318.268-1317.313=0.954
mean98.250
σ8.500
min94.000
max111.000
mean1569.000-1565.000=4.000
σ0.000
min1569.000-1565.000=4.000
max1569.000-1565.000=4.000
mean0.577-0.547=0.030
σ0.560-0.528=0.032
min0.296-0.279=0.017
max1.417-1.340=0.077
policies=20
mean1725.196-1706.088=19.108
σ0.408-0.403=0.005
min1724.907-1705.803=19.103
max1725.790-1706.678=19.112
mean940.000
σ0.000
min940.000
max940.000
mean1569.000-1565.000=4.000
σ0.000
min1569.000-1565.000=4.000
max1569.000-1565.000=4.000
mean2.862-2.821=0.040
σ0.016-0.011=0.005
min2.850-2.809=0.042
max2.885-2.832=0.052
policies=200
mean17259.593-17068.616=190.977
σ0.088-0.081=0.007
min17259.523-17068.555=190.969
max17259.721-17068.732=190.990
mean9400.000
σ0.000
min9400.000
max9400.000
mean1569.000-1565.000=4.000
σ0.000
min1569.000-1565.000=4.000
max1569.000-1565.000=4.000
mean28.761-28.489=0.272
σ0.196-0.067=0.130
min28.595-28.405=0.191
max29.044-28.547=0.497