Compare commits

Home / Compare b5c6d2e4 .. cbf86414

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.731=0.050
σ0.047-0.052=-0.005
min70.749-70.703=0.046
max70.910-70.875=0.035
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.159-0.161=-0.002
σ0.005-0.004=0.001
min0.153-0.157=-0.004
max0.169-0.168=0.000
cache=y
dps=1
iters=10
policies=100
mean21.493-21.446=0.047
σ0.002-0.003=-0.000
min21.490-21.443=0.047
max21.498-21.450=0.048
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.067-0.065=0.001
σ0.004-0.002=0.002
min0.064-0.063=0.001
max0.075-0.071=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1755.286=-1.192
σ0.361-0.359=0.001
min1753.529-1754.721=-1.192
max1754.679-1755.855=-1.175
mean1658.600-1650.900=7.700
σ629.790-637.912=-8.123
min628.000-622.000=6.000
max2771.000-2852.000=-81.000
mean2.767-2.875=-0.109
σ0.223-0.101=0.121
min2.149-2.629=-0.480
max3.025-3.076=-0.052

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.601-274.366=-2.765
σ0.007-0.010=-0.002
min271.591-274.355=-2.764
max271.609-274.379=-2.770
mean2771.000-2852.000=-81.000
σ0.000
min2771.000-2852.000=-81.000
max2771.000-2852.000=-81.000
mean0.384-0.382=0.001
σ0.007-0.001=0.007
min0.379-0.382=-0.003
max0.397-0.383=0.013
iters=5
new-facts=1
prior-facts=6402
mean1932.003-1934.752=-2.749
σ0.011-0.015=-0.005
min1931.990-1934.726=-2.736
max1932.013-1934.765=-2.753
mean2771.000-2852.000=-81.000
σ0.000
min2771.000-2852.000=-81.000
max2771.000-2852.000=-81.000
mean2.579-2.977=-0.398
σ0.129-0.147=-0.017
min2.475-2.735=-0.260
max2.736-3.097=-0.361
iters=5
new-facts=6402
prior-facts=1
mean4752.585-4755.500=-2.915
σ1.018-0.901=0.117
min4751.733-4755.011=-3.278
max4754.354-4757.108=-2.754
mean2771.000-2852.000=-81.000
σ0.000
min2771.000-2852.000=-81.000
max2771.000-2852.000=-81.000
mean8.742-8.701=0.041
σ0.483-0.324=0.159
min7.997-8.412=-0.415
max9.231-9.065=0.166
iters=5
new-facts=6402
prior-facts=6402
mean4943.212-4945.979=-2.767
σ0.015-0.020=-0.004
min4943.195-4945.955=-2.760
max4943.230-4946.005=-2.775
mean3040.600-3042.400=-1.800
σ248.281-252.109=-3.828
min2771.000-2852.000=-81.000
max3384.000-3434.000=-50.000
mean8.773-8.412=0.361
σ0.218-0.056=0.162
min8.472-8.335=0.137
max9.023-8.490=0.533

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.002-1.032=-0.030
σ0.143-0.135=0.008
min0.935-0.938=-0.003
max1.258-1.253=0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.642-472.842=-4.200
σ574.932-574.930=0.002
min181.169-185.369=-4.200
max1331.041-1335.237=-4.196
mean88.250
σ8.500
min84.000
max101.000
mean2771.000-2852.000=-81.000
σ0.000
min2771.000-2852.000=-81.000
max2771.000-2852.000=-81.000
mean0.447-0.488=-0.042
σ0.305-0.379=-0.074
min0.291-0.298=-0.007
max0.904-1.057=-0.153
policies=20
mean1811.991-1853.994=-42.003
σ0.389-0.370=0.020
min1811.700-1853.718=-42.018
max1812.560-1854.532=-41.972
mean840.000
σ0.000
min840.000
max840.000
mean2771.000-2852.000=-81.000
σ0.000
min2771.000-2852.000=-81.000
max2771.000-2852.000=-81.000
mean2.940-2.950=-0.011
σ0.093-0.022=0.070
min2.849-2.923=-0.074
max3.067-2.977=0.090
policies=200
mean18126.758-18546.726=-419.969
σ0.543-0.509=0.034
min18126.342-18546.375=-420.033
max18127.555-18547.481=-419.926
mean8400.000
σ0.000
min8400.000
max8400.000
mean2771.000-2852.000=-81.000
σ0.000
min2771.000-2852.000=-81.000
max2771.000-2852.000=-81.000
mean28.681-29.290=-0.609
σ0.033-0.501=-0.468
min28.648-28.847=-0.199
max28.722-29.727=-1.005