Compare commits

Home / Compare c70125e9 .. b9b62185

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.701=0.001
σ0.047-0.047=-0.000
min70.669-70.672=-0.003
max70.832-70.832=-0.000
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.157-0.161=-0.004
σ0.005-0.004=0.001
min0.151-0.157=-0.006
max0.164-0.167=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.409-21.408=0.000
σ0.003-0.002=0.001
min21.403-21.405=-0.002
max21.413-21.411=0.002
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.066-0.065=0.001
σ0.004-0.002=0.001
min0.064-0.063=0.000
max0.074-0.071=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1717.001-1754.931=-37.930
σ169.575-0.363=169.212
min996.558-1754.363=-757.804
max1755.509-1755.519=-0.010
mean1624.800-1666.200=-41.400
σ599.274-636.621=-37.347
min628.000-669.000=-41.000
max2419.000-2699.000=-280.000
mean2.777-2.821=-0.044
σ0.293-0.222=0.072
min1.585-2.260=-0.675
max3.045-3.123=-0.078

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.757-272.757=0.000
σ0.007-0.007=-0.000
min272.746-272.747=-0.002
max272.763-272.764=-0.001
mean2419.000-2699.000=-280.000
σ0.000
min2419.000-2699.000=-280.000
max2419.000-2699.000=-280.000
mean0.385-0.383=0.002
σ0.009-0.005=0.004
min0.377-0.380=-0.003
max0.395-0.392=0.004
iters=5
new-facts=1
prior-facts=6402
mean1933.164-1933.159=0.005
σ0.009-0.014=-0.005
min1933.155-1933.140=0.015
max1933.175-1933.174=0.001
mean2419.000-2699.000=-280.000
σ0.000
min2419.000-2699.000=-280.000
max2419.000-2699.000=-280.000
mean3.064-3.114=-0.050
σ0.298-0.080=0.218
min2.653-3.029=-0.376
max3.480-3.207=0.273
iters=5
new-facts=6402
prior-facts=1
mean4756.959-4756.922=0.037
σ7.637-7.634=0.003
min4753.394-4753.441=-0.046
max4770.619-4770.577=0.042
mean2419.000-2699.000=-280.000
σ0.000
min2419.000-2699.000=-280.000
max2419.000-2699.000=-280.000
mean8.869-8.573=0.296
σ0.616-0.406=0.209
min7.967-7.941=0.026
max9.635-8.937=0.698
iters=5
new-facts=6402
prior-facts=6402
mean4944.325-4944.387=-0.061
σ0.161-0.018=0.144
min4944.038-4944.368=-0.331
max4944.414-4944.413=0.001
mean3002.800-3019.600=-16.800
σ324.846-349.647=-24.801
min2574.000-2699.000=-125.000
max3416.000-3530.000=-114.000
mean8.536-8.477=0.059
σ0.140-0.132=0.008
min8.412-8.369=0.042
max8.706-8.706=-0.000

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.674-1.015=0.659
σ0.195-0.143=0.052
min1.388-0.911=0.477
max1.817-1.226=0.592

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.337-468.331=0.006
σ574.296-574.270=0.026
min181.187-181.188=-0.001
max1329.782-1329.736=0.045
mean88.250
σ8.500
min84.000
max101.000
mean2419.000-2699.000=-280.000
σ0.000
min2419.000-2699.000=-280.000
max2419.000-2699.000=-280.000
mean0.546-0.557=-0.011
σ0.542-0.542=0.000
min0.265-0.285=-0.019
max1.359-1.370=-0.010
policies=20
mean1812.151-1812.189=-0.038
σ0.395-0.380=0.015
min1811.900-1811.934=-0.033
max1812.738-1812.752=-0.014
mean840.000
σ0.000
min840.000
max840.000
mean2419.000-2699.000=-280.000
σ0.000
min2419.000-2699.000=-280.000
max2419.000-2699.000=-280.000
mean2.807-2.825=-0.017
σ0.008-0.013=-0.006
min2.798-2.808=-0.010
max2.814-2.836=-0.021
policies=200
mean18129.051-18129.052=-0.000
σ0.497-0.450=0.047
min18128.756-18128.786=-0.030
max18129.795-18129.725=0.071
mean8400.000
σ0.000
min8400.000
max8400.000
mean2419.000-2699.000=-280.000
σ0.000
min2419.000-2699.000=-280.000
max2419.000-2699.000=-280.000
mean28.361-28.358=0.002
σ0.087-0.098=-0.011
min28.240-28.248=-0.008
max28.449-28.452=-0.003