Compare commits

Home / Compare da87e9b8 .. 44788c55

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.381-70.379=0.002
σ0.046-0.045=0.000
min70.354-70.350=0.004
max70.509-70.506=0.003
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.159-0.158=0.001
σ0.004-0.004=-0.000
min0.153-0.152=0.001
max0.164-0.162=0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.000
σ0.002-0.002=0.001
min21.141-21.143=-0.002
max21.147-21.149=-0.002
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.065-0.064=0.001
σ0.002-0.002=0.000
min0.064-0.062=0.001
max0.071-0.068=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.385-1752.387=-0.002
σ0.362-0.363=-0.001
min1751.824-1751.819=0.005
max1752.954-1752.971=-0.017
mean1629.900-1656.800=-26.900
σ609.293-635.125=-25.832
min628.000-689.000=-61.000
max2450.000-2773.000=-323.000
mean2.748-2.788=-0.040
σ0.228-0.190=0.039
min2.190-2.255=-0.065
max3.015-3.152=-0.137

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.108-270.126=-0.018
σ0.007-0.009=-0.003
min270.099-270.112=-0.013
max270.117-270.134=-0.016
mean2450.000-2773.000=-323.000
σ0.000
min2450.000-2773.000=-323.000
max2450.000-2773.000=-323.000
mean0.384-0.380=0.003
σ0.005-0.013=-0.008
min0.380-0.370=0.009
max0.392-0.395=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1930.591-1930.595=-0.005
σ0.010-0.014=-0.004
min1930.575-1930.580=-0.005
max1930.602-1930.611=-0.009
mean2450.000-2773.000=-323.000
σ0.000
min2450.000-2773.000=-323.000
max2450.000-2773.000=-323.000
mean2.607-2.585=0.022
σ0.139-0.161=-0.022
min2.459-2.458=0.002
max2.793-2.843=-0.050
iters=5
new-facts=6402
prior-facts=1
mean4751.104-4750.929=0.175
σ0.928-1.004=-0.077
min4750.613-4750.041=0.572
max4752.748-4752.660=0.088
mean2450.000-2773.000=-323.000
σ0.000
min2450.000-2773.000=-323.000
max2450.000-2773.000=-323.000
mean8.491-8.770=-0.279
σ0.644-0.206=0.438
min7.925-8.566=-0.641
max9.539-9.054=0.485
iters=5
new-facts=6402
prior-facts=6402
mean4941.461-4941.523=-0.062
σ0.119-0.089=0.030
min4941.280-4941.445=-0.166
max4941.614-4941.620=-0.006
mean2947.400-3022.000=-74.600
σ383.588-228.759=154.829
min2450.000-2773.000=-323.000
max3432.000-3322.000=110.000
mean8.510-8.517=-0.008
σ0.191-0.113=0.078
min8.335-8.424=-0.089
max8.792-8.679=0.113

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.681-1.077=0.604
σ0.089-0.101=-0.012
min1.561-0.941=0.620
max1.806-1.226=0.580

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.356-466.364=-0.007
σ575.919-575.920=-0.001
min178.391-178.396=-0.004
max1330.234-1330.243=-0.009
mean84.000
σ8.000
min80.000
max96.000
mean2450.000-2773.000=-323.000
σ0.000
min2450.000-2773.000=-323.000
max2450.000-2773.000=-323.000
mean0.561-0.445=0.116
σ0.565-0.308=0.256
min0.277-0.289=-0.012
max1.408-0.907=0.501
policies=20
mean1784.223-1784.256=-0.033
σ0.358-0.379=-0.021
min1783.991-1784.016=-0.025
max1784.756-1784.817=-0.062
mean800.000
σ0.000
min800.000
max800.000
mean2450.000-2773.000=-323.000
σ0.000
min2450.000-2773.000=-323.000
max2450.000-2773.000=-323.000
mean2.784-2.849=-0.066
σ0.021-0.094=-0.073
min2.759-2.765=-0.007
max2.807-2.980=-0.173
policies=200
mean17848.926-17848.876=0.049
σ0.434-0.485=-0.051
min17848.616-17848.593=0.023
max17849.568-17849.600=-0.032
mean8000.000
σ0.000
min8000.000
max8000.000
mean2450.000-2773.000=-323.000
σ0.000
min2450.000-2773.000=-323.000
max2450.000-2773.000=-323.000
mean28.058-28.020=0.039
σ0.039-0.081=-0.042
min28.002-27.953=0.049
max28.090-28.134=-0.044