Compare commits

Home / Compare 888f28ef .. d1a98a81

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.389-70.388=0.001
σ0.046-0.044=0.002
min70.362-70.360=0.002
max70.517-70.512=0.005
mean419.400-414.000=5.400
σ0.516-0.000=0.516
min419.000-414.000=5.000
max420.000-414.000=6.000
mean0.158-0.160=-0.002
σ0.003-0.003=-0.000
min0.155-0.154=0.002
max0.165-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.001
σ0.002-0.003=-0.001
min21.142-21.138=0.004
max21.147-21.149=-0.002
mean420.000-414.000=6.000
σ0.000
min420.000-414.000=6.000
max420.000-414.000=6.000
mean0.064-0.062=0.002
σ0.003-0.004=-0.001
min0.062-0.057=0.005
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.395=-0.002
σ0.362-0.362=0.000
min1751.828
max1752.977-1752.982=-0.005
mean1656.950-1642.850=14.100
σ644.279-630.101=14.178
min637.000-616.000=21.000
max2851.000-2801.000=50.000
mean2.836-2.851=-0.015
σ0.163-0.154=0.009
min2.358-2.409=-0.050
max3.047-3.076=-0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.146-270.143=0.003
σ0.003-0.008=-0.006
min270.142-270.131=0.011
max270.150-270.153=-0.003
mean2851.000-2801.000=50.000
σ0.000
min2851.000-2801.000=50.000
max2851.000-2801.000=50.000
mean0.377-0.385=-0.007
σ0.003-0.012=-0.009
min0.372-0.371=0.001
max0.381-0.398=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1930.607-1930.609=-0.002
σ0.010-0.004=0.006
min1930.595-1930.604=-0.009
max1930.623-1930.615=0.008
mean2851.000-2801.000=50.000
σ0.000
min2851.000-2801.000=50.000
max2851.000-2801.000=50.000
mean2.562-2.485=0.078
σ0.166-0.076=0.091
min2.450-2.430=0.020
max2.840-2.598=0.242
iters=5
new-facts=6402
prior-facts=1
mean4751.282-4751.321=-0.039
σ0.915-0.914=0.001
min4750.811-4750.809=0.002
max4752.915-4752.945=-0.030
mean2851.000-2801.000=50.000
σ0.000
min2851.000-2801.000=50.000
max2851.000-2801.000=50.000
mean8.641-8.478=0.163
σ0.367-0.514=-0.147
min8.118-7.661=0.457
max9.002-9.005=-0.003
iters=5
new-facts=6402
prior-facts=6402
mean4941.774-4941.773=0.001
σ0.021-0.013=0.008
min4941.748-4941.758=-0.010
max4941.802-4941.788=0.014
mean3073.400-3025.200=48.200
σ222.667-225.690=-3.023
min2851.000-2801.000=50.000
max3371.000-3330.000=41.000
mean8.761-8.508=0.253
σ0.421-0.254=0.168
min8.369-8.314=0.055
max9.466-8.922=0.544

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.073-1.054=0.019
σ0.190-0.123=0.067
min0.932-0.941=-0.009
max1.318-1.241=0.077

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.381-466.379=0.003
σ575.934-575.943=-0.009
min178.403-178.401=0.001
max1330.282-1330.292=-0.010
mean84.250
σ8.500
min80.000
max97.000
mean2851.000-2801.000=50.000
σ0.000
min2851.000-2801.000=50.000
max2851.000-2801.000=50.000
mean0.442-0.480=-0.038
σ0.304-0.380=-0.076
min0.287-0.287=0.000
max0.898-1.051=-0.152
policies=20
mean1784.368-1784.331=0.037
σ0.363-0.342=0.021
min1784.113-1784.109=0.005
max1784.903-1784.837=0.066
mean800.000
σ0.000
min800.000
max800.000
mean2851.000-2801.000=50.000
σ0.000
min2851.000-2801.000=50.000
max2851.000-2801.000=50.000
mean2.857-2.867=-0.009
σ0.006-0.078=-0.072
min2.851-2.774=0.077
max2.864-2.965=-0.101
policies=200
mean17849.968-17849.783=0.185
σ0.401-0.581=-0.180
min17849.708-17849.367=0.340
max17850.565-17850.632=-0.067
mean8000.000
σ0.000
min8000.000
max8000.000
mean2851.000-2801.000=50.000
σ0.000
min2851.000-2801.000=50.000
max2851.000-2801.000=50.000
mean28.427-28.001=0.426
σ0.504-0.125=0.379
min27.888-27.888=-0.000
max28.866-28.177=0.689