Compare commits

Home / Compare 5f31c39f .. 57e2ce4c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.707-70.705=0.002
σ0.046-0.047=-0.000
min70.672-70.672=0.000
max70.835-70.834=0.001
mean412.000
σ0.000
min412.000
max412.000
mean0.159-0.158=0.001
σ0.005-0.006=-0.001
min0.151-0.150=0.001
max0.165-0.168=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.412-21.413=-0.001
σ0.003-0.002=0.001
min21.407-21.409=-0.002
max21.414-21.415=-0.001
mean412.000
σ0.000
min412.000
max412.000
mean0.066-0.064=0.002
σ0.003-0.004=-0.001
min0.064-0.059=0.005
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.929-1754.934=-0.005
σ0.361-0.361=0.001
min1754.361-1754.360=0.001
max1755.515-1755.513=0.002
mean1657.950-1657.500=0.450
σ622.637-624.670=-2.034
min639.000-681.000=-42.000
max2500.000-2771.000=-271.000
mean2.754-2.861=-0.107
σ0.199-0.073=0.127
min2.306-2.731=-0.426
max3.140-3.007=0.133

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.794-272.793=0.001
σ0.004-0.007=-0.003
min272.789-272.786=0.003
max272.798-272.803=-0.005
mean2500.000-2771.000=-271.000
σ0.000
min2500.000-2771.000=-271.000
max2500.000-2771.000=-271.000
mean0.382-0.383=-0.001
σ0.009-0.006=0.002
min0.377-0.379=-0.002
max0.398-0.394=0.003
iters=5
new-facts=1
prior-facts=6402
mean1933.223-1933.226=-0.003
σ0.019-0.019=0.000
min1933.204-1933.196=0.008
max1933.246-1933.246=-0.000
mean2500.000-2771.000=-271.000
σ0.000
min2500.000-2771.000=-271.000
max2500.000-2771.000=-271.000
mean3.141-3.010=0.130
σ0.143-0.331=-0.188
min2.997-2.469=0.528
max3.358-3.372=-0.014
iters=5
new-facts=6402
prior-facts=1
mean4756.966-4756.885=0.081
σ7.557-7.619=-0.061
min4753.496-4753.121=0.375
max4770.484-4770.509=-0.024
mean2500.000-2771.000=-271.000
σ0.000
min2500.000-2771.000=-271.000
max2500.000-2771.000=-271.000
mean8.532-8.279=0.253
σ0.277-0.482=-0.206
min8.221-7.627=0.594
max8.876-8.886=-0.010
iters=5
new-facts=6402
prior-facts=6402
mean4944.448-4944.382=0.066
σ0.019-0.153=-0.134
min4944.425-4944.108=0.317
max4944.477-4944.460=0.017
mean2943.400-3019.800=-76.400
σ374.375-310.666=63.709
min2500.000-2771.000=-271.000
max3463.000-3497.000=-34.000
mean8.430-8.564=-0.134
σ0.142-0.372=-0.230
min8.291-8.350=-0.059
max8.657-9.222=-0.565

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.661-0.977=0.683
σ0.113-0.138=-0.025
min1.531-0.912=0.619
max1.799-1.224=0.574

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.319-468.337=-0.017
σ574.257-574.259=-0.003
min181.187-181.203=-0.016
max1329.704-1329.726=-0.021
mean88.250
σ8.500
min84.000
max101.000
mean2500.000-2771.000=-271.000
σ0.000
min2500.000-2771.000=-271.000
max2500.000-2771.000=-271.000
mean0.565-0.444=0.121
σ0.560-0.306=0.255
min0.280-0.289=-0.009
max1.406-0.903=0.503
policies=20
mean1812.182-1812.353=-0.171
σ0.384-0.387=-0.003
min1811.919-1812.091=-0.172
max1812.748-1812.923=-0.175
mean840.000
σ0.000
min840.000
max840.000
mean2500.000-2771.000=-271.000
σ0.000
min2500.000-2771.000=-271.000
max2500.000-2771.000=-271.000
mean2.820-2.884=-0.064
σ0.014-0.003=0.011
min2.807-2.881=-0.074
max2.838-2.887=-0.049
policies=200
mean18129.204-18129.207=-0.003
σ0.438-0.481=-0.043
min18128.907-18128.774=0.133
max18129.855-18129.894=-0.039
mean8400.000
σ0.000
min8400.000
max8400.000
mean2500.000-2771.000=-271.000
σ0.000
min2500.000-2771.000=-271.000
max2500.000-2771.000=-271.000
mean28.345-28.464=-0.118
σ0.078-0.248=-0.170
min28.255-28.268=-0.013
max28.446-28.825=-0.379