Compare commits

Home / Compare 2bced4e1 .. 709d0a8a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.704-70.701=0.003
σ0.046-0.047=-0.001
min70.672-70.664=0.008
max70.830-70.831=-0.001
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.162-0.155=0.006
σ0.003-0.004=-0.000
min0.158-0.151=0.006
max0.169-0.162=0.006
cache=y
dps=1
iters=10
policies=100
mean21.408-21.408=0.000
σ0.003-0.003=0.000
min21.402-21.404=-0.002
max21.415-21.412=0.003
mean411.000-416.000=-5.000
σ0.000
min411.000-416.000=-5.000
max411.000-416.000=-5.000
mean0.065-0.063=0.001
σ0.002-0.003=-0.001
min0.063-0.060=0.003
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.929-1754.931=-0.001
σ0.360-0.363=-0.003
min1754.356-1754.363=-0.007
max1755.510-1755.516=-0.006
mean1645.150-1633.000=12.150
σ632.787-594.295=38.492
min619.000-625.000=-6.000
max2770.000-2432.000=338.000
mean2.829-2.804=0.024
σ0.135-0.156=-0.021
min2.534-2.342=0.192
max3.125-3.036=0.088

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.758-272.756=0.002
σ0.006-0.003=0.002
min272.751-272.751=0.000
max272.766-272.760=0.006
mean2770.000-2432.000=338.000
σ0.000
min2770.000-2432.000=338.000
max2770.000-2432.000=338.000
mean0.382-0.381=0.001
σ0.005-0.007=-0.001
min0.376-0.376=-0.000
max0.388-0.393=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.157-1933.166=-0.010
σ0.016-0.010=0.006
min1933.131-1933.153=-0.021
max1933.173-1933.180=-0.007
mean2770.000-2432.000=338.000
σ0.000
min2770.000-2432.000=338.000
max2770.000-2432.000=338.000
mean3.116-3.005=0.111
σ0.235-0.076=0.159
min2.768-2.906=-0.138
max3.386-3.110=0.276
iters=5
new-facts=6402
prior-facts=1
mean4756.922-4756.922=0.000
σ7.558-7.600=-0.041
min4753.482-4753.440=0.043
max4770.441-4770.516=-0.074
mean2770.000-2432.000=338.000
σ0.000
min2770.000-2432.000=338.000
max2770.000-2432.000=338.000
mean8.534-8.615=-0.081
σ0.293-0.391=-0.098
min8.269-8.021=0.249
max8.903-9.114=-0.211
iters=5
new-facts=6402
prior-facts=6402
mean4944.317-4944.254=0.063
σ0.153-0.202=-0.049
min4944.046-4944.033=0.013
max4944.413-4944.410=0.003
mean3031.200-2933.000=98.200
σ322.532-358.034=-35.502
min2770.000-2432.000=338.000
max3518.000-3406.000=112.000
mean8.448-8.628=-0.180
σ0.146-0.285=-0.139
min8.261-8.395=-0.134
max8.669-9.125=-0.456

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.970-1.772=-0.802
σ0.132-0.100=0.032
min0.900-1.597=-0.697
max1.205-1.835=-0.630

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.341-468.317=0.024
σ574.256-574.249=0.007
min181.203-181.188=0.015
max1329.725-1329.692=0.034
mean88.250
σ8.500
min84.000
max101.000
mean2770.000-2432.000=338.000
σ0.000
min2770.000-2432.000=338.000
max2770.000-2432.000=338.000
mean0.447-0.567=-0.120
σ0.302-0.566=-0.264
min0.295-0.282=0.013
max0.900-1.416=-0.516
policies=20
mean1812.375-1812.172=0.202
σ0.387-0.393=-0.006
min1812.106-1811.924=0.182
max1812.943-1812.756=0.187
mean840.000
σ0.000
min840.000
max840.000
mean2770.000-2432.000=338.000
σ0.000
min2770.000-2432.000=338.000
max2770.000-2432.000=338.000
mean2.898-2.806=0.092
σ0.012-0.020=-0.007
min2.891-2.778=0.113
max2.917-2.825=0.092
policies=200
mean18128.910-18129.039=-0.129
σ0.632-0.431=0.201
min18128.456-18128.714=-0.258
max18129.844-18129.674=0.170
mean8400.000
σ0.000
min8400.000
max8400.000
mean2770.000-2432.000=338.000
σ0.000
min2770.000-2432.000=338.000
max2770.000-2432.000=338.000
mean28.490-28.357=0.133
σ0.251-0.135=0.116
min28.257-28.188=0.069
max28.798-28.470=0.328