Compare commits

Home / Compare 3f3abfe9 .. d7145e75

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.730-70.730=0.000
σ0.046-0.046=-0.001
min70.699-70.704=-0.006
max70.857-70.859=-0.003
mean413.000-414.400=-1.400
σ0.000-0.516=-0.516
min413.000-414.000=-1.000
max413.000-415.000=-2.000
mean0.160-0.162=-0.002
σ0.003-0.009=-0.006
min0.156-0.152=0.004
max0.167-0.176=-0.010
cache=y
dps=1
iters=10
policies=100
mean21.446-21.446=-0.000
σ0.003-0.002=0.001
min21.441-21.443=-0.002
max21.450-21.450=0.000
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.063-0.065=-0.003
σ0.003-0.003=0.001
min0.059-0.063=-0.005
max0.069-0.072=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.527-1754.528=-0.000
σ0.362-0.364=-0.001
min1753.956-1753.956=-0.000
max1755.112-1755.111=0.001
mean1659.950-1654.650=5.300
σ627.898-632.641=-4.743
min626.000-642.000=-16.000
max2853.000-2845.000=8.000
mean2.801-2.794=0.007
σ0.127-0.190=-0.063
min2.401-2.275=0.127
max2.955-3.041=-0.087

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.593-273.610=-0.017
σ0.017-0.007=0.010
min273.575-273.601=-0.026
max273.619-273.618=0.001
mean2853.000-2845.000=8.000
σ0.000
min2853.000-2845.000=8.000
max2853.000-2845.000=8.000
mean0.390-0.387=0.003
σ0.006-0.010=-0.004
min0.384-0.379=0.006
max0.399-0.403=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.993-1934.001=-0.009
σ0.006-0.019=-0.012
min1933.986-1933.973=0.013
max1934.004-1934.023=-0.020
mean2853.000-2845.000=8.000
σ0.000
min2853.000-2845.000=8.000
max2853.000-2845.000=8.000
mean3.050-3.104=-0.054
σ0.198-0.328=-0.130
min2.763-2.870=-0.107
max3.234-3.679=-0.445
iters=5
new-facts=6402
prior-facts=1
mean4614.225-4614.224=0.001
σ314.655-314.523=0.132
min4051.356-4051.591=-0.235
max4756.350-4756.329=0.020
mean2853.000-2845.000=8.000
σ0.000
min2853.000-2845.000=8.000
max2853.000-2845.000=8.000
mean8.313-8.139=0.174
σ0.628-0.723=-0.095
min7.680-7.017=0.663
max9.225-8.790=0.435
iters=5
new-facts=6402
prior-facts=6402
mean4945.235-4945.220=0.015
σ0.020-0.015=0.005
min4945.213-4945.202=0.011
max4945.264-4945.244=0.020
mean3087.400-3025.200=62.200
σ298.900-263.403=35.497
min2853.000-2845.000=8.000
max3544.000-3445.000=99.000
mean8.703-8.567=0.136
σ0.233-0.185=0.048
min8.541-8.413=0.128
max9.108-8.792=0.316

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.006-1.094=-0.088
σ0.123-0.182=-0.059
min0.920-0.924=-0.004
max1.201-1.324=-0.122

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.845-472.841=0.003
σ574.927-574.938=-0.011
min185.376-185.372=0.004
max1335.236-1335.249=-0.013
mean88.250
σ8.500
min84.000
max101.000
mean2853.000-2845.000=8.000
σ0.000
min2853.000-2845.000=8.000
max2853.000-2845.000=8.000
mean0.486-0.452=0.034
σ0.372-0.308=0.065
min0.298-0.296=0.001
max1.044-0.913=0.131
policies=20
mean1854.021-1854.017=0.004
σ0.367-0.373=-0.006
min1853.743-1853.743=-0.000
max1854.555-1854.560=-0.005
mean840.000
σ0.000
min840.000
max840.000
mean2853.000-2845.000=8.000
σ0.000
min2853.000-2845.000=8.000
max2853.000-2845.000=8.000
mean2.950-2.955=-0.005
σ0.006-0.027=-0.020
min2.943-2.929=0.014
max2.958-2.982=-0.024
policies=200
mean18546.648-18546.653=-0.005
σ0.565-0.543=0.022
min18546.324-18546.296=0.028
max18547.492-18547.459=0.034
mean8400.000
σ0.000
min8400.000
max8400.000
mean2853.000-2845.000=8.000
σ0.000
min2853.000-2845.000=8.000
max2853.000-2845.000=8.000
mean29.193-29.192=0.000
σ0.439-0.469=-0.030
min28.791-28.701=0.090
max29.722-29.646=0.076