Compare commits

Home / Compare 651f67dd .. 75500c48

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.698-70.696=0.002
σ0.045-0.049=-0.004
min70.673-70.671=0.002
max70.821-70.835=-0.014
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.157-0.160=-0.003
σ0.005-0.003=0.002
min0.152-0.157=-0.005
max0.163-0.166=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.421-21.422=-0.001
σ0.003-0.011=-0.009
min21.417-21.415=0.003
max21.424-21.453=-0.029
mean413.800-414.000=-0.200
σ0.422-0.000=0.422
min413.000-414.000=-1.000
max414.000
mean0.064-0.065=-0.001
σ0.004-0.002=0.002
min0.060-0.063=-0.003
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.459-1754.458=0.002
σ0.362-0.361=0.000
min1753.889-1753.887=0.002
max1755.053-1755.044=0.009
mean1643.650-1656.950=-13.300
σ627.749-641.892=-14.142
min624.000
max2851.000-2883.000=-32.000
mean2.804-2.824=-0.020
σ0.143-0.145=-0.002
min2.500-2.394=0.106
max3.026-3.123=-0.097

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.502-273.503=-0.001
σ0.005-0.008=-0.004
min273.497-273.492=0.005
max273.510-273.515=-0.005
mean2851.000-2883.000=-32.000
σ0.000
min2851.000-2883.000=-32.000
max2851.000-2883.000=-32.000
mean0.378-0.386=-0.008
σ0.005-0.005=0.001
min0.373-0.380=-0.007
max0.384-0.393=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1933.892-1933.889=0.003
σ0.011-0.009=0.001
min1933.878-1933.876=0.003
max1933.908-1933.898=0.010
mean2851.000-2883.000=-32.000
σ0.000
min2851.000-2883.000=-32.000
max2851.000-2883.000=-32.000
mean3.006-3.013=-0.007
σ0.055-0.087=-0.032
min2.941-2.915=0.027
max3.084-3.143=-0.059
iters=5
new-facts=6402
prior-facts=1
mean4754.734-4754.580=0.154
σ0.796-0.603=0.192
min4754.307-4754.233=0.074
max4756.155-4755.651=0.505
mean2851.000-2883.000=-32.000
σ0.000
min2851.000-2883.000=-32.000
max2851.000-2883.000=-32.000
mean7.932-8.401=-0.469
σ0.343-0.436=-0.093
min7.676-7.680=-0.004
max8.530-8.739=-0.209
iters=5
new-facts=6402
prior-facts=6402
mean4944.972-4945.044=-0.071
σ0.189-0.159=0.029
min4944.756-4944.761=-0.005
max4945.123-4945.133=-0.010
mean3056.800-3066.800=-10.000
σ286.815-177.483=109.332
min2851.000-2883.000=-32.000
max3510.000-3323.000=187.000
mean8.462-8.540=-0.078
σ0.167-0.222=-0.055
min8.334-8.363=-0.029
max8.729-8.907=-0.179

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.056-0.987=0.069
σ0.134-0.143=-0.009
min0.933-0.917=0.016
max1.259-1.243=0.017

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.080-473.063=0.017
σ575.910-575.909=0.000
min185.122-185.100=0.023
max1336.945-1336.927=0.018
mean88.250
σ8.500
min84.000
max101.000
mean2851.000-2883.000=-32.000
σ0.000
min2851.000-2883.000=-32.000
max2851.000-2883.000=-32.000
mean0.488-0.488=-0.001
σ0.373-0.380=-0.007
min0.296-0.296=0.000
max1.046-1.058=-0.012
policies=20
mean1851.456-1851.298=0.158
σ0.373-0.363=0.011
min1851.177-1851.028=0.149
max1851.998-1851.825=0.172
mean840.000
σ0.000
min840.000
max840.000
mean2851.000-2883.000=-32.000
σ0.000
min2851.000-2883.000=-32.000
max2851.000-2883.000=-32.000
mean2.954-2.944=0.010
σ0.017-0.008=0.009
min2.937-2.932=0.005
max2.977-2.950=0.028
policies=200
mean18519.918-18519.408=0.510
σ0.765-0.569=0.196
min18519.271-18519.041=0.230
max18520.859-18520.256=0.603
mean8400.000
σ0.000
min8400.000
max8400.000
mean2851.000-2883.000=-32.000
σ0.000
min2851.000-2883.000=-32.000
max2851.000-2883.000=-32.000
mean29.150-29.228=-0.078
σ0.384-0.412=-0.027
min28.910-28.816=0.094
max29.724-29.744=-0.020