Compare commits

Home / Compare efbcb87c .. 2bebca95

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.375=-0.001
σ0.057-0.059=-0.002
min70.337-70.330=0.006
max70.533-70.540=-0.007
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.160-0.157=0.003
σ0.002-0.005=-0.003
min0.158-0.151=0.006
max0.163-0.165=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.001
σ0.002-0.002=0.000
min21.139-21.141=-0.002
max21.145-21.146=-0.000
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.065-0.064=0.001
σ0.003-0.003=-0.000
min0.062-0.062=0.000
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.201-1752.200=0.001
σ0.360-0.360=-0.000
min1751.632-1751.633=-0.001
max1752.771-1752.784=-0.013
mean1653.000-1650.550=2.450
σ643.477-632.868=10.609
min631.000-643.000=-12.000
max2851.000
mean2.841-2.808=0.033
σ0.126-0.130=-0.004
min2.546-2.524=0.022
max3.011-3.052=-0.040

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.932-269.927=0.005
σ0.008-0.008=-0.001
min269.922-269.918=0.003
max269.944-269.940=0.004
mean2851.000
σ0.000
min2851.000
max2851.000
mean0.376-0.371=0.004
σ0.007-0.004=0.003
min0.370-0.369=0.001
max0.383-0.379=0.005
iters=5
new-facts=1
prior-facts=6402
mean1930.400-1930.402=-0.001
σ0.006-0.007=-0.001
min1930.393-1930.396=-0.003
max1930.408-1930.414=-0.006
mean2851.000
σ0.000
min2851.000
max2851.000
mean2.617-2.513=0.103
σ0.254-0.074=0.181
min2.461-2.452=0.009
max3.062-2.639=0.424
iters=5
new-facts=6402
prior-facts=1
mean4750.844-4750.863=-0.019
σ0.857-0.892=-0.036
min4750.351-4750.310=0.041
max4752.370-4752.451=-0.081
mean2851.000
σ0.000
min2851.000
max2851.000
mean8.643-8.696=-0.053
σ0.299-0.599=-0.300
min8.128-7.641=0.487
max8.868-9.078=-0.210
iters=5
new-facts=6402
prior-facts=6402
mean4941.334-4941.332=0.001
σ0.089-0.089=0.001
min4941.257-4941.262=-0.005
max4941.437-4941.435=0.002
mean3044.600-3049.600=-5.000
σ198.430-201.604=-3.175
min2851.000
max3321.000-3326.000=-5.000
mean8.569-8.477=0.092
σ0.257-0.204=0.052
min8.374-8.323=0.051
max8.996-8.808=0.189

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.042-1.049=-0.007
σ0.130-0.128=0.002
min0.929-0.932=-0.003
max1.246-1.243=0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.915-465.911=0.004
σ575.756-575.756=-0.000
min178.032-178.028=0.004
max1329.549-1329.545=0.004
mean81.750
σ7.500
min78.000
max93.000
mean2851.000
σ0.000
min2851.000
max2851.000
mean0.443-0.443=-0.001
σ0.303-0.307=-0.004
min0.286-0.287=-0.000
max0.898-0.904=-0.006
policies=20
mean1780.525-1780.489=0.036
σ0.353-0.358=-0.005
min1780.270-1780.230=0.040
max1781.038-1781.014=0.024
mean780.000
σ0.000
min780.000
max780.000
mean2851.000
σ0.000
min2851.000
max2851.000
mean2.901-2.846=0.056
σ0.063-0.008=0.055
min2.841-2.837=0.004
max2.964-2.852=0.111
policies=200
mean17811.542-17811.270=0.273
σ0.345-0.550=-0.205
min17811.329-17810.903=0.425
max17812.057-17812.083=-0.026
mean7800.000
σ0.000
min7800.000
max7800.000
mean2851.000
σ0.000
min2851.000
max2851.000
mean28.325-28.266=0.058
σ0.492-0.470=0.021
min27.748-27.762=-0.014
max28.773-28.679=0.094