Compare commits

Home / Compare feeae82c .. 74dae525

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.244=-0.000
σ0.054-0.055=-0.001
min35.212-35.215=-0.002
max35.395-35.398=-0.003
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.086-0.086=0.000
σ0.005-0.004=0.001
min0.082-0.082=-0.000
max0.096-0.094=0.001
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.003-0.003=-0.000
min23.766-23.765=0.000
max23.773-23.774=-0.001
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.068-0.066=0.002
σ0.003-0.003=0.000
min0.066-0.061=0.005
max0.074-0.070=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.363-1756.364=-0.001
σ0.365-0.365=0.000
min1755.788-1755.788=-0.000
max1756.958-1756.948=0.010
mean1642.900-1647.300=-4.400
σ632.332-633.513=-1.181
min626.000-628.000=-2.000
max2839.000-2826.000=13.000
mean2.332-2.342=-0.010
σ0.094-0.076=0.018
min2.226-2.255=-0.029
max2.630-2.570=0.060

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.581-324.587=-0.006
σ0.057-0.046=0.011
min324.479-324.506=-0.027
max324.612-324.614=-0.002
mean2839.000-2826.000=13.000
σ0.000
min2839.000-2826.000=13.000
max2839.000-2826.000=13.000
mean0.436-0.430=0.007
σ0.010-0.008=0.002
min0.424-0.422=0.002
max0.446-0.443=0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.142-1985.141=0.001
σ0.014-0.016=-0.002
min1985.118-1985.123=-0.006
max1985.151-1985.159=-0.008
mean2839.000-2826.000=13.000
σ0.000
min2839.000-2826.000=13.000
max2839.000-2826.000=13.000
mean2.616-2.796=-0.180
σ0.107-0.308=-0.201
min2.556-2.574=-0.018
max2.806-3.327=-0.520
iters=5
new-facts=6402
prior-facts=1
mean4808.780-4808.653=0.127
σ7.603-7.688=-0.084
min4805.227-4804.903=0.324
max4822.379-4822.400=-0.021
mean2839.000-2826.000=13.000
σ0.000
min2839.000-2826.000=13.000
max2839.000-2826.000=13.000
mean8.560-8.664=-0.104
σ0.606-0.504=0.102
min7.729-7.880=-0.151
max9.192-9.154=0.038
iters=5
new-facts=6402
prior-facts=6402
mean4996.335-4996.349=-0.015
σ0.028-0.024=0.004
min4996.307-4996.318=-0.011
max4996.371-4996.374=-0.003
mean3066.600-3049.200=17.400
σ303.197-301.212=1.985
min2839.000-2826.000=13.000
max3538.000-3529.000=9.000
mean8.504-8.620=-0.117
σ0.153-0.166=-0.012
min8.384-8.463=-0.078
max8.771-8.868=-0.097

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.971-1.009=-0.038
σ0.070-0.136=-0.066
min0.905-0.912=-0.007
max1.048-1.235=-0.188

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.970-462.971=-0.001
σ574.247-574.252=-0.004
min175.843-175.839=0.004
max1324.341-1324.349=-0.008
mean86.250
σ8.500
min82.000
max99.000
mean2839.000-2826.000=13.000
σ0.000
min2839.000-2826.000=13.000
max2839.000-2826.000=13.000
mean0.435-0.437=-0.002
σ0.301-0.300=0.000
min0.283-0.283=-0.000
max0.886-0.887=-0.001
policies=20
mean1758.709-1758.709=-0.000
σ0.337-0.346=-0.009
min1758.500-1758.476=0.024
max1759.210-1759.221=-0.011
mean820.000
σ0.000
min820.000
max820.000
mean2839.000-2826.000=13.000
σ0.000
min2839.000-2826.000=13.000
max2839.000-2826.000=13.000
mean2.792-2.787=0.005
σ0.011-0.003=0.007
min2.778-2.783=-0.005
max2.805-2.790=0.015
policies=200
mean17593.328-17593.102=0.226
σ0.693-0.766=-0.073
min17592.389-17592.133=0.256
max17593.856-17593.859=-0.003
mean8200.000
σ0.000
min8200.000
max8200.000
mean2839.000-2826.000=13.000
σ0.000
min2839.000-2826.000=13.000
max2839.000-2826.000=13.000
mean27.851-27.801=0.050
σ0.379-0.411=-0.031
min27.509-27.369=0.140
max28.292-28.257=0.035