Compare commits

Home / Compare b27aecc9 .. e60020e3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.243-35.244=-0.001
σ0.055-0.055=0.000
min35.207-35.214=-0.007
max35.397-35.398=-0.001
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.083-0.086=-0.003
σ0.006-0.004=0.002
min0.076-0.081=-0.004
max0.093-0.092=0.000
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.000
σ0.003-0.003=0.000
min23.766-23.762=0.003
max23.775-23.773=0.002
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.068-0.065=0.003
σ0.003-0.004=-0.001
min0.066-0.061=0.005
max0.074-0.073=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.484-1756.485=-0.001
σ0.364-0.365=-0.001
min1755.910-1755.908=0.002
max1757.068-1757.077=-0.009
mean1636.950-1651.650=-14.700
σ624.537-639.916=-15.379
min650.000-628.000=22.000
max2824.000-2829.000=-5.000
mean2.372-2.378=-0.005
σ0.122-0.133=-0.010
min2.269-2.188=0.081
max2.749-2.834=-0.085

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.703-324.702=0.001
σ0.056-0.057=-0.001
min324.602-324.601=0.002
max324.731-324.737=-0.006
mean2824.000-2829.000=-5.000
σ0.000
min2824.000-2829.000=-5.000
max2824.000-2829.000=-5.000
mean0.428-0.433=-0.005
σ0.009-0.008=0.001
min0.422-0.426=-0.004
max0.444-0.442=0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.265-1985.247=0.018
σ0.014-0.028=-0.014
min1985.243-1985.203=0.040
max1985.280-1985.272=0.008
mean2824.000-2829.000=-5.000
σ0.000
min2824.000-2829.000=-5.000
max2824.000-2829.000=-5.000
mean2.625-2.646=-0.020
σ0.084-0.160=-0.076
min2.561-2.477=0.084
max2.768-2.884=-0.115
iters=5
new-facts=6402
prior-facts=1
mean4808.770-4808.765=0.006
σ7.769-7.787=-0.019
min4804.791-4804.806=-0.015
max4822.656-4822.687=-0.030
mean2824.000-2829.000=-5.000
σ0.000
min2824.000-2829.000=-5.000
max2824.000-2829.000=-5.000
mean8.790-8.894=-0.103
σ0.432-0.607=-0.175
min8.093-7.834=0.259
max9.193-9.356=-0.163
iters=5
new-facts=6402
prior-facts=6402
mean4996.321-4996.459=-0.137
σ0.198-0.015=0.183
min4996.102-4996.442=-0.339
max4996.476-4996.476=0.000
mean3029.200-3067.800=-38.600
σ275.454-309.670=-34.216
min2824.000-2829.000=-5.000
max3447.000-3541.000=-94.000
mean8.426-8.578=-0.151
σ0.039-0.201=-0.162
min8.372-8.366=0.007
max8.476-8.875=-0.399

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.976-1.031=-0.055
σ0.071-0.180=-0.109
min0.917-0.920=-0.003
max1.057-1.338=-0.281

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.968-462.968=0.000
σ574.255-574.255=0.000
min175.832-175.839=-0.007
max1324.351-1324.350=0.001
mean86.250
σ8.500
min82.000
max99.000
mean2824.000-2829.000=-5.000
σ0.000
min2824.000-2829.000=-5.000
max2824.000-2829.000=-5.000
mean0.428-0.434=-0.006
σ0.304-0.304=0.000
min0.275-0.278=-0.003
max0.884-0.890=-0.005
policies=20
mean1758.687-1758.705=-0.018
σ0.347-0.337=0.010
min1758.453-1758.474=-0.021
max1759.202-1759.205=-0.002
mean820.000
σ0.000
min820.000
max820.000
mean2824.000-2829.000=-5.000
σ0.000
min2824.000-2829.000=-5.000
max2824.000-2829.000=-5.000
mean2.781-2.802=-0.022
σ0.006-0.017=-0.011
min2.774-2.781=-0.008
max2.787-2.824=-0.037
policies=200
mean17593.100-17593.183=-0.083
σ0.711-0.645=0.066
min17592.125-17592.239=-0.114
max17593.641-17593.618=0.024
mean8200.000
σ0.000
min8200.000
max8200.000
mean2824.000-2829.000=-5.000
σ0.000
min2824.000-2829.000=-5.000
max2824.000-2829.000=-5.000
mean27.798-27.989=-0.191
σ0.413-0.341=0.073
min27.414-27.685=-0.271
max28.262-28.370=-0.108