Compare commits

Home / Compare 5f0ccf98 .. 505ea04b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.243=0.001
σ0.053-0.054=-0.002
min35.220-35.214=0.006
max35.393-35.396=-0.003
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.085-0.081=0.004
σ0.004-0.006=-0.003
min0.081-0.076=0.005
max0.092-0.094=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.004-0.003=0.001
min23.764-23.764=0.001
max23.778-23.774=0.004
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.069-0.068=0.001
σ0.004-0.003=0.001
min0.066-0.066=-0.000
max0.076-0.076=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.484-1756.484=0.000
σ0.364-0.365=-0.000
min1755.908-1755.911=-0.003
max1757.075-1757.070=0.005
mean1655.200-1649.800=5.400
σ642.785-643.595=-0.810
min628.000-624.000=4.000
max2840.000-2835.000=5.000
mean2.326-2.341=-0.015
σ0.078-0.069=0.009
min2.193-2.264=-0.070
max2.542-2.476=0.067

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.702-324.701=0.000
σ0.055-0.056=-0.001
min324.603-324.602=0.001
max324.731-324.732=-0.002
mean2840.000-2835.000=5.000
σ0.000
min2840.000-2835.000=5.000
max2840.000-2835.000=5.000
mean0.425-0.423=0.002
σ0.002-0.002=0.000
min0.423-0.420=0.003
max0.428-0.425=0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.258-1985.262=-0.004
σ0.020-0.014=0.005
min1985.226-1985.240=-0.014
max1985.276-1985.279=-0.003
mean2840.000-2835.000=5.000
σ0.000
min2840.000-2835.000=5.000
max2840.000-2835.000=5.000
mean2.564-2.663=-0.099
σ0.048-0.126=-0.077
min2.512-2.537=-0.025
max2.643-2.846=-0.202
iters=5
new-facts=6402
prior-facts=1
mean4808.910-4808.880=0.030
σ7.645-7.658=-0.013
min4805.327-4805.406=-0.079
max4822.585-4822.579=0.006
mean2840.000-2835.000=5.000
σ0.000
min2840.000-2835.000=5.000
max2840.000-2835.000=5.000
mean8.465-8.651=-0.186
σ0.605-0.320=0.284
min7.721-8.086=-0.366
max9.051-8.832=0.220
iters=5
new-facts=6402
prior-facts=6402
mean4996.412-4996.466=-0.054
σ0.141-0.019=0.121
min4996.162-4996.442=-0.280
max4996.493-4996.489=0.003
mean3052.200-3042.000=10.200
σ222.074-243.873=-21.799
min2840.000-2835.000=5.000
max3371.000-3419.000=-48.000
mean8.666-8.515=0.151
σ0.200-0.114=0.086
min8.503-8.409=0.094
max8.991-8.702=0.289

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.040-0.972=0.067
σ0.125-0.066=0.059
min0.918-0.911=0.007
max1.236-1.050=0.186

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.956-462.951=0.005
σ574.252-574.251=0.001
min175.823-175.819=0.004
max1324.335-1324.328=0.007
mean86.250
σ8.500
min82.000
max99.000
mean2840.000-2835.000=5.000
σ0.000
min2840.000-2835.000=5.000
max2840.000-2835.000=5.000
mean0.432-0.393=0.039
σ0.301-0.271=0.031
min0.279-0.220=0.060
max0.884-0.797=0.087
policies=20
mean1758.537-1758.572=-0.035
σ0.370-0.352=0.018
min1758.299-1758.344=-0.045
max1759.089-1759.096=-0.007
mean820.000
σ0.000
min820.000
max820.000
mean2840.000-2835.000=5.000
σ0.000
min2840.000-2835.000=5.000
max2840.000-2835.000=5.000
mean2.782-2.793=-0.011
σ0.006-0.013=-0.007
min2.775-2.777=-0.002
max2.790-2.808=-0.019
policies=200
mean17592.374-17592.370=0.004
σ0.599-0.539=0.059
min17592.026-17591.881=0.145
max17593.269-17593.111=0.158
mean8200.000
σ0.000
min8200.000
max8200.000
mean2840.000-2835.000=5.000
σ0.000
min2840.000-2835.000=5.000
max2840.000-2835.000=5.000
mean27.895-27.876=0.019
σ0.329-0.300=0.029
min27.590-27.562=0.028
max28.286-28.222=0.064