Compare commits

Home / Compare 09de152a .. a2ca8385

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.616=0.002
σ0.054-0.055=-0.000
min35.589-35.582=0.007
max35.772-35.770=0.002
mean415.000-416.800=-1.800
σ0.000-0.422=-0.422
min415.000-416.000=-1.000
max415.000-417.000=-2.000
mean0.085-0.081=0.005
σ0.002-0.004=-0.002
min0.083-0.075=0.008
max0.092-0.087=0.004
cache=y
dps=1
iters=10
policies=100
mean24.046-24.047=-0.001
σ0.004-0.003=0.001
min24.042-24.043=-0.001
max24.054-24.055=-0.001
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.066-0.069=-0.003
σ0.004-0.004=0.000
min0.061-0.066=-0.006
max0.071-0.075=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.492=-0.002
σ0.365-0.366=-0.001
min1755.915-1755.914=0.001
max1757.082-1757.082=-0.000
mean1655.950-1638.650=17.300
σ639.302-602.823=36.479
min626.000-661.000=-35.000
max2778.000-2452.000=326.000
mean2.356-2.331=0.026
σ0.119-0.094=0.025
min2.243-2.216=0.026
max2.798-2.630=0.168

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.763-324.769=-0.006
σ0.036-0.043=-0.007
min324.701-324.695=0.006
max324.787-324.800=-0.013
mean2778.000-2452.000=326.000
σ0.000
min2778.000-2452.000=326.000
max2778.000-2452.000=326.000
mean0.419-0.430=-0.011
σ0.009-0.009=0.000
min0.415-0.423=-0.009
max0.436-0.443=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1985.325-1985.310=0.015
σ0.010-0.022=-0.012
min1985.313-1985.286=0.027
max1985.339-1985.337=0.002
mean2778.000-2452.000=326.000
σ0.000
min2778.000-2452.000=326.000
max2778.000-2452.000=326.000
mean2.622-2.685=-0.063
σ0.097-0.267=-0.170
min2.541-2.460=0.081
max2.768-3.126=-0.358
iters=5
new-facts=6402
prior-facts=1
mean4808.973-4809.136=-0.163
σ7.459-7.623=-0.164
min4805.598-4805.544=0.055
max4822.315-4822.770=-0.454
mean2778.000-2452.000=326.000
σ0.000
min2778.000-2452.000=326.000
max2778.000-2452.000=326.000
mean9.023-8.804=0.220
σ0.273-0.744=-0.471
min8.703-7.768=0.935
max9.346-9.826=-0.480
iters=5
new-facts=6402
prior-facts=6402
mean4996.633-4996.633=0.000
σ0.016-0.029=-0.013
min4996.615-4996.599=0.016
max4996.649-4996.661=-0.012
mean3031.200-2957.600=73.600
σ201.312-429.346=-228.034
min2778.000-2474.000=304.000
max3306.000-3536.000=-230.000
mean8.604-8.559=0.045
σ0.162-0.208=-0.046
min8.402-8.380=0.022
max8.786-8.801=-0.015

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.971-1.697=-0.726
σ0.065-0.131=-0.066
min0.913-1.555=-0.642
max1.043-1.831=-0.788

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.208-463.202=0.006
σ574.774-574.764=0.011
min175.815-175.815=0.000
max1325.370-1325.347=0.022
mean86.250
σ8.500
min82.000
max99.000
mean2778.000-2452.000=326.000
σ0.000
min2778.000-2452.000=326.000
max2778.000-2452.000=326.000
mean0.428-0.564=-0.136
σ0.295-0.577=-0.281
min0.278-0.275=0.003
max0.871-1.429=-0.558
policies=20
mean1758.515-1758.480=0.035
σ0.357-0.353=0.004
min1758.279-1758.245=0.034
max1759.045-1759.003=0.042
mean820.000
σ0.000
min820.000
max820.000
mean2778.000-2452.000=326.000
σ0.000
min2778.000-2452.000=326.000
max2778.000-2452.000=326.000
mean2.780-2.724=0.055
σ0.004-0.017=-0.013
min2.776-2.706=0.070
max2.786-2.745=0.041
policies=200
mean17592.033-17592.131=-0.098
σ0.466-0.502=-0.036
min17591.603-17591.815=-0.213
max17592.684-17592.881=-0.196
mean8200.000
σ0.000
min8200.000
max8200.000
mean2778.000-2452.000=326.000
σ0.000
min2778.000-2452.000=326.000
max2778.000-2452.000=326.000
mean27.469-27.495=-0.027
σ0.124-0.223=-0.099
min27.293-27.249=0.044
max27.572-27.736=-0.163