Compare commits

Home / Compare be84f7b2 .. e79d738a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-35.245=0.000
σ0.054-0.056=-0.002
min35.221-35.213=0.008
max35.396-35.402=-0.006
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.084-0.087=-0.002
σ0.004-0.004=0.000
min0.076-0.084=-0.008
max0.091-0.093=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.000
σ0.003-0.002=0.001
min23.765-23.763=0.002
max23.776-23.772=0.004
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.066-0.068=-0.002
σ0.005-0.003=0.002
min0.062-0.066=-0.004
max0.075-0.075=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.365-1756.362=0.003
σ0.365-0.364=0.001
min1755.788-1755.787=0.002
max1756.957-1756.949=0.008
mean1653.900-1649.250=4.650
σ631.668-637.469=-5.801
min622.000-628.000=-6.000
max2755.000-2831.000=-76.000
mean2.354-2.351=0.003
σ0.106-0.105=0.001
min2.243-2.251=-0.008
max2.613-2.616=-0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.581-324.581=0.000
σ0.052-0.057=-0.005
min324.489-324.481=0.008
max324.611-324.614=-0.003
mean2755.000-2831.000=-76.000
σ0.000
min2755.000-2831.000=-76.000
max2755.000-2831.000=-76.000
mean0.424-0.425=-0.001
σ0.008-0.002=0.006
min0.419-0.423=-0.004
max0.438-0.428=0.011
iters=5
new-facts=1
prior-facts=6402
mean1985.143-1985.147=-0.004
σ0.018-0.006=0.012
min1985.112-1985.143=-0.030
max1985.156-1985.156=-0.000
mean2755.000-2831.000=-76.000
σ0.000
min2755.000-2831.000=-76.000
max2755.000-2831.000=-76.000
mean2.582-2.639=-0.057
σ0.096-0.071=0.025
min2.429-2.561=-0.132
max2.693-2.722=-0.029
iters=5
new-facts=6402
prior-facts=1
mean4808.642-4808.761=-0.119
σ7.720-7.676=0.044
min4804.703-4805.306=-0.602
max4822.443-4822.492=-0.049
mean2755.000-2831.000=-76.000
σ0.000
min2755.000-2831.000=-76.000
max2755.000-2831.000=-76.000
mean9.033-9.082=-0.049
σ0.424-0.106=0.318
min8.624-8.942=-0.318
max9.728-9.214=0.515
iters=5
new-facts=6402
prior-facts=6402
mean4996.350-4996.342=0.009
σ0.022-0.017=0.005
min4996.325-4996.320=0.004
max4996.380-4996.367=0.012
mean3028.000-3042.000=-14.000
σ256.654-185.177=71.477
min2755.000-2831.000=-76.000
max3378.000-3305.000=73.000
mean8.751-8.719=0.032
σ0.226-0.221=0.005
min8.531-8.511=0.020
max9.125-9.076=0.049

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.977-0.978=-0.001
σ0.069-0.136=-0.067
min0.918-0.916=0.002
max1.054-1.222=-0.168

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.976-462.971=0.006
σ574.254-574.253=0.001
min175.838-175.837=0.001
max1324.357-1324.350=0.007
mean86.250
σ8.500
min82.000
max99.000
mean2755.000-2831.000=-76.000
σ0.000
min2755.000-2831.000=-76.000
max2755.000-2831.000=-76.000
mean0.434-0.431=0.004
σ0.304-0.296=0.008
min0.280-0.278=0.002
max0.890-0.875=0.016
policies=20
mean1758.715-1758.710=0.004
σ0.350-0.351=-0.002
min1758.480-1758.467=0.013
max1759.233-1759.230=0.003
mean820.000
σ0.000
min820.000
max820.000
mean2755.000-2831.000=-76.000
σ0.000
min2755.000-2831.000=-76.000
max2755.000-2831.000=-76.000
mean2.777-2.793=-0.016
σ0.018-0.016=0.003
min2.756-2.780=-0.024
max2.797-2.813=-0.016
policies=200
mean17592.328-17593.320=-0.992
σ0.548-0.650=-0.102
min17591.975-17592.452=-0.478
max17593.136-17593.825=-0.690
mean8200.000
σ0.000
min8200.000
max8200.000
mean2755.000-2831.000=-76.000
σ0.000
min2755.000-2831.000=-76.000
max2755.000-2831.000=-76.000
mean27.486-27.892=-0.406
σ0.083-0.346=-0.263
min27.367-27.552=-0.185
max27.562-28.275=-0.713