Compare commits

Home / Compare 241a6229 .. 34a980f3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.245=-0.001
σ0.054-0.053=0.000
min35.219-35.218=0.001
max35.396-35.396=0.000
mean412.000
σ0.000
min412.000
max412.000
mean0.084-0.084=0.001
σ0.003-0.004=-0.001
min0.083-0.077=0.006
max0.092-0.092=0.001
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.000
σ0.003-0.002=0.001
min23.765-23.766=-0.000
max23.775-23.773=0.003
mean412.000
σ0.000
min412.000
max412.000
mean0.068-0.066=0.002
σ0.003-0.004=-0.001
min0.066-0.061=0.005
max0.073-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.364-1756.362=0.002
σ0.364-0.365=-0.001
min1755.788-1755.786=0.001
max1756.948-1756.946=0.001
mean1640.850-1651.800=-10.950
σ630.810-644.917=-14.107
min624.000
max2831.000-2845.000=-14.000
mean2.339-2.343=-0.004
σ0.086-0.073=0.013
min2.235-2.262=-0.027
max2.586-2.492=0.094

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.589-324.581=0.008
σ0.046-0.055=-0.009
min324.507-324.482=0.025
max324.622-324.611=0.011
mean2831.000-2845.000=-14.000
σ0.000
min2831.000-2845.000=-14.000
max2831.000-2845.000=-14.000
mean0.427-0.426=0.002
σ0.009-0.002=0.007
min0.421-0.423=-0.001
max0.443-0.427=0.016
iters=5
new-facts=1
prior-facts=6402
mean1985.130-1985.135=-0.005
σ0.021-0.011=0.010
min1985.112-1985.123=-0.011
max1985.158-1985.145=0.012
mean2831.000-2845.000=-14.000
σ0.000
min2831.000-2845.000=-14.000
max2831.000-2845.000=-14.000
mean2.614-2.651=-0.037
σ0.077-0.100=-0.022
min2.537-2.570=-0.032
max2.704-2.789=-0.085
iters=5
new-facts=6402
prior-facts=1
mean4808.685-4808.667=0.018
σ7.749-7.717=0.032
min4804.670-4804.668=0.002
max4822.534-4822.460=0.074
mean2831.000-2845.000=-14.000
σ0.000
min2831.000-2845.000=-14.000
max2831.000-2845.000=-14.000
mean8.615-8.725=-0.111
σ0.576-0.595=-0.019
min7.906-7.719=0.187
max9.248-9.260=-0.012
iters=5
new-facts=6402
prior-facts=6402
mean4996.342-4996.274=0.068
σ0.026-0.150=-0.124
min4996.303-4996.008=0.295
max4996.367-4996.375=-0.008
mean3066.400-3018.600=47.800
σ314.927-260.301=54.625
min2831.000-2845.000=-14.000
max3553.000-3429.000=124.000
mean8.585-8.604=-0.019
σ0.168-0.163=0.005
min8.343-8.461=-0.118
max8.748-8.835=-0.087

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.995-0.980=0.015
σ0.067-0.071=-0.004
min0.911-0.921=-0.010
max1.054-1.062=-0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.972-462.974=-0.002
σ574.252-574.252=0.000
min175.835-175.838=-0.003
max1324.351-1324.352=-0.001
mean86.250
σ8.500
min82.000
max99.000
mean2831.000-2845.000=-14.000
σ0.000
min2831.000-2845.000=-14.000
max2831.000-2845.000=-14.000
mean0.429-0.431=-0.002
σ0.292-0.298=-0.006
min0.281-0.279=0.002
max0.867-0.878=-0.010
policies=20
mean1758.694-1758.696=-0.002
σ0.366-0.349=0.018
min1758.452-1758.462=-0.010
max1759.238-1759.213=0.025
mean820.000
σ0.000
min820.000
max820.000
mean2831.000-2845.000=-14.000
σ0.000
min2831.000-2845.000=-14.000
max2831.000-2845.000=-14.000
mean2.783-2.794=-0.011
σ0.008-0.015=-0.007
min2.777-2.783=-0.005
max2.796-2.816=-0.020
policies=200
mean17593.229-17593.396=-0.167
σ0.629-0.538=0.091
min17592.344-17592.716=-0.372
max17593.726-17593.855=-0.129
mean8200.000
σ0.000
min8200.000
max8200.000
mean2831.000-2845.000=-14.000
σ0.000
min2831.000-2845.000=-14.000
max2831.000-2845.000=-14.000
mean27.878-27.901=-0.023
σ0.410-0.328=0.082
min27.494-27.527=-0.033
max28.378-28.267=0.112