Compare commits

Home / Compare a2da3fdd .. 2aeaf1c4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.264=-0.001
σ0.055-0.053=0.003
min35.230-35.238=-0.008
max35.418-35.412=0.006
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.083-0.085=-0.002
σ0.004-0.004=-0.000
min0.077-0.082=-0.005
max0.088-0.092=-0.004
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.000
σ0.003-0.003=0.000
min23.764-23.765=-0.001
max23.774-23.774=-0.000
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.067-0.069=-0.002
σ0.005-0.004=0.001
min0.061-0.066=-0.005
max0.076-0.076=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.487=-0.002
σ0.366-0.365=0.001
min1755.909-1755.910=-0.001
max1757.079-1757.078=0.001
mean1646.300-1656.250=-9.950
σ639.692-642.871=-3.178
min623.000-630.000=-7.000
max2823.000-2839.000=-16.000
mean2.330-2.327=0.003
σ0.067-0.064=0.003
min2.238-2.231=0.006
max2.468-2.435=0.034

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.682-324.705=-0.023
σ0.051-0.056=-0.005
min324.593-324.606=-0.013
max324.716-324.738=-0.022
mean2823.000-2839.000=-16.000
σ0.000
min2823.000-2839.000=-16.000
max2823.000-2839.000=-16.000
mean0.438-0.424=0.014
σ0.017-0.002=0.015
min0.425-0.421=0.004
max0.466-0.426=0.039
iters=5
new-facts=1
prior-facts=6402
mean1985.266-1985.258=0.008
σ0.010-0.020=-0.009
min1985.250-1985.231=0.018
max1985.274-1985.277=-0.002
mean2823.000-2839.000=-16.000
σ0.000
min2823.000-2839.000=-16.000
max2823.000-2839.000=-16.000
mean2.687-2.625=0.062
σ0.163-0.091=0.072
min2.510-2.534=-0.024
max2.890-2.765=0.125
iters=5
new-facts=6402
prior-facts=1
mean4808.672-4808.864=-0.192
σ7.216-7.642=-0.426
min4805.422-4805.371=0.051
max4821.581-4822.534=-0.953
mean2823.000-2839.000=-16.000
σ0.000
min2823.000-2839.000=-16.000
max2823.000-2839.000=-16.000
mean9.145-8.695=0.451
σ0.200-0.188=0.011
min8.977-8.494=0.483
max9.469-8.894=0.575
iters=5
new-facts=6402
prior-facts=6402
mean4996.467-4996.458=0.009
σ0.018-0.019=-0.001
min4996.446-4996.429=0.018
max4996.489-4996.481=0.008
mean3029.400-3070.200=-40.800
σ281.789-303.047=-21.259
min2823.000-2839.000=-16.000
max3471.000-3535.000=-64.000
mean8.507-8.536=-0.029
σ0.127-0.124=0.004
min8.359-8.427=-0.069
max8.699-8.672=0.028

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.973-0.995=-0.022
σ0.067-0.062=0.005
min0.916-0.911=0.005
max1.052-1.045=0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.972-462.972=-0.001
σ574.256-574.254=0.001
min175.836-175.835=0.001
max1324.355-1324.354=0.001
mean86.250
σ8.500
min82.000
max99.000
mean2823.000-2839.000=-16.000
σ0.000
min2823.000-2839.000=-16.000
max2823.000-2839.000=-16.000
mean0.431-0.433=-0.002
σ0.298-0.301=-0.003
min0.278-0.279=-0.001
max0.879-0.885=-0.007
policies=20
mean1758.718-1758.691=0.027
σ0.342-0.352=-0.010
min1758.487-1758.440=0.048
max1759.225-1759.208=0.017
mean820.000
σ0.000
min820.000
max820.000
mean2823.000-2839.000=-16.000
σ0.000
min2823.000-2839.000=-16.000
max2823.000-2839.000=-16.000
mean2.799-2.813=-0.014
σ0.004-0.027=-0.023
min2.794-2.790=0.004
max2.801-2.849=-0.048
policies=200
mean17593.366-17593.290=0.076
σ0.723-0.518=0.205
min17592.370-17592.554=-0.183
max17593.930-17593.673=0.258
mean8200.000
σ0.000
min8200.000
max8200.000
mean2823.000-2839.000=-16.000
σ0.000
min2823.000-2839.000=-16.000
max2823.000-2839.000=-16.000
mean27.935-27.872=0.062
σ0.353-0.350=0.002
min27.588-27.523=0.064
max28.350-28.230=0.119