Compare commits

Home / Compare a68a7af3 .. 47adf1b3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.617=-0.000
σ0.056-0.055=0.001
min35.591-35.587=0.004
max35.776-35.773=0.003
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.083-0.084=-0.001
σ0.005-0.005=0.000
min0.076-0.078=-0.001
max0.092-0.092=-0.000
cache=y
dps=1
iters=10
policies=100
mean24.046-24.047=-0.000
σ0.003-0.003=0.000
min24.042-24.043=-0.001
max24.051-24.051=-0.000
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.067-0.065=0.002
σ0.005-0.003=0.002
min0.060-0.061=-0.001
max0.074-0.069=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1718.563-1756.489=-37.926
σ169.703-0.365=169.338
min997.577-1755.915=-758.338
max1757.080-1757.081=-0.001
mean1593.350-1655.850=-62.500
σ603.188-641.870=-38.683
min629.000-623.000=6.000
max2429.000-2848.000=-419.000
mean2.263-2.354=-0.091
σ0.218-0.068=0.150
min1.397-2.266=-0.869
max2.444-2.507=-0.064

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.766-324.762=0.005
σ0.050-0.056=-0.006
min324.678-324.663=0.015
max324.795-324.793=0.002
mean2429.000-2848.000=-419.000
σ0.000
min2429.000-2848.000=-419.000
max2429.000-2848.000=-419.000
mean0.431-0.429=0.002
σ0.012-0.009=0.003
min0.421-0.424=-0.003
max0.448-0.445=0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.319-1985.316=0.002
σ0.013-0.015=-0.002
min1985.305-1985.298=0.007
max1985.334-1985.332=0.002
mean2429.000-2848.000=-419.000
σ0.000
min2429.000-2848.000=-419.000
max2429.000-2848.000=-419.000
mean2.624-2.658=-0.033
σ0.096-0.105=-0.010
min2.535-2.567=-0.032
max2.739-2.778=-0.039
iters=5
new-facts=6402
prior-facts=1
mean4808.980-4809.000=-0.020
σ7.745-7.774=-0.029
min4805.008-4805.014=-0.007
max4822.824-4822.897=-0.073
mean2429.000-2848.000=-419.000
σ0.000
min2429.000-2848.000=-419.000
max2429.000-2848.000=-419.000
mean8.930-8.795=0.134
σ0.424-0.409=0.015
min8.587-8.075=0.512
max9.613-9.056=0.557
iters=5
new-facts=6402
prior-facts=6402
mean4996.632-4996.489=0.143
σ0.013-0.192=-0.179
min4996.614-4996.256=0.358
max4996.646-4996.647=-0.001
mean2995.400-3067.000=-71.600
σ324.019-291.781=32.238
min2571.000-2848.000=-277.000
max3408.000-3517.000=-109.000
mean8.612-8.543=0.069
σ0.108-0.132=-0.024
min8.491-8.465=0.026
max8.716-8.777=-0.061

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.629-1.009=0.620
σ0.245-0.118=0.126
min1.198-0.928=0.270
max1.791-1.194=0.597

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.203-463.209=-0.007
σ574.763-574.767=-0.004
min175.816-175.816=0.001
max1325.346-1325.360=-0.013
mean86.250
σ8.500
min82.000
max99.000
mean2429.000-2848.000=-419.000
σ0.000
min2429.000-2848.000=-419.000
max2429.000-2848.000=-419.000
mean0.542-0.435=0.106
σ0.545-0.301=0.244
min0.266-0.283=-0.018
max1.359-0.887=0.472
policies=20
mean1758.496-1758.501=-0.005
σ0.348-0.352=-0.004
min1758.258-1758.253=0.005
max1759.010-1759.020=-0.009
mean820.000
σ0.000
min820.000
max820.000
mean2429.000-2848.000=-419.000
σ0.000
min2429.000-2848.000=-419.000
max2429.000-2848.000=-419.000
mean2.701-2.791=-0.090
σ0.013-0.004=0.009
min2.685-2.786=-0.101
max2.715-2.795=-0.080
policies=200
mean17592.001-17592.131=-0.130
σ0.615-0.512=0.103
min17591.648-17591.834=-0.186
max17592.922-17592.897=0.025
mean8200.000
σ0.000
min8200.000
max8200.000
mean2429.000-2848.000=-419.000
σ0.000
min2429.000-2848.000=-419.000
max2429.000-2848.000=-419.000
mean27.299-28.030=-0.731
σ0.133-0.376=-0.243
min27.158-27.662=-0.504
max27.474-28.494=-1.020