Compare commits

Home / Compare 4ae262ed .. 18ba5bbc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.978=-0.000
σ0.050-0.048=0.002
min33.949-33.942=0.007
max34.117-34.109=0.007
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.080-0.084=-0.003
σ0.006-0.003=0.003
min0.075-0.079=-0.003
max0.090-0.089=0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.003-0.004=-0.000
min23.312-23.313=-0.001
max23.322-23.324=-0.002
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.065-0.065=0.000
σ0.002-0.004=-0.001
min0.063-0.060=0.004
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.487-1757.493=-0.006
σ0.364-0.363=0.001
min1756.918-1756.922=-0.004
max1758.077-1758.079=-0.001
mean1649.550-1645.650=3.900
σ639.467-635.338=4.129
min630.000-652.000=-22.000
max2879.000-2831.000=48.000
mean2.401-2.380=0.021
σ0.098-0.116=-0.018
min2.300-2.113=0.187
max2.690-2.701=-0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.638-326.636=0.001
σ0.049-0.056=-0.007
min326.551-326.537=0.014
max326.674-326.672=0.003
mean2879.000-2831.000=48.000
σ0.000
min2879.000-2831.000=48.000
max2879.000-2831.000=48.000
mean0.426-0.426=-0.001
σ0.006-0.001=0.004
min0.420-0.424=-0.004
max0.433-0.428=0.006
iters=5
new-facts=1
prior-facts=6402
mean1988.801-1988.782=0.020
σ0.014-0.014=0.000
min1988.784-1988.761=0.023
max1988.822-1988.793=0.029
mean2879.000-2831.000=48.000
σ0.000
min2879.000-2831.000=48.000
max2879.000-2831.000=48.000
mean2.724-2.745=-0.021
σ0.117-0.113=0.004
min2.625-2.612=0.014
max2.924-2.889=0.035
iters=5
new-facts=6402
prior-facts=1
mean4813.699-4813.629=0.069
σ7.741-7.730=0.012
min4810.118-4810.147=-0.029
max4827.546-4827.456=0.089
mean2879.000-2831.000=48.000
σ0.000
min2879.000-2831.000=48.000
max2879.000-2831.000=48.000
mean8.703-8.653=0.050
σ0.711-0.348=0.364
min7.675-8.107=-0.431
max9.417-9.008=0.409
iters=5
new-facts=6402
prior-facts=6402
mean5001.194-5001.057=0.137
σ0.013-0.330=-0.317
min5001.179-5000.467=0.712
max5001.205-5001.227=-0.022
mean3032.400-3061.600=-29.200
σ241.143-242.524=-1.381
min2879.000-2831.000=48.000
max3430.000-3412.000=18.000
mean9.496-9.703=-0.207
σ0.563-0.197=0.367
min8.490-9.453=-0.963
max9.778-9.961=-0.184

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.090-1.086=0.004
σ0.246-0.253=-0.007
min0.917-0.908=0.009
max1.515-1.524=-0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.632-464.632=-0.000
σ574.765-574.767=-0.002
min177.239-177.239=0.000
max1326.778-1326.782=-0.004
mean88.250
σ8.500
min84.000
max101.000
mean2879.000-2831.000=48.000
σ0.000
min2879.000-2831.000=48.000
max2879.000-2831.000=48.000
mean0.435-0.436=-0.001
σ0.304-0.298=0.006
min0.282-0.282=-0.000
max0.892-0.884=0.008
policies=20
mean1772.700-1772.733=-0.033
σ0.365-0.370=-0.006
min1772.440-1772.462=-0.022
max1773.239-1773.275=-0.037
mean840.000
σ0.000
min840.000
max840.000
mean2879.000-2831.000=48.000
σ0.000
min2879.000-2831.000=48.000
max2879.000-2831.000=48.000
mean2.798-2.844=-0.046
σ0.008-0.053=-0.045
min2.787-2.801=-0.014
max2.806-2.918=-0.111
policies=200
mean17733.837-17734.110=-0.274
σ0.540-0.479=0.062
min17733.433-17733.764=-0.331
max17734.634-17734.812=-0.178
mean8400.000
σ0.000
min8400.000
max8400.000
mean2879.000-2831.000=48.000
σ0.000
min2879.000-2831.000=48.000
max2879.000-2831.000=48.000
mean27.961-27.900=0.061
σ0.387-0.345=0.042
min27.597-27.516=0.082
max28.438-28.237=0.201