Compare commits

Home / Compare 4a15ebb5 .. 23228f88

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-53.914=0.001
σ0.366-0.368=-0.002
min53.788-53.787=0.002
max54.957-54.961=-0.004
mean419.600-416.600=3.000
σ0.843-0.516=0.327
min418.000-416.000=2.000
max420.000-417.000=3.000
mean0.137-0.138=-0.001
σ0.006-0.003=0.003
min0.130-0.134=-0.004
max0.149-0.143=0.006
cache=y
dps=1
iters=10
policies=100
mean43.140-43.140=0.000
σ0.005-0.006=-0.001
min43.131-43.131=-0.000
max43.149-43.151=-0.002
mean420.000-417.000=3.000
σ0.000
min420.000-417.000=3.000
max420.000-417.000=3.000
mean0.121-0.119=0.002
σ0.003-0.004=-0.001
min0.118-0.114=0.004
max0.126-0.126=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.812-991.792=0.020
σ1.266-1.265=0.002
min991.265-991.248=0.017
max997.144-997.117=0.027
mean1070.650-1065.150=5.500
σ322.508-321.640=0.868
min577.000-569.000=8.000
max1648.000-1629.000=19.000
mean1.586-1.570=0.016
σ0.172-0.146=0.026
min1.351-1.428=-0.076
max2.035-1.995=0.040

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-285.409=0.003
σ0.010-0.015=-0.006
min285.396-285.383=0.012
max285.420-285.422=-0.002
mean1648.000-1629.000=19.000
σ0.000
min1648.000-1629.000=19.000
max1648.000-1629.000=19.000
mean0.376-0.380=-0.005
σ0.003-0.009=-0.006
min0.373-0.373=-0.000
max0.380-0.393=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1285.357-1285.376=-0.019
σ0.100-0.136=-0.035
min1285.305-1285.307=-0.002
max1285.536-1285.619=-0.083
mean1648.000-1629.000=19.000
σ0.000
min1648.000-1629.000=19.000
max1648.000-1629.000=19.000
mean1.888-1.938=-0.050
σ0.073-0.119=-0.045
min1.819-1.832=-0.013
max2.010-2.123=-0.113
iters=5
new-facts=6402
prior-facts=1
mean1807.702-1807.728=-0.026
σ6.998-6.961=0.037
min1804.329-1804.381=-0.052
max1820.206-1820.163=0.043
mean1648.000-1629.000=19.000
σ0.000
min1648.000-1629.000=19.000
max1648.000-1629.000=19.000
mean4.182-4.198=-0.017
σ0.233-0.156=0.077
min3.932-4.073=-0.141
max4.526-4.466=0.060
iters=5
new-facts=6402
prior-facts=6402
mean2070.195-2070.196=-0.000
σ0.009-0.008=0.000
min2070.189-2070.184=0.005
max2070.211-2070.205=0.006
mean1849.200-1835.400=13.800
σ171.510-181.182=-9.672
min1648.000-1629.000=19.000
max2090.000-2073.000=17.000
mean4.508-4.491=0.017
σ0.098-0.025=0.073
min4.414-4.475=-0.061
max4.671-4.536=0.135

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.220-1.165=0.055
σ0.295-0.248=0.047
min0.913-0.902=0.012
max1.688-1.502=0.187

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.785-436.785=0.001
σ572.361-572.366=-0.004
min150.597-150.596=0.001
max1295.327-1295.333=-0.006
mean90.250
σ8.500
min86.000
max103.000
mean1648.000-1629.000=19.000
σ0.000
min1648.000-1629.000=19.000
max1648.000-1629.000=19.000
mean0.540-0.519=0.021
σ0.582-0.537=0.044
min0.248-0.248=0.000
max1.412-1.325=0.087
policies=20
mean1506.259-1506.256=0.003
σ0.233-0.221=0.012
min1506.107-1506.109=-0.002
max1506.606-1506.585=0.022
mean860.000
σ0.000
min860.000
max860.000
mean1648.000-1629.000=19.000
σ0.000
min1648.000-1629.000=19.000
max1648.000-1629.000=19.000
mean2.511-2.497=0.014
σ0.014-0.007=0.006
min2.492-2.489=0.003
max2.523-2.507=0.016
policies=200
mean15070.269-15070.287=-0.018
σ0.051-0.082=-0.031
min15070.196-15070.177=0.019
max15070.317-15070.364=-0.047
mean8600.000
σ0.000
min8600.000
max8600.000
mean1648.000-1629.000=19.000
σ0.000
min1648.000-1629.000=19.000
max1648.000-1629.000=19.000
mean25.485-25.383=0.103
σ0.108-0.066=0.042
min25.360-25.328=0.032
max25.591-25.469=0.122