Compare commits

Home / Compare 81cd384c .. f26983ad

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.654-53.655=-0.001
σ0.369-0.370=-0.000
min53.511-53.517=-0.006
max54.704-54.706=-0.002
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.138-0.137=0.001
σ0.004-0.003=0.001
min0.135-0.134=0.001
max0.145-0.141=0.004
cache=y
dps=1
iters=10
policies=100
mean42.981-42.980=0.001
σ0.005-0.007=-0.002
min42.976-42.970=0.006
max42.991-42.992=-0.000
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.122-0.119=0.002
σ0.008-0.005=0.003
min0.117-0.115=0.002
max0.142-0.126=0.016

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.693-1013.694=-0.001
σ1.212-1.213=-0.002
min1013.163-1013.163=0.000
max1018.770-1018.776=-0.006
mean1060.950
σ318.078-316.357=1.721
min594.000-595.000=-1.000
max1655.000-1638.000=17.000
mean1.602-1.622=-0.019
σ0.085-0.096=-0.011
min1.448-1.523=-0.075
max1.849-1.871=-0.021

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean334.474-334.291=0.183
σ0.212-0.202=0.010
min334.303-334.103=0.200
max335.059-334.825=0.234
mean2114.000-2111.000=3.000
σ0.000
min2114.000-2111.000=3.000
max2114.000-2111.000=3.000
mean0.794-0.774=0.020
σ0.052-0.066=-0.015
min0.711-0.688=0.023
max0.848-0.849=-0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.415-294.415=0.000
σ0.016-0.018=-0.002
min294.395-294.393=0.002
max294.438-294.440=-0.002
mean1655.000-1638.000=17.000
σ0.000
min1655.000-1638.000=17.000
max1655.000-1638.000=17.000
mean0.395-0.390=0.005
σ0.011-0.009=0.002
min0.380-0.383=-0.002
max0.403-0.401=0.003
iters=5
new-facts=1
prior-facts=6402
mean1316.714-1316.696=0.018
σ0.086-0.077=0.009
min1316.565-1316.565=0.000
max1316.784-1316.771=0.013
mean1655.000-1638.000=17.000
σ0.000
min1655.000-1638.000=17.000
max1655.000-1638.000=17.000
mean1.886-1.894=-0.007
σ0.050-0.080=-0.030
min1.828-1.827=0.001
max1.944-2.029=-0.085
iters=5
new-facts=6402
prior-facts=1
mean1736.930-1736.943=-0.013
σ6.935-6.906=0.029
min1733.645-1733.696=-0.051
max1749.332-1749.292=0.040
mean1655.000-1638.000=17.000
σ0.000
min1655.000-1638.000=17.000
max1655.000-1638.000=17.000
mean3.186-3.067=0.119
σ0.415-0.360=0.056
min2.572-2.624=-0.052
max3.696-3.506=0.190
iters=5
new-facts=6402
prior-facts=6402
mean1999.658-1999.669=-0.011
σ0.012-0.018=-0.006
min1999.643-1999.642=0.002
max1999.675-1999.687=-0.012
mean1891.200-1868.600=22.600
σ197.772-193.833=3.939
min1655.000-1638.000=17.000
max2114.000-2111.000=3.000
mean3.322-3.343=-0.021
σ0.098-0.096=0.002
min3.184-3.257=-0.073
max3.412-3.495=-0.083

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.149-1.172=-0.023
σ0.256-0.206=0.049
min0.911-0.918=-0.007
max1.556-1.463=0.093

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean441.087-441.092=-0.005
σ573.040-573.035=0.006
min154.565-154.568=-0.004
max1300.648-1300.644=0.003
mean94.250
σ8.500
min90.000
max107.000
mean1655.000-1638.000=17.000
σ0.000
min1655.000-1638.000=17.000
max1655.000-1638.000=17.000
mean0.542-0.563=-0.021
σ0.551-0.599=-0.048
min0.264-0.258=0.005
max1.368-1.461=-0.092
policies=20
mean1545.911-1545.913=-0.002
σ0.321-0.328=-0.007
min1545.726-1545.716=0.010
max1546.391-1546.403=-0.012
mean900.000
σ0.000
min900.000
max900.000
mean1655.000-1638.000=17.000
σ0.000
min1655.000-1638.000=17.000
max1655.000-1638.000=17.000
mean2.608-2.618=-0.010
σ0.017-0.012=0.005
min2.583-2.608=-0.025
max2.622-2.634=-0.012
policies=200
mean15467.056-15467.112=-0.056
σ0.087-0.061=0.026
min15466.945-15467.043=-0.098
max15467.138-15467.188=-0.050
mean9000.000
σ0.000
min9000.000
max9000.000
mean1655.000-1638.000=17.000
σ0.000
min1655.000-1638.000=17.000
max1655.000-1638.000=17.000
mean26.610-26.605=0.004
σ0.200-0.160=0.040
min26.428-26.447=-0.019
max26.835-26.820=0.015