Compare commits

Home / Compare 147b772c .. e6736226

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.956-35.958=-0.001
σ0.102-0.103=-0.000
min35.915-35.911=0.004
max36.246-36.248=-0.002
mean415.000-418.200=-3.200
σ0.000-0.422=-0.422
min415.000-418.000=-3.000
max415.000-419.000=-4.000
mean0.077-0.076=0.001
σ0.004-0.003=0.001
min0.074-0.071=0.003
max0.084-0.083=0.001
cache=y
dps=1
iters=10
policies=100
mean26.203-26.203=0.000
σ0.005-0.003=0.002
min26.197-26.198=-0.001
max26.214-26.209=0.005
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.060-0.060=0.000
σ0.002-0.002=0.000
min0.059-0.056=0.002
max0.066-0.064=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.303-1756.305=-0.001
σ0.369-0.367=0.002
min1755.729-1755.730=-0.001
max1756.900-1756.899=0.001
mean1644.650-1663.600=-18.950
σ630.270-637.150=-6.880
min611.000-626.000=-15.000
max2587.000-2698.000=-111.000
mean2.389-2.414=-0.025
σ0.149-0.191=-0.041
min2.108-2.179=-0.070
max2.772-3.125=-0.354

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.826-278.825=0.001
σ0.005-0.006=-0.001
min278.820-278.814=0.005
max278.833-278.829=0.004
mean2587.000-2698.000=-111.000
σ0.000
min2587.000-2698.000=-111.000
max2587.000-2698.000=-111.000
mean0.408-0.411=-0.003
σ0.002-0.005=-0.003
min0.406-0.406=-0.000
max0.411-0.417=-0.006
iters=5
new-facts=1
prior-facts=6402
mean2268.876-2268.890=-0.014
σ0.014-0.014=0.000
min2268.851-2268.871=-0.020
max2268.884-2268.904=-0.020
mean2587.000-2698.000=-111.000
σ0.000
min2587.000-2698.000=-111.000
max2587.000-2698.000=-111.000
mean3.234-3.114=0.120
σ0.337-0.183=0.153
min2.954-2.910=0.044
max3.790-3.354=0.436
iters=5
new-facts=6402
prior-facts=1
mean4954.288-4954.288=0.000
σ0.956-0.931=0.025
min4953.644-4953.674=-0.031
max4955.978-4955.932=0.045
mean2587.000-2698.000=-111.000
σ0.000
min2587.000-2698.000=-111.000
max2587.000-2698.000=-111.000
mean8.089-8.021=0.067
σ0.446-0.399=0.047
min7.789-7.705=0.084
max8.874-8.706=0.169
iters=5
new-facts=6402
prior-facts=6402
mean5168.827-5168.754=0.073
σ0.094-0.146=-0.052
min5168.721-5168.533=0.187
max5168.911-5168.890=0.021
mean3426.200-3471.000=-44.800
σ506.759-477.761=28.998
min2838.000-2884.000=-46.000
max4185.000-4161.000=24.000
mean9.306-9.320=-0.014
σ0.443-0.179=0.263
min8.630-9.070=-0.439
max9.761-9.485=0.276

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.348-1.176=0.173
σ0.440-0.358=0.081
min0.936-0.939=-0.003
max1.875-1.805=0.070

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.818-459.818=-0.000
σ571.593-571.583=0.009
min174.017-174.017=-0.000
max1317.206-1317.193=0.013
mean79.500
σ7.000
min76.000
max90.000
mean2587.000-2698.000=-111.000
σ0.000
min2587.000-2698.000=-111.000
max2587.000-2698.000=-111.000
mean0.563-0.560=0.003
σ0.592-0.583=0.009
min0.264-0.266=-0.002
max1.452-1.435=0.017
policies=20
mean1740.437-1740.407=0.030
σ0.332-0.311=0.020
min1740.238-1740.215=0.023
max1740.933-1740.872=0.061
mean760.000
σ0.000
min760.000
max760.000
mean2587.000-2698.000=-111.000
σ0.000
min2587.000-2698.000=-111.000
max2587.000-2698.000=-111.000
mean2.698-2.671=0.027
σ0.074-0.027=0.047
min2.644-2.635=0.009
max2.806-2.695=0.111
policies=200
mean17411.271-17411.067=0.204
σ0.479-0.506=-0.026
min17411.007-17410.787=0.220
max17411.989-17411.825=0.164
mean7600.000
σ0.000
min7600.000
max7600.000
mean2587.000-2698.000=-111.000
σ0.000
min2587.000-2698.000=-111.000
max2587.000-2698.000=-111.000
mean26.983-27.005=-0.022
σ0.033-0.078=-0.045
min26.943-26.920=0.023
max27.023-27.089=-0.066