Compare commits

Home / Compare d7ab856f .. 11584e05

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.727-36.728=-0.001
σ0.614-0.687=-0.073
min35.929-35.922=0.007
max37.220-37.531=-0.311
mean3986.000-3924.000=62.000
σ0.000
min3986.000-3924.000=62.000
max3986.000-3924.000=62.000
mean0.076-0.075=0.000
σ0.002-0.001=0.002
min0.072-0.074=-0.002
max0.080-0.077=0.003
cache=y
dps=1
iters=10
policies=100
mean26.711-26.587=0.124
σ0.646-0.606=0.040
min26.207-26.205=0.001
max27.463-27.465=-0.002
mean3986.000-3924.000=62.000
σ0.000
min3986.000-3924.000=62.000
max3986.000-3924.000=62.000
mean0.060-0.060=-0.001
σ0.002-0.001=0.001
min0.056-0.059=-0.003
max0.063-0.062=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.368-1756.368=0.000
σ0.373-0.373=-0.000
min1755.800-1755.800=0.000
max1756.968-1756.960=0.009
mean1658.400-1652.000=6.400
σ627.666-632.187=-4.521
min684.000-620.000=64.000
max2609.000-2594.000=15.000
mean2.269-2.324=-0.054
σ0.152-0.185=-0.033
min2.157-2.145=0.012
max2.792-2.741=0.051

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.701-278.698=0.003
σ0.010-0.015=-0.004
min278.693-278.682=0.011
max278.718-278.721=-0.002
mean2609.000-2594.000=15.000
σ0.000
min2609.000-2594.000=15.000
max2609.000-2594.000=15.000
mean0.415-0.425=-0.010
σ0.002-0.012=-0.010
min0.414-0.416=-0.002
max0.418-0.439=-0.021
iters=5
new-facts=1
prior-facts=6402
mean2268.872-2268.867=0.005
σ0.004-0.009=-0.005
min2268.868-2268.853=0.014
max2268.877-2268.875=0.001
mean2609.000-2594.000=15.000
σ0.000
min2609.000-2594.000=15.000
max2609.000-2594.000=15.000
mean2.908-2.985=-0.078
σ0.087-0.144=-0.057
min2.768-2.887=-0.119
max3.005-3.240=-0.235
iters=5
new-facts=6402
prior-facts=1
mean4952.360-4952.244=0.117
σ0.865-0.962=-0.097
min4951.879-4951.431=0.448
max4953.904-4953.914=-0.010
mean2609.000-2594.000=15.000
σ0.000
min2609.000-2594.000=15.000
max2609.000-2594.000=15.000
mean7.985-7.934=0.051
σ0.297-0.288=0.009
min7.719-7.636=0.083
max8.468-8.366=0.102
iters=5
new-facts=6402
prior-facts=6402
mean5167.004-5167.076=-0.072
σ0.150-0.014=0.136
min5166.735-5167.062=-0.327
max5167.079-5167.098=-0.019
mean3384.000-3374.400=9.600
σ479.347-425.087=54.260
min2729.000-2801.000=-72.000
max3986.000-3924.000=62.000
mean9.336-9.300=0.036
σ0.195-0.229=-0.033
min9.113-9.066=0.047
max9.586-9.557=0.029

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.080-1.081=-0.000
σ0.110-0.093=0.017
min0.940-0.946=-0.006
max1.249-1.209=0.040

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.261-460.261=-0.000
σ572.607-572.607=-0.000
min173.956-173.955=0.001
max1319.171-1319.172=-0.001
mean79.500
σ7.000
min76.000
max90.000
mean435.000-437.000=-2.000
σ0.000
min435.000-437.000=-2.000
max435.000-437.000=-2.000
mean0.565-0.550=0.015
σ0.584-0.562=0.022
min0.267-0.263=0.004
max1.441-1.393=0.048
policies=20
mean1740.066-1740.066=-0.000
σ0.334-0.326=0.008
min1739.823-1739.832=-0.010
max1740.556-1740.545=0.011
mean760.000
σ0.000
min760.000
max760.000
mean445.500-446.250=-0.750
σ9.950-9.032=0.918
min435.000-437.000=-2.000
max454.000
mean2.662-2.653=0.009
σ0.013-0.023=-0.010
min2.645-2.633=0.012
max2.677-2.683=-0.006
policies=200
mean17409.837-17409.864=-0.027
σ0.052-0.076=-0.024
min17409.788-17409.774=0.015
max17409.911-17409.960=-0.049
mean7600.000
σ0.000
min7600.000
max7600.000
mean491.250-490.750=0.500
σ4.113-4.856=-0.743
min486.000
max495.000-497.000=-2.000
mean26.836-26.828=0.008
σ0.069-0.022=0.047
min26.783-26.801=-0.018
max26.932-26.854=0.077