Compare commits

Home / Compare 423f248d .. 0270eed9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.977-35.979=-0.003
σ0.098-0.099=-0.001
min35.934-35.931=0.003
max36.255-36.258=-0.003
mean4068.000-3957.000=111.000
σ0.000
min4068.000-3957.000=111.000
max4068.000-3957.000=111.000
mean0.075-0.077=-0.002
σ0.000-0.002=-0.002
min0.075-0.075=-0.000
max0.076-0.081=-0.005
cache=y
dps=1
iters=10
policies=100
mean26.208-26.206=0.002
σ0.004-0.004=0.001
min26.200-26.200=-0.001
max26.214-26.212=0.002
mean4068.000-3957.000=111.000
σ0.000
min4068.000-3957.000=111.000
max4068.000-3957.000=111.000
mean0.060-0.061=-0.000
σ0.001-0.001=-0.000
min0.059-0.059=-0.000
max0.061-0.062=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.368-1756.358=0.010
σ0.373-0.373=-0.000
min1755.796-1755.781=0.014
max1756.966-1756.961=0.005
mean1659.100-1653.550=5.550
σ627.644-627.262=0.382
min616.000-680.000=-64.000
max2631.000-2603.000=28.000
mean2.300-2.248=0.053
σ0.147-0.123=0.024
min2.172-2.135=0.038
max2.797-2.681=0.116

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.697-278.674=0.023
σ0.007-0.013=-0.005
min278.691-278.666=0.024
max278.708-278.696=0.011
mean2631.000-2603.000=28.000
σ0.000
min2631.000-2603.000=28.000
max2631.000-2603.000=28.000
mean0.420-0.424=-0.004
σ0.001-0.009=-0.008
min0.419-0.419=-0.000
max0.422-0.440=-0.018
iters=5
new-facts=1
prior-facts=6402
mean2268.870-2268.848=0.022
σ0.006-0.005=0.000
min2268.865-2268.843=0.022
max2268.879-2268.857=0.022
mean2631.000-2603.000=28.000
σ0.000
min2631.000-2603.000=28.000
max2631.000-2603.000=28.000
mean2.957-2.937=0.020
σ0.084-0.053=0.031
min2.903-2.885=0.018
max3.105-3.009=0.096
iters=5
new-facts=6402
prior-facts=1
mean4952.348-4952.194=0.154
σ0.785-0.633=0.152
min4951.893-4951.826=0.067
max4953.747-4953.318=0.429
mean2631.000-2603.000=28.000
σ0.000
min2631.000-2603.000=28.000
max2631.000-2603.000=28.000
mean7.902-8.074=-0.173
σ0.273-0.380=-0.107
min7.558-7.722=-0.164
max8.309-8.518=-0.209
iters=5
new-facts=6402
prior-facts=6402
mean5167.012-5167.053=-0.041
σ0.164-0.011=0.153
min5166.722-5167.044=-0.322
max5167.116-5167.065=0.051
mean3427.400-3352.400=75.000
σ493.681-452.789=40.891
min2762.000-2756.000=6.000
max4068.000-3957.000=111.000
mean9.693-9.495=0.198
σ0.532-0.412=0.120
min9.183-9.072=0.110
max10.560-10.110=0.450

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.054-1.112=-0.058
σ0.282-0.083=0.199
min0.911-1.066=-0.154
max1.559-1.261=0.298

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.259-460.255=0.004
σ572.609-572.607=0.002
min173.950-173.950=-0.001
max1319.173-1319.166=0.006
mean79.500
σ7.000
min76.000
max90.000
mean435.000-437.000=-2.000
σ0.000
min435.000-437.000=-2.000
max435.000-437.000=-2.000
mean0.548-0.560=-0.012
σ0.548-0.573=-0.025
min0.270-0.268=0.002
max1.369-1.419=-0.050
policies=20
mean1740.051-1740.008=0.043
σ0.331-0.344=-0.013
min1739.815-1739.770=0.044
max1740.538-1740.517=0.021
mean760.000
σ0.000
min760.000
max760.000
mean445.500-446.250=-0.750
σ9.950-9.032=0.918
min435.000-437.000=-2.000
max454.000
mean2.654-2.713=-0.059
σ0.011-0.060=-0.049
min2.643-2.651=-0.008
max2.665-2.779=-0.113
policies=200
mean17409.955-17409.258=0.697
σ0.058-0.151=-0.093
min17409.904-17409.078=0.826
max17410.027-17409.392=0.635
mean7600.000
σ0.000
min7600.000
max7600.000
mean487.750-491.250=-3.500
σ1.708-2.062=-0.354
min486.000-489.000=-3.000
max490.000-493.000=-3.000
mean26.918-26.997=-0.080
σ0.106-0.123=-0.017
min26.804-26.901=-0.097
max27.017-27.160=-0.142