Compare commits

Home / Compare 97691288 .. d9f6947c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-35.245=-0.000
σ0.053-0.054=-0.001
min35.221-35.219=0.001
max35.396-35.398=-0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.085-0.083=0.003
σ0.004-0.005=-0.002
min0.083-0.077=0.006
max0.092-0.091=0.001
cache=y
dps=1
iters=10
policies=100
mean23.771-23.770=0.001
σ0.003-0.003=-0.000
min23.766-23.765=0.001
max23.776-23.774=0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.069-0.069=-0.000
σ0.003-0.003=-0.000
min0.066-0.066=-0.000
max0.075-0.076=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.364-1756.364=0.000
σ0.366-0.365=0.001
min1755.789-1755.789=-0.000
max1756.957-1756.950=0.008
mean1666.150-1652.700=13.450
σ615.397-643.626=-28.228
min677.000-627.000=50.000
max2503.000-2840.000=-337.000
mean2.334-2.327=0.007
σ0.074-0.081=-0.007
min2.176-2.247=-0.071
max2.437-2.550=-0.114

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.588-324.581=0.007
σ0.044-0.052=-0.008
min324.510-324.488=0.022
max324.612-324.611=0.000
mean2503.000-2840.000=-337.000
σ0.000
min2503.000-2840.000=-337.000
max2503.000-2840.000=-337.000
mean0.424-0.426=-0.002
σ0.002-0.006=-0.004
min0.421-0.422=-0.001
max0.427-0.436=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1985.136-1985.138=-0.002
σ0.020-0.012=0.008
min1985.109-1985.127=-0.017
max1985.154-1985.155=-0.001
mean2503.000-2840.000=-337.000
σ0.000
min2503.000-2840.000=-337.000
max2503.000-2840.000=-337.000
mean2.724-2.641=0.083
σ0.286-0.103=0.184
min2.499-2.555=-0.057
max3.195-2.785=0.410
iters=5
new-facts=6402
prior-facts=1
mean4808.739-4808.739=-0.000
σ7.661-7.665=-0.005
min4805.280-4805.251=0.029
max4822.443-4822.451=-0.008
mean2503.000-2840.000=-337.000
σ0.000
min2503.000-2840.000=-337.000
max2503.000-2840.000=-337.000
mean8.963-8.682=0.280
σ0.121-0.517=-0.397
min8.839-7.778=1.061
max9.131-9.022=0.109
iters=5
new-facts=6402
prior-facts=6402
mean4996.134-4996.341=-0.206
σ0.179-0.017=0.162
min4996.002-4996.313=-0.311
max4996.335-4996.355=-0.020
mean2991.600-3065.200=-73.600
σ308.096-303.369=4.727
min2586.000-2840.000=-254.000
max3389.000-3531.000=-142.000
mean8.588-8.512=0.076
σ0.082-0.130=-0.048
min8.491-8.401=0.090
max8.705-8.733=-0.028

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.568-0.973=0.596
σ0.289-0.064=0.225
min1.084-0.916=0.168
max1.805-1.045=0.760

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.949-462.970=-0.021
σ574.250-574.256=-0.006
min175.818-175.836=-0.018
max1324.324-1324.355=-0.030
mean86.250
σ8.500
min82.000
max99.000
mean2503.000-2840.000=-337.000
σ0.000
min2503.000-2840.000=-337.000
max2503.000-2840.000=-337.000
mean0.546-0.430=0.116
σ0.541-0.294=0.247
min0.273-0.281=-0.008
max1.358-0.871=0.488
policies=20
mean1758.520-1758.692=-0.172
σ0.344-0.354=-0.010
min1758.278-1758.446=-0.168
max1759.028-1759.216=-0.187
mean820.000
σ0.000
min820.000
max820.000
mean2503.000-2840.000=-337.000
σ0.000
min2503.000-2840.000=-337.000
max2503.000-2840.000=-337.000
mean2.714-2.795=-0.081
σ0.017-0.010=0.007
min2.700-2.786=-0.086
max2.737-2.809=-0.072
policies=200
mean17592.310-17593.348=-1.038
σ0.580-0.618=-0.038
min17591.952-17592.499=-0.547
max17593.170-17593.859=-0.688
mean8200.000
σ0.000
min8200.000
max8200.000
mean2503.000-2840.000=-337.000
σ0.000
min2503.000-2840.000=-337.000
max2503.000-2840.000=-337.000
mean27.442-27.885=-0.442
σ0.128-0.315=-0.186
min27.308-27.576=-0.269
max27.559-28.236=-0.677