Compare commits

Home / Compare 773e47a8 .. d729751a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.986-33.986=-0.000
σ0.054-0.054=0.001
min33.957-33.956=0.001
max34.140-34.138=0.002
mean412.800-415.000=-2.200
σ0.422-0.000=0.422
min412.000-415.000=-3.000
max413.000-415.000=-2.000
mean0.084-0.086=-0.001
σ0.003-0.004=-0.001
min0.082-0.083=-0.001
max0.091-0.093=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.324-23.324=0.000
σ0.003-0.004=-0.001
min23.320-23.320=0.001
max23.331-23.331=-0.000
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.064-0.066=-0.003
σ0.004-0.003=0.001
min0.059-0.065=-0.006
max0.070-0.074=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.727-1756.726=0.001
σ0.364-0.364=0.000
min1756.154-1756.169=-0.015
max1757.321-1757.300=0.022
mean1630.750-1645.900=-15.150
σ627.205-623.770=3.434
min636.000-627.000=9.000
max2824.000-2691.000=133.000
mean2.360-2.439=-0.078
σ0.129-0.254=-0.125
min2.163-2.215=-0.053
max2.653-3.298=-0.646

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean325.309-325.315=-0.006
σ0.055-0.052=0.003
min325.213-325.222=-0.010
max325.344-325.341=0.003
mean2824.000-2691.000=133.000
σ0.000
min2824.000-2691.000=133.000
max2824.000-2691.000=133.000
mean0.424-0.431=-0.007
σ0.001-0.006=-0.005
min0.422-0.426=-0.003
max0.426-0.440=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1985.877-1985.877=-0.000
σ0.013-0.009=0.004
min1985.863-1985.863=0.001
max1985.892-1985.888=0.004
mean2824.000-2691.000=133.000
σ0.000
min2824.000-2691.000=133.000
max2824.000-2691.000=133.000
mean2.835-2.724=0.111
σ0.179-0.082=0.097
min2.616-2.673=-0.057
max3.112-2.869=0.243
iters=5
new-facts=6402
prior-facts=1
mean4809.515-4809.420=0.095
σ7.779-7.488=0.290
min4805.636-4805.561=0.074
max4823.424-4822.804=0.619
mean2824.000-2691.000=133.000
σ0.000
min2824.000-2691.000=133.000
max2824.000-2691.000=133.000
mean8.978-8.465=0.513
σ0.080-0.580=-0.500
min8.837-7.706=1.131
max9.031-9.163=-0.132
iters=5
new-facts=6402
prior-facts=6402
mean4997.193-4997.091=0.103
σ0.015-0.131=-0.116
min4997.174-4996.861=0.313
max4997.213-4997.175=0.038
mean3042.200-3006.200=36.000
σ280.956-362.472=-81.516
min2824.000-2691.000=133.000
max3474.000-3535.000=-61.000
mean8.866-8.531=0.335
σ0.305-0.108=0.196
min8.637-8.399=0.238
max9.337-8.694=0.642

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.976-1.039=-0.062
σ0.068-0.163=-0.095
min0.917-0.916=0.001
max1.054-1.236=-0.182

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.381-463.375=0.006
σ574.770-574.777=-0.006
min175.985-175.979=0.006
max1325.536-1325.540=-0.004
mean86.250
σ8.500
min82.000
max99.000
mean2824.000-2691.000=133.000
σ0.000
min2824.000-2691.000=133.000
max2824.000-2691.000=133.000
mean0.427-0.556=-0.129
σ0.292-0.556=-0.264
min0.280-0.277=0.002
max0.865-1.390=-0.525
policies=20
mean1760.160-1760.102=0.058
σ0.355-0.336=0.019
min1759.917-1759.883=0.035
max1760.684-1760.601=0.083
mean820.000
σ0.000
min820.000
max820.000
mean2824.000-2691.000=133.000
σ0.000
min2824.000-2691.000=133.000
max2824.000-2691.000=133.000
mean2.807-2.741=0.066
σ0.006-0.024=-0.018
min2.801-2.715=0.086
max2.813-2.771=0.042
policies=200
mean17608.337-17608.400=-0.062
σ0.401-0.524=-0.122
min17607.966-17608.035=-0.070
max17608.907-17609.176=-0.269
mean8200.000
σ0.000
min8200.000
max8200.000
mean2824.000-2691.000=133.000
σ0.000
min2824.000-2691.000=133.000
max2824.000-2691.000=133.000
mean27.802-27.579=0.223
σ0.391-0.117=0.274
min27.376-27.424=-0.047
max28.261-27.688=0.573