Compare commits

Home / Compare c080755f .. c5b5b55d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean92.523-92.531=-0.008
σ0.054-0.051=0.003
min92.467-92.495=-0.028
max92.665-92.666=-0.001
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.213-0.235=-0.022
σ0.005-0.024=-0.018
min0.200-0.204=-0.004
max0.220-0.259=-0.039
cache=y
dps=1
iters=10
policies=100
mean43.138-43.136=0.001
σ0.007-0.005=0.002
min43.126-43.128=-0.002
max43.150-43.144=0.007
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.112-0.115=-0.002
σ0.003-0.003=-0.000
min0.109-0.110=-0.001
max0.118-0.118=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1761.434-1761.433=0.001
σ0.363-0.362=0.001
min1760.856-1760.864=-0.007
max1762.025-1762.026=-0.001
mean1670.950-1654.450=16.500
σ641.983-640.734=1.249
min621.000-659.000=-38.000
max2788.000-2836.000=-48.000
mean2.546-2.568=-0.023
σ0.281-0.339=-0.058
min2.164-2.174=-0.010
max2.959-3.216=-0.257

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean328.772-328.800=-0.028
σ0.054-0.069=-0.015
min328.676-328.676=-0.001
max328.806-328.838=-0.032
mean2788.000-2836.000=-48.000
σ0.000
min2788.000-2836.000=-48.000
max2788.000-2836.000=-48.000
mean0.447-0.447=0.000
σ0.011-0.013=-0.002
min0.433-0.434=-0.001
max0.458-0.462=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1989.319-1989.320=-0.000
σ0.013-0.014=-0.001
min1989.306-1989.303=0.003
max1989.334-1989.332=0.002
mean2788.000-2836.000=-48.000
σ0.000
min2788.000-2836.000=-48.000
max2788.000-2836.000=-48.000
mean3.079-3.039=0.040
σ0.052-0.138=-0.086
min3.025-2.845=0.180
max3.163-3.215=-0.051
iters=5
new-facts=6402
prior-facts=1
mean4813.059-4812.936=0.122
σ7.798-7.852=-0.054
min4809.425-4808.980=0.445
max4827.006-4826.974=0.031
mean2788.000-2836.000=-48.000
σ0.000
min2788.000-2836.000=-48.000
max2788.000-2836.000=-48.000
mean8.507-8.735=-0.228
σ0.524-0.265=0.259
min7.683-8.407=-0.724
max9.134-9.146=-0.013
iters=5
new-facts=6402
prior-facts=6402
mean5000.516-5000.535=-0.018
σ0.160-0.159=0.001
min5000.233-5000.253=-0.020
max5000.608-5000.629=-0.021
mean3052.600-3017.000=35.600
σ237.106-201.149=35.957
min2788.000-2836.000=-48.000
max3359.000-3325.000=34.000
mean8.890-8.837=0.053
σ0.439-0.436=0.004
min8.463-8.515=-0.052
max9.548-9.597=-0.048

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.014-1.042=-0.028
σ0.140-0.133=0.007
min0.920-0.919=0.001
max1.240-1.245=-0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean470.847-470.844=0.003
σ574.236-574.237=-0.001
min183.719-183.719=-0.001
max1332.200-1332.200=0.000
mean90.250
σ8.500
min86.000
max103.000
mean2788.000-2836.000=-48.000
σ0.000
min2788.000-2836.000=-48.000
max2788.000-2836.000=-48.000
mean0.444-0.439=0.005
σ0.297-0.298=-0.001
min0.292-0.279=0.013
max0.890-0.885=0.004
policies=20
mean1837.494-1837.509=-0.015
σ0.406-0.398=0.008
min1837.215-1837.214=0.001
max1838.091-1838.090=0.001
mean860.000
σ0.000
min860.000
max860.000
mean2788.000-2836.000=-48.000
σ0.000
min2788.000-2836.000=-48.000
max2788.000-2836.000=-48.000
mean2.968-2.932=0.036
σ0.082-0.015=0.068
min2.923-2.911=0.012
max3.092-2.945=0.147
policies=200
mean18381.805-18382.001=-0.197
σ0.424-0.446=-0.022
min18381.512-18381.729=-0.218
max18382.434-18382.662=-0.227
mean8600.000
σ0.000
min8600.000
max8600.000
mean2788.000-2836.000=-48.000
σ0.000
min2788.000-2836.000=-48.000
max2788.000-2836.000=-48.000
mean28.625-29.196=-0.571
σ0.052-0.434=-0.382
min28.547-28.746=-0.199
max28.661-29.593=-0.932