Compare commits

Home / Compare 4e8219e1 .. abb8c9cb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.795-35.794=0.000
σ0.108-0.109=-0.002
min35.752-35.752=0.000
max36.101-36.105=-0.004
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.076-0.076=-0.000
σ0.003-0.004=-0.001
min0.073-0.074=-0.000
max0.082-0.084=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.065-26.064=0.001
σ0.004-0.003=0.001
min26.058-26.060=-0.002
max26.072-26.069=0.003
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.062-0.059=0.002
σ0.002-0.004=-0.002
min0.060-0.056=0.003
max0.067-0.069=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.237-1751.236=0.001
σ0.362-0.363=-0.000
min1750.666-1750.668=-0.002
max1751.823-1751.824=-0.001
mean1652.300-1648.250=4.050
σ641.430-628.513=12.917
min630.000-631.000=-1.000
max2854.000-2849.000=5.000
mean2.816-2.795=0.021
σ0.201-0.188=0.013
min2.167-2.359=-0.192
max3.050-3.082=-0.033

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.570-275.545=0.026
σ0.009-0.009=0.000
min275.556-275.532=0.025
max275.582-275.553=0.029
mean2854.000-2849.000=5.000
σ0.000
min2854.000-2849.000=5.000
max2854.000-2849.000=5.000
mean0.403-0.405=-0.002
σ0.010-0.009=0.002
min0.391-0.394=-0.003
max0.414-0.417=-0.002
iters=5
new-facts=1
prior-facts=6402
mean2168.090-2168.089=0.001
σ0.018-0.018=-0.000
min2168.058-2168.060=-0.003
max2168.099-2168.103=-0.004
mean2854.000-2849.000=5.000
σ0.000
min2854.000-2849.000=5.000
max2854.000-2849.000=5.000
mean2.943-2.955=-0.012
σ0.123-0.173=-0.051
min2.761-2.767=-0.007
max3.067-3.203=-0.136
iters=5
new-facts=6402
prior-facts=1
mean5047.803-5047.708=0.095
σ0.991-1.123=-0.131
min5046.909-5046.748=0.161
max5049.507-5049.606=-0.099
mean2854.000-2849.000=5.000
σ0.000
min2854.000-2849.000=5.000
max2854.000-2849.000=5.000
mean8.859-8.962=-0.103
σ0.543-0.658=-0.115
min8.041-8.228=-0.187
max9.358-9.670=-0.311
iters=5
new-facts=6402
prior-facts=6402
mean5179.044-5179.043=0.000
σ0.087-0.091=-0.004
min5178.970-5178.947=0.023
max5179.147-5179.157=-0.009
mean3253.400-3265.000=-11.600
σ336.560-360.136=-23.576
min2854.000-2849.000=5.000
max3724.000-3625.000=99.000
mean9.989-9.688=0.301
σ0.048-0.610=-0.562
min9.954-8.664=1.291
max10.074-10.195=-0.121

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.032-1.072=-0.039
σ0.136-0.148=-0.012
min0.939-0.945=-0.006
max1.256-1.308=-0.052

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.206-463.211=-0.005
σ572.650-572.658=-0.008
min176.867-176.876=-0.009
max1322.181-1322.197=-0.017
mean77.500
σ7.000
min74.000
max88.000
mean2854.000-2849.000=5.000
σ0.000
min2854.000-2849.000=5.000
max2854.000-2849.000=5.000
mean0.435-0.438=-0.003
σ0.305-0.306=-0.001
min0.280-0.282=-0.002
max0.893-0.897=-0.005
policies=20
mean1768.980-1769.007=-0.027
σ0.332-0.342=-0.010
min1768.756-1768.771=-0.015
max1769.470-1769.512=-0.042
mean740.000
σ0.000
min740.000
max740.000
mean2854.000-2849.000=5.000
σ0.000
min2854.000-2849.000=5.000
max2854.000-2849.000=5.000
mean2.825-2.818=0.007
σ0.009-0.012=-0.003
min2.815-2.805=0.010
max2.834-2.833=0.001
policies=200
mean17696.230-17696.310=-0.080
σ0.503-0.474=0.029
min17695.961-17695.968=-0.007
max17696.985-17697.013=-0.028
mean7400.000
σ0.000
min7400.000
max7400.000
mean2854.000-2849.000=5.000
σ0.000
min2854.000-2849.000=5.000
max2854.000-2849.000=5.000
mean28.209-28.114=0.096
σ0.531-0.509=0.022
min27.696-27.623=0.073
max28.679-28.623=0.057