Compare commits

Home / Compare e6736226 .. 6342698d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.957-35.956=0.000
σ0.102-0.102=0.000
min35.916-35.915=0.001
max36.248-36.246=0.001
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.074-0.077=-0.003
σ0.004-0.004=0.000
min0.070-0.074=-0.004
max0.084-0.084=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.203-26.203=-0.000
σ0.004-0.005=-0.001
min26.198-26.197=0.001
max26.211-26.214=-0.003
mean417.900-415.000=2.900
σ0.316-0.000=0.316
min417.000-415.000=2.000
max418.000-415.000=3.000
mean0.059-0.060=-0.002
σ0.003-0.002=0.001
min0.056-0.059=-0.003
max0.066-0.066=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.305-1756.303=0.001
σ0.369-0.369=-0.001
min1755.729-1755.729=0.000
max1756.897-1756.900=-0.003
mean1670.000-1644.650=25.350
σ628.342-630.270=-1.928
min685.000-611.000=74.000
max2695.000-2587.000=108.000
mean2.398-2.389=0.009
σ0.089-0.149=-0.060
min2.232-2.108=0.124
max2.537-2.772=-0.235

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.817-278.826=-0.008
σ0.015-0.005=0.010
min278.792-278.820=-0.028
max278.829-278.833=-0.004
mean2695.000-2587.000=108.000
σ0.000
min2695.000-2587.000=108.000
max2695.000-2587.000=108.000
mean0.425-0.408=0.017
σ0.009-0.002=0.007
min0.409-0.406=0.003
max0.431-0.411=0.020
iters=5
new-facts=1
prior-facts=6402
mean2268.881-2268.876=0.005
σ0.007-0.014=-0.006
min2268.871-2268.851=0.020
max2268.892-2268.884=0.008
mean2695.000-2587.000=108.000
σ0.000
min2695.000-2587.000=108.000
max2695.000-2587.000=108.000
mean2.966-3.234=-0.268
σ0.075-0.337=-0.262
min2.911-2.954=-0.043
max3.096-3.790=-0.693
iters=5
new-facts=6402
prior-facts=1
mean4954.275-4954.288=-0.013
σ1.035-0.956=0.079
min4953.573-4953.644=-0.071
max4956.100-4955.978=0.122
mean2695.000-2587.000=108.000
σ0.000
min2695.000-2587.000=108.000
max2695.000-2587.000=108.000
mean8.308-8.089=0.219
σ0.565-0.446=0.119
min7.691-7.789=-0.098
max9.233-8.874=0.359
iters=5
new-facts=6402
prior-facts=6402
mean5168.821-5168.827=-0.006
σ0.090-0.094=-0.004
min5168.720-5168.721=-0.001
max5168.900-5168.911=-0.011
mean3399.800-3426.200=-26.400
σ461.109-506.759=-45.650
min2814.000-2838.000=-24.000
max4016.000-4185.000=-169.000
mean9.337-9.306=0.031
σ0.262-0.443=-0.181
min8.957-8.630=0.327
max9.655-9.761=-0.106

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.133-1.348=-0.216
σ0.137-0.440=-0.303
min0.951-0.936=0.015
max1.277-1.875=-0.598

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.815-459.818=-0.003
σ571.586-571.593=-0.007
min174.015-174.017=-0.002
max1317.193-1317.206=-0.013
mean79.500
σ7.000
min76.000
max90.000
mean2695.000-2587.000=108.000
σ0.000
min2695.000-2587.000=108.000
max2695.000-2587.000=108.000
mean0.563-0.563=-0.000
σ0.583-0.592=-0.010
min0.268-0.264=0.004
max1.437-1.452=-0.015
policies=20
mean1740.420-1740.437=-0.018
σ0.331-0.332=-0.001
min1740.194-1740.238=-0.044
max1740.910-1740.933=-0.022
mean760.000
σ0.000
min760.000
max760.000
mean2695.000-2587.000=108.000
σ0.000
min2695.000-2587.000=108.000
max2695.000-2587.000=108.000
mean2.689-2.698=-0.008
σ0.006-0.074=-0.068
min2.681-2.644=0.037
max2.694-2.806=-0.112
policies=200
mean17411.274-17411.271=0.003
σ0.473-0.479=-0.007
min17411.034-17411.007=0.027
max17411.983-17411.989=-0.006
mean7600.000
σ0.000
min7600.000
max7600.000
mean2695.000-2587.000=108.000
σ0.000
min2695.000-2587.000=108.000
max2695.000-2587.000=108.000
mean27.059-26.983=0.076
σ0.062-0.033=0.028
min26.996-26.943=0.053
max27.144-27.023=0.121