Compare commits

Home / Compare da2321c9 .. a8dda9eb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.771-30.772=-0.001
σ0.046-0.049=-0.002
min30.747-30.743=0.004
max30.902-30.909=-0.007
mean415.000
σ0.000
min415.000
max415.000
mean0.074-0.074=0.000
σ0.005-0.005=-0.001
min0.070-0.070=-0.000
max0.083-0.085=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.059-21.059=0.000
σ0.002-0.003=-0.001
min21.054-21.055=-0.000
max21.062-21.063=-0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.063-0.063=-0.001
σ0.003-0.004=-0.001
min0.057-0.059=-0.002
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.234-1751.237=-0.003
σ0.362-0.364=-0.001
min1750.677-1750.670=0.007
max1751.802-1751.821=-0.019
mean1649.450-1665.900=-16.450
σ634.549-636.535=-1.986
min632.000-681.000=-49.000
max2850.000-2704.000=146.000
mean2.783-2.873=-0.090
σ0.200-0.131=0.069
min2.301-2.540=-0.239
max3.118-3.032=0.085

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.571-275.564=0.007
σ0.008-0.007=0.001
min275.562-275.557=0.004
max275.581-275.576=0.005
mean2850.000-2704.000=146.000
σ0.000
min2850.000-2704.000=146.000
max2850.000-2704.000=146.000
mean0.394-0.393=0.001
σ0.009-0.010=-0.001
min0.387-0.385=0.002
max0.404-0.404=-0.000
iters=5
new-facts=1
prior-facts=6402
mean2168.101-2168.091=0.010
σ0.004-0.008=-0.004
min2168.095-2168.077=0.018
max2168.107-2168.098=0.008
mean2850.000-2704.000=146.000
σ0.000
min2850.000-2704.000=146.000
max2850.000-2704.000=146.000
mean2.942-3.024=-0.082
σ0.117-0.196=-0.079
min2.768-2.779=-0.012
max3.049-3.225=-0.176
iters=5
new-facts=6402
prior-facts=1
mean5047.917-5047.785=0.131
σ0.847-1.014=-0.167
min5047.362-5046.920=0.442
max5049.409-5049.540=-0.131
mean2850.000-2704.000=146.000
σ0.000
min2850.000-2704.000=146.000
max2850.000-2704.000=146.000
mean8.736-8.766=-0.030
σ0.503-0.300=0.203
min8.079-8.351=-0.272
max9.457-9.152=0.306
iters=5
new-facts=6402
prior-facts=6402
mean5178.919-5179.041=-0.122
σ0.349-0.077=0.272
min5178.312-5178.968=-0.656
max5179.158-5179.129=0.029
mean3251.200-3220.600=30.600
σ334.534-379.642=-45.107
min2850.000-2704.000=146.000
max3706.000-3700.000=6.000
mean10.198-9.884=0.313
σ0.222-0.389=-0.166
min9.927-9.433=0.495
max10.463-10.466=-0.003

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.068-1.086=-0.017
σ0.187-0.133=0.053
min0.953-0.957=-0.004
max1.385-1.265=0.119

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.207-463.207=-0.000
σ572.651-572.661=-0.010
min176.875-176.873=0.003
max1322.183-1322.198=-0.015
mean77.500
σ7.000
min74.000
max88.000
mean2850.000-2704.000=146.000
σ0.000
min2850.000-2704.000=146.000
max2850.000-2704.000=146.000
mean0.437-0.548=-0.111
σ0.313-0.544=-0.231
min0.272-0.271=0.001
max0.906-1.364=-0.457
policies=20
mean1769.006-1768.971=0.035
σ0.337-0.338=-0.001
min1768.781-1768.757=0.024
max1769.506-1769.476=0.030
mean740.000
σ0.000
min740.000
max740.000
mean2850.000-2704.000=146.000
σ0.000
min2850.000-2704.000=146.000
max2850.000-2704.000=146.000
mean2.840-2.755=0.086
σ0.016-0.017=-0.001
min2.829-2.740=0.088
max2.863-2.778=0.085
policies=200
mean17696.173-17696.241=-0.068
σ0.586-0.507=0.079
min17695.842-17695.930=-0.088
max17697.049-17696.995=0.053
mean7400.000
σ0.000
min7400.000
max7400.000
mean2850.000-2704.000=146.000
σ0.000
min2850.000-2704.000=146.000
max2850.000-2704.000=146.000
mean28.169-27.688=0.481
σ0.517-0.142=0.375
min27.575-27.501=0.075
max28.664-27.801=0.864