Compare commits

Home / Compare 34daf5b9 .. 9a104c25

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.707-70.698=0.009
σ0.046-0.049=-0.003
min70.675-70.666=0.009
max70.833-70.833=0.000
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.162-0.158=0.004
σ0.003-0.006=-0.003
min0.158-0.152=0.006
max0.166-0.173=-0.006
cache=y
dps=1
iters=10
policies=100
mean21.411-21.410=0.001
σ0.003-0.003=-0.000
min21.408-21.406=0.002
max21.416-21.414=0.002
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.062-0.064=-0.001
σ0.004-0.004=0.000
min0.059-0.059=-0.000
max0.070-0.072=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.931=-0.001
σ0.363-0.362=0.000
min1754.354-1754.363=-0.009
max1755.525-1755.533=-0.008
mean1654.550-1671.400=-16.850
σ623.578-645.055=-21.477
min688.000-670.000=18.000
max2717.000-2751.000=-34.000
mean2.775-2.789=-0.015
σ0.205-0.144=0.061
min2.312-2.270=0.041
max2.999-2.971=0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.791-272.794=-0.003
σ0.004-0.004=-0.000
min272.788-272.791=-0.003
max272.797-272.799=-0.002
mean2717.000-2751.000=-34.000
σ0.000
min2717.000-2751.000=-34.000
max2717.000-2751.000=-34.000
mean0.378-0.383=-0.004
σ0.006-0.008=-0.002
min0.374-0.378=-0.004
max0.388-0.397=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1933.232-1933.230=0.003
σ0.015-0.015=-0.001
min1933.218-1933.217=0.001
max1933.256-1933.254=0.002
mean2717.000-2751.000=-34.000
σ0.000
min2717.000-2751.000=-34.000
max2717.000-2751.000=-34.000
mean2.979-2.867=0.112
σ0.129-0.271=-0.142
min2.753-2.462=0.291
max3.074-3.133=-0.058
iters=5
new-facts=6402
prior-facts=1
mean4756.864-4756.970=-0.105
σ7.717-7.564=0.153
min4752.829-4753.559=-0.730
max4770.654-4770.500=0.154
mean2717.000-2751.000=-34.000
σ0.000
min2717.000-2751.000=-34.000
max2717.000-2751.000=-34.000
mean8.573-8.434=0.139
σ0.621-0.287=0.334
min7.640-7.940=-0.300
max9.151-8.660=0.491
iters=5
new-facts=6402
prior-facts=6402
mean4944.454-4944.388=0.066
σ0.023-0.169=-0.146
min4944.431-4944.087=0.344
max4944.485-4944.483=0.002
mean3014.400-3010.600=3.800
σ245.161-228.084=17.077
min2717.000-2751.000=-34.000
max3324.000-3309.000=15.000
mean8.598-8.539=0.059
σ0.158-0.178=-0.020
min8.418-8.267=0.151
max8.753-8.712=0.041

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.014-1.021=-0.007
σ0.140-0.199=-0.059
min0.918-0.926=-0.009
max1.239-1.377=-0.139

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.318-468.314=0.003
σ574.243-574.242=0.001
min181.188-181.184=0.004
max1329.682-1329.677=0.005
mean88.250
σ8.500
min84.000
max101.000
mean2717.000-2751.000=-34.000
σ0.000
min2717.000-2751.000=-34.000
max2717.000-2751.000=-34.000
mean0.560-0.573=-0.013
σ0.537-0.577=-0.040
min0.290-0.280=0.010
max1.365-1.439=-0.074
policies=20
mean1812.195-1812.184=0.011
σ0.378-0.389=-0.011
min1811.943-1811.928=0.015
max1812.756-1812.761=-0.005
mean840.000
σ0.000
min840.000
max840.000
mean2717.000-2751.000=-34.000
σ0.000
min2717.000-2751.000=-34.000
max2717.000-2751.000=-34.000
mean2.816-2.810=0.006
σ0.019-0.011=0.007
min2.792-2.801=-0.008
max2.831-2.826=0.005
policies=200
mean18129.003-18128.999=0.004
σ0.602-0.471=0.131
min18128.645-18128.681=-0.036
max18129.902-18129.680=0.221
mean8400.000
σ0.000
min8400.000
max8400.000
mean2717.000-2751.000=-34.000
σ0.000
min2717.000-2751.000=-34.000
max2717.000-2751.000=-34.000
mean28.423-28.420=0.003
σ0.067-0.144=-0.077
min28.354-28.297=0.057
max28.515-28.625=-0.109