Compare commits

Home / Compare 738fd0ec .. b258ea50

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.688-70.686=0.002
σ0.047-0.045=0.002
min70.663-70.663=-0.000
max70.821-70.813=0.007
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.168-0.161=0.007
σ0.012-0.003=0.009
min0.153-0.158=-0.005
max0.185-0.166=0.019
cache=y
dps=1
iters=10
policies=100
mean21.420-21.420=0.000
σ0.003-0.004=-0.001
min21.415-21.415=0.000
max21.424-21.426=-0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.065-0.063=0.002
σ0.002-0.004=-0.001
min0.064-0.060=0.004
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1754.457=0.001
σ0.360-0.357=0.003
min1753.885-1753.887=-0.002
max1755.047-1755.030=0.017
mean1674.600-1673.200=1.400
σ650.793-651.225=-0.432
min625.000
max2872.000-2843.000=29.000
mean2.804-2.813=-0.010
σ0.180-0.126=0.055
min2.155-2.529=-0.374
max3.012-2.970=0.043

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.506-273.502=0.004
σ0.005-0.005=-0.001
min273.500-273.495=0.005
max273.512-273.508=0.004
mean2872.000-2843.000=29.000
σ0.000
min2872.000-2843.000=29.000
max2872.000-2843.000=29.000
mean0.385-0.376=0.009
σ0.005-0.006=-0.001
min0.382-0.373=0.009
max0.394-0.387=0.007
iters=5
new-facts=1
prior-facts=6402
mean1933.910-1933.895=0.015
σ0.017-0.008=0.009
min1933.893-1933.886=0.006
max1933.933-1933.905=0.028
mean2872.000-2843.000=29.000
σ0.000
min2872.000-2843.000=29.000
max2872.000-2843.000=29.000
mean2.838-2.924=-0.086
σ0.311-0.271=0.040
min2.494-2.564=-0.069
max3.127-3.290=-0.163
iters=5
new-facts=6402
prior-facts=1
mean4754.735-4754.587=0.147
σ0.804-0.883=-0.078
min4754.298-4753.889=0.408
max4756.171-4756.126=0.045
mean2872.000-2843.000=29.000
σ0.000
min2872.000-2843.000=29.000
max2872.000-2843.000=29.000
mean7.979-8.130=-0.151
σ0.348-0.501=-0.154
min7.700-7.711=-0.011
max8.586-8.901=-0.315
iters=5
new-facts=6402
prior-facts=6402
mean4944.909-4945.120=-0.212
σ0.327-0.011=0.316
min4944.386-4945.110=-0.725
max4945.140-4945.138=0.002
mean3036.200-3082.600=-46.400
σ247.853-318.285=-70.432
min2872.000-2843.000=29.000
max3430.000-3570.000=-140.000
mean8.551-8.585=-0.034
σ0.332-0.298=0.034
min8.329-8.347=-0.018
max9.139-9.085=0.054

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.069-1.028=0.041
σ0.172-0.146=0.026
min0.930-0.935=-0.004
max1.354-1.269=0.085

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.573-472.566=0.007
σ574.926-574.929=-0.003
min185.104-185.099=0.005
max1334.962-1334.960=0.002
mean88.250
σ8.500
min84.000
max101.000
mean2872.000-2843.000=29.000
σ0.000
min2872.000-2843.000=29.000
max2872.000-2843.000=29.000
mean0.448-0.450=-0.002
σ0.299-0.302=-0.003
min0.292-0.293=-0.001
max0.896-0.903=-0.007
policies=20
mean1851.299-1851.279=0.020
σ0.367-0.371=-0.004
min1851.031-1851.009=0.021
max1851.832-1851.819=0.014
mean840.000
σ0.000
min840.000
max840.000
mean2872.000-2843.000=29.000
σ0.000
min2872.000-2843.000=29.000
max2872.000-2843.000=29.000
mean2.946-2.970=-0.023
σ0.007-0.035=-0.028
min2.937-2.935=0.001
max2.954-3.016=-0.062
policies=200
mean18519.502-18519.369=0.133
σ0.472-0.422=0.051
min18519.210-18519.099=0.111
max18520.207-18519.998=0.209
mean8400.000
σ0.000
min8400.000
max8400.000
mean2872.000-2843.000=29.000
σ0.000
min2872.000-2843.000=29.000
max2872.000-2843.000=29.000
mean29.225-29.087=0.139
σ0.396-0.473=-0.076
min28.967-28.832=0.135
max29.816-29.795=0.021