Compare commits

Home / Compare 649983b2 .. 31daf1af

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.568=-0.005
σ0.045-0.047=-0.001
min70.539-70.534=0.005
max70.690-70.693=-0.003
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.157-0.161=-0.003
σ0.004-0.004=-0.000
min0.151-0.157=-0.006
max0.164-0.168=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.287-21.288=-0.001
σ0.003-0.002=0.001
min21.282-21.284=-0.003
max21.291-21.291=0.001
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.062-0.065=-0.003
σ0.003-0.003=0.000
min0.059-0.063=-0.004
max0.067-0.072=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.567-1753.570=-0.003
σ0.360-0.359=0.001
min1752.996-1753.003=-0.007
max1754.160-1754.150=0.010
mean1655.750-1652.400=3.350
σ638.143-645.077=-6.935
min648.000-627.000=21.000
max2846.000-2896.000=-50.000
mean2.762-2.818=-0.055
σ0.157-0.110=0.047
min2.304-2.510=-0.206
max2.926-2.987=-0.061

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.019-272.019=0.000
σ0.007-0.006=0.001
min272.015-272.011=0.004
max272.030-272.025=0.005
mean2846.000-2896.000=-50.000
σ0.000
min2846.000-2896.000=-50.000
max2846.000-2896.000=-50.000
mean0.392-0.390=0.002
σ0.006-0.012=-0.006
min0.381-0.378=0.003
max0.395-0.407=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1932.439-1932.437=0.001
σ0.005-0.022=-0.017
min1932.432-1932.413=0.019
max1932.444-1932.470=-0.027
mean2846.000-2896.000=-50.000
σ0.000
min2846.000-2896.000=-50.000
max2846.000-2896.000=-50.000
mean3.064-2.929=0.135
σ0.143-0.277=-0.134
min2.952-2.455=0.497
max3.307-3.175=0.132
iters=5
new-facts=6402
prior-facts=1
mean4753.083-4753.212=-0.129
σ0.963-0.876=0.087
min4752.317-4752.695=-0.378
max4754.757-4754.770=-0.013
mean2846.000-2896.000=-50.000
σ0.000
min2846.000-2896.000=-50.000
max2846.000-2896.000=-50.000
mean8.430-8.287=0.143
σ0.542-0.464=0.078
min7.945-7.736=0.209
max9.098-8.934=0.164
iters=5
new-facts=6402
prior-facts=6402
mean4943.627-4943.550=0.077
σ0.015-0.170=-0.155
min4943.606-4943.246=0.360
max4943.645-4943.642=0.003
mean3084.800-3063.800=21.000
σ313.063-234.536=78.527
min2846.000-2896.000=-50.000
max3569.000-3432.000=137.000
mean8.432-8.437=-0.005
σ0.126-0.082=0.044
min8.355-8.373=-0.018
max8.651-8.576=0.075

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.055-1.055=0.000
σ0.132-0.128=0.003
min0.933-0.938=-0.005
max1.256-1.250=0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.103-473.106=-0.004
σ575.915-575.923=-0.008
min185.143-185.135=0.008
max1336.975-1336.991=-0.016
mean88.250
σ8.500
min84.000
max101.000
mean2846.000-2896.000=-50.000
σ0.000
min2846.000-2896.000=-50.000
max2846.000-2896.000=-50.000
mean0.448-0.485=-0.037
σ0.304-0.371=-0.067
min0.293-0.298=-0.005
max0.904-1.041=-0.137
policies=20
mean1851.683-1851.709=-0.026
σ0.367-0.370=-0.003
min1851.401-1851.435=-0.034
max1852.213-1852.247=-0.034
mean840.000
σ0.000
min840.000
max840.000
mean2846.000-2896.000=-50.000
σ0.000
min2846.000-2896.000=-50.000
max2846.000-2896.000=-50.000
mean2.948-2.940=0.008
σ0.005-0.014=-0.009
min2.943-2.927=0.017
max2.954-2.960=-0.006
policies=200
mean18523.599-18523.651=-0.052
σ0.500-0.419=0.081
min18523.334-18523.353=-0.019
max18524.348-18524.271=0.078
mean8400.000
σ0.000
min8400.000
max8400.000
mean2846.000-2896.000=-50.000
σ0.000
min2846.000-2896.000=-50.000
max2846.000-2896.000=-50.000
mean29.149-29.240=-0.091
σ0.452-0.506=-0.054
min28.687-28.750=-0.062
max29.654-29.684=-0.029