Compare commits

Home / Compare 397b88d6 .. f531ad82

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.779-70.732=0.047
σ0.053-0.050=0.003
min70.750-70.701=0.049
max70.926-70.872=0.054
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.162-0.167=-0.005
σ0.004-0.011=-0.007
min0.159-0.154=0.004
max0.168-0.184=-0.016
cache=y
dps=1
iters=10
policies=100
mean21.493-21.445=0.048
σ0.004-0.003=0.000
min21.488-21.440=0.048
max21.497-21.448=0.049
mean412.000-414.700=-2.700
σ0.000-0.483=-0.483
min412.000-414.000=-2.000
max412.000-415.000=-3.000
mean0.065-0.065=0.000
σ0.003-0.003=-0.000
min0.063-0.063=0.000
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.880-1754.528=-2.647
σ0.361-0.360=0.001
min1751.305-1753.960=-2.655
max1752.452-1755.126=-2.674
mean1650.100-1654.000=-3.900
σ638.231-632.102=6.129
min625.000-640.000=-15.000
max2854.000-2846.000=8.000
mean2.813-2.837=-0.023
σ0.179-0.193=-0.014
min2.319-2.301=0.018
max2.980-3.220=-0.240

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.376-273.610=-4.234
σ0.008-0.009=-0.001
min269.366-273.603=-4.237
max269.388-273.622=-4.234
mean2854.000-2846.000=8.000
σ0.000
min2854.000-2846.000=8.000
max2854.000-2846.000=8.000
mean0.376-0.389=-0.013
σ0.005-0.010=-0.005
min0.372-0.380=-0.008
max0.385-0.405=-0.020
iters=5
new-facts=1
prior-facts=6402
mean1929.744-1933.996=-4.252
σ0.019-0.008=0.011
min1929.715-1933.986=-4.271
max1929.762-1934.006=-4.244
mean2854.000-2846.000=8.000
σ0.000
min2854.000-2846.000=8.000
max2854.000-2846.000=8.000
mean3.123-3.007=0.116
σ0.145-0.043=0.102
min3.009-2.964=0.045
max3.363-3.076=0.287
iters=5
new-facts=6402
prior-facts=1
mean4750.386-4754.840=-4.455
σ0.960-0.814=0.145
min4749.526-4754.375=-4.849
max4752.026-4756.292=-4.266
mean2854.000-2846.000=8.000
σ0.000
min2854.000-2846.000=8.000
max2854.000-2846.000=8.000
mean8.731-8.135=0.597
σ0.533-0.322=0.211
min8.098-7.819=0.279
max9.540-8.653=0.887
iters=5
new-facts=6402
prior-facts=6402
mean4940.980-4945.221=-4.241
σ0.020-0.012=0.008
min4940.955-4945.205=-4.250
max4941.001-4945.237=-4.236
mean3075.000-3076.000=-1.000
σ297.157-303.815=-6.658
min2854.000-2846.000=8.000
max3534.000-3543.000=-9.000
mean8.409-8.470=-0.061
σ0.113-0.116=-0.003
min8.335-8.337=-0.002
max8.608-8.646=-0.038

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.022-1.052=-0.029
σ0.138-0.124=0.014
min0.928-0.935=-0.007
max1.246-1.241=0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.064-472.844=-6.780
σ574.923-574.926=-0.003
min178.595-185.375=-6.781
max1328.449-1335.233=-6.784
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2854.000-2846.000=8.000
σ0.000
min2854.000-2846.000=8.000
max2854.000-2846.000=8.000
mean0.477-0.452=0.025
σ0.376-0.305=0.071
min0.279-0.297=-0.019
max1.040-0.909=0.131
policies=20
mean1786.173-1854.005=-67.832
σ0.367-0.378=-0.011
min1785.909-1853.718=-67.809
max1786.713-1854.551=-67.838
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2854.000-2846.000=8.000
σ0.000
min2854.000-2846.000=8.000
max2854.000-2846.000=8.000
mean2.856-2.962=-0.107
σ0.012-0.018=-0.007
min2.845-2.944=-0.098
max2.872-2.983=-0.110
policies=200
mean17868.556-18546.497=-677.941
σ0.548-0.370=0.179
min17868.197-18546.205=-678.008
max17869.368-18547.037=-677.669
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2854.000-2846.000=8.000
σ0.000
min2854.000-2846.000=8.000
max2854.000-2846.000=8.000
mean28.428-29.254=-0.826
σ0.471-0.522=-0.051
min27.879-28.770=-0.891
max28.843-29.841=-0.998