Compare commits

Home / Compare bc983278 .. 5453aac1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.991-35.993=-0.002
σ0.102-0.102=-0.001
min35.952-35.946=0.007
max36.281-36.283=-0.002
mean3779.000-3999.000=-220.000
σ0.000
min3779.000-3999.000=-220.000
max3779.000-3999.000=-220.000
mean0.076-0.076=-0.001
σ0.002-0.001=0.001
min0.073-0.075=-0.001
max0.078-0.078=0.000
cache=y
dps=1
iters=10
policies=100
mean26.212-26.215=-0.003
σ0.004-0.002=0.002
min26.208-26.212=-0.004
max26.220-26.217=0.003
mean3779.000-3999.000=-220.000
σ0.000
min3779.000-3999.000=-220.000
max3779.000-3999.000=-220.000
mean0.060-0.060=0.000
σ0.001-0.001=0.001
min0.059-0.059=-0.000
max0.064-0.062=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.369-1756.367=0.002
σ0.373-0.374=-0.001
min1755.797-1755.791=0.006
max1756.962-1756.973=-0.012
mean1654.300-1654.250=0.050
σ621.571-624.859=-3.288
min674.000-686.000=-12.000
max2660.000-2589.000=71.000
mean2.271-2.264=0.007
σ0.139-0.122=0.017
min2.149-2.102=0.047
max2.773-2.523=0.250

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.690-278.693=-0.003
σ0.012-0.008=0.004
min278.680-278.686=-0.005
max278.712-278.706=0.005
mean2660.000-2589.000=71.000
σ0.000
min2660.000-2589.000=71.000
max2660.000-2589.000=71.000
mean0.419-0.417=0.001
σ0.001-0.001=0.000
min0.417-0.416=0.001
max0.420-0.418=0.002
iters=5
new-facts=1
prior-facts=6402
mean2268.855-2268.861=-0.006
σ0.018-0.017=0.001
min2268.834-2268.833=0.001
max2268.870-2268.877=-0.007
mean2660.000-2589.000=71.000
σ0.000
min2660.000-2589.000=71.000
max2660.000-2589.000=71.000
mean3.100-2.980=0.120
σ0.144-0.136=0.008
min2.872-2.897=-0.025
max3.251-3.219=0.032
iters=5
new-facts=6402
prior-facts=1
mean4952.031-4952.062=-0.032
σ0.866-0.976=-0.110
min4951.253-4951.133=0.119
max4953.516-4953.725=-0.209
mean2660.000-2589.000=71.000
σ0.000
min2660.000-2589.000=71.000
max2660.000-2589.000=71.000
mean7.949-7.937=0.013
σ0.445-0.320=0.125
min7.650-7.674=-0.023
max8.717-8.427=0.289
iters=5
new-facts=6402
prior-facts=6402
mean5166.851-5166.915=-0.064
σ0.168-0.013=0.155
min5166.553-5166.903=-0.351
max5166.951-5166.936=0.015
mean3349.800-3343.800=6.000
σ423.692-468.509=-44.817
min2932.000-2775.000=157.000
max3779.000-3999.000=-220.000
mean9.445-9.453=-0.008
σ0.382-0.251=0.131
min9.015-9.208=-0.193
max10.005-9.807=0.198

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.635-1.093=0.542
σ0.318-0.110=0.208
min1.256-0.956=0.299
max1.903-1.263=0.641

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.257-460.258=-0.001
σ572.605-572.607=-0.002
min173.954-173.954=-0.000
max1319.165-1319.169=-0.004
mean79.500
σ7.000
min76.000
max90.000
mean435.000-437.000=-2.000
σ0.000
min435.000-437.000=-2.000
max435.000-437.000=-2.000
mean0.560-0.562=-0.002
σ0.567-0.563=0.004
min0.273-0.274=-0.001
max1.411-1.407=0.005
policies=20
mean1740.042-1740.039=0.003
σ0.322-0.329=-0.007
min1739.802-1739.803=-0.001
max1740.513-1740.522=-0.009
mean760.000
σ0.000
min760.000
max760.000
mean445.000-447.000=-2.000
σ9.381
min435.000-437.000=-2.000
max453.000-455.000=-2.000
mean2.653-2.662=-0.009
σ0.007-0.013=-0.005
min2.641-2.650=-0.008
max2.657-2.678=-0.021
policies=200
mean17409.892-17409.808=0.085
σ0.057-0.134=-0.077
min17409.810-17409.642=0.168
max17409.940-17409.968=-0.029
mean7600.000
σ0.000
min7600.000
max7600.000
mean486.750-491.750=-5.000
σ1.708-2.754=-1.046
min485.000-489.000=-4.000
max489.000-495.000=-6.000
mean26.951-26.844=0.107
σ0.086-0.100=-0.014
min26.829-26.751=0.078
max27.024-26.951=0.073