Compare commits

Home / Compare 07e2b9b8 .. 4d91f174

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.728-36.727=0.001
σ1.040-0.848=0.192
min35.926-35.924=0.002
max38.465-38.435=0.030
mean3981.000-3979.000=2.000
σ0.000
min3981.000-3979.000=2.000
max3981.000-3979.000=2.000
mean0.075-0.076=-0.001
σ0.001-0.002=-0.001
min0.074-0.074=-0.000
max0.076-0.081=-0.005
cache=y
dps=1
iters=10
policies=100
mean26.712-26.580=0.132
σ0.648-0.606=0.042
min26.205-26.187=0.018
max27.468-27.463=0.005
mean3981.000-3979.000=2.000
σ0.000
min3981.000-3979.000=2.000
max3981.000-3979.000=2.000
mean0.061-0.060=0.000
σ0.001-0.002=-0.001
min0.060-0.056=0.003
max0.061-0.062=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.367-1756.367=-0.000
σ0.372-0.371=0.001
min1755.790-1755.798=-0.008
max1756.962-1756.953=0.009
mean1660.800-1666.700=-5.900
σ627.910-646.226=-18.316
min618.000-629.000=-11.000
max2636.000-2857.000=-221.000
mean2.310-2.260=0.049
σ0.227-0.152=0.075
min2.157-2.094=0.063
max3.062-2.835=0.226

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.701-278.695=0.006
σ0.010-0.014=-0.004
min278.690-278.682=0.007
max278.716-278.719=-0.003
mean2636.000-2857.000=-221.000
σ0.000
min2636.000-2857.000=-221.000
max2636.000-2857.000=-221.000
mean0.418-0.417=0.001
σ0.001-0.001=-0.000
min0.417-0.415=0.002
max0.420-0.418=0.001
iters=5
new-facts=1
prior-facts=6402
mean2268.867-2268.872=-0.006
σ0.005-0.005=-0.000
min2268.860-2268.867=-0.007
max2268.873-2268.880=-0.006
mean2636.000-2857.000=-221.000
σ0.000
min2636.000-2857.000=-221.000
max2636.000-2857.000=-221.000
mean2.928-2.931=-0.003
σ0.056-0.064=-0.008
min2.865-2.849=0.015
max3.007-3.022=-0.015
iters=5
new-facts=6402
prior-facts=1
mean4952.226-4952.375=-0.149
σ0.867-0.747=0.120
min4951.499-4951.994=-0.494
max4953.731-4953.708=0.023
mean2636.000-2857.000=-221.000
σ0.000
min2636.000-2857.000=-221.000
max2636.000-2857.000=-221.000
mean8.002-7.661=0.341
σ0.278-0.129=0.150
min7.714-7.545=0.169
max8.404-7.865=0.538
iters=5
new-facts=6402
prior-facts=6402
mean5167.075-5167.072=0.003
σ0.009-0.010=-0.001
min5167.067-5167.063=0.004
max5167.089-5167.084=0.005
mean3418.000-3404.600=13.400
σ451.231-434.963=16.268
min2806.000-2857.000=-51.000
max3981.000-3979.000=2.000
mean9.146-9.328=-0.182
σ0.120-0.243=-0.123
min8.992-8.958=0.034
max9.265-9.624=-0.359

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.070-1.080=-0.011
σ0.271-0.114=0.157
min0.945-0.936=0.009
max1.555-1.255=0.300

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.258-460.259=-0.001
σ572.606-572.607=-0.001
min173.954
max1319.167-1319.170=-0.003
mean79.500
σ7.000
min76.000
max90.000
mean436.000-438.000=-2.000
σ0.000
min436.000-438.000=-2.000
max436.000-438.000=-2.000
mean0.553-0.540=0.012
σ0.558-0.537=0.021
min0.271-0.270=0.001
max1.390-1.346=0.043
policies=20
mean1740.034-1740.053=-0.019
σ0.326-0.336=-0.010
min1739.801-1739.812=-0.011
max1740.513-1740.546=-0.033
mean760.000
σ0.000
min760.000
max760.000
mean446.500-447.750=-1.250
σ9.950-9.605=0.345
min436.000-438.000=-2.000
max455.000-456.000=-1.000
mean2.659-2.657=0.002
σ0.014-0.012=0.002
min2.645-2.642=0.003
max2.677-2.671=0.006
policies=200
mean17409.856-17409.954=-0.097
σ0.146-0.057=0.089
min17409.688-17409.890=-0.202
max17410.000-17410.027=-0.027
mean7600.000
σ0.000
min7600.000
max7600.000
mean491.250-492.000=-0.750
σ2.062-2.449=-0.388
min489.000-490.000=-1.000
max494.000-495.000=-1.000
mean26.977-26.807=0.170
σ0.130-0.126=0.004
min26.819-26.650=0.169
max27.117-26.915=0.202