Compare commits

Home / Compare ade5e238 .. 37172689

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.040=0.000
σ0.049-0.049=-0.000
min31.003-31.007=-0.004
max31.177-31.177=-0.001
mean416.000-411.500=4.500
σ0.000-0.527=-0.527
min416.000-411.000=5.000
max416.000-412.000=4.000
mean0.080-0.079=0.001
σ0.004-0.003=0.001
min0.077-0.076=0.002
max0.087-0.084=0.003
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.000
σ0.003-0.002=0.001
min21.138-21.140=-0.002
max21.147-21.147=0.000
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.061-0.064=-0.003
σ0.003-0.003=0.000
min0.058-0.063=-0.005
max0.064-0.071=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.414-1751.413=0.001
σ0.360-0.360=0.000
min1750.848-1750.845=0.004
max1751.999-1752.009=-0.009
mean1656.450-1654.550=1.900
σ614.652-645.930=-31.278
min639.000-626.000=13.000
max2491.000-2857.000=-366.000
mean2.852-2.782=0.070
σ0.147-0.217=-0.070
min2.457-2.184=0.273
max3.026-2.975=0.051

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.788-266.787=0.001
σ0.007-0.010=-0.003
min266.779-266.779=0.001
max266.798-266.803=-0.005
mean2491.000-2857.000=-366.000
σ0.000
min2491.000-2857.000=-366.000
max2491.000-2857.000=-366.000
mean0.374-0.378=-0.004
σ0.003-0.010=-0.007
min0.372-0.370=0.002
max0.379-0.393=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1927.213-1927.215=-0.002
σ0.012-0.009=0.003
min1927.198-1927.201=-0.003
max1927.231-1927.224=0.007
mean2491.000-2857.000=-366.000
σ0.000
min2491.000-2857.000=-366.000
max2491.000-2857.000=-366.000
mean3.058-2.944=0.114
σ0.115-0.166=-0.050
min2.970-2.667=0.303
max3.257-3.072=0.184
iters=5
new-facts=6402
prior-facts=1
mean4747.728-4747.671=0.058
σ0.796-0.862=-0.066
min4747.356-4747.225=0.131
max4749.153-4749.212=-0.059
mean2491.000-2857.000=-366.000
σ0.000
min2491.000-2857.000=-366.000
max2491.000-2857.000=-366.000
mean8.222-8.731=-0.509
σ0.604-0.563=0.041
min7.691-7.782=-0.091
max8.925-9.118=-0.193
iters=5
new-facts=6402
prior-facts=6402
mean4938.164-4938.168=-0.003
σ0.078-0.091=-0.012
min4938.105-4938.087=0.018
max4938.252-4938.271=-0.019
mean2968.000-3053.400=-85.400
σ438.647-207.525=231.122
min2491.000-2857.000=-366.000
max3559.000-3355.000=204.000
mean8.530-8.568=-0.038
σ0.219-0.245=-0.027
min8.358-8.361=-0.003
max8.887-8.964=-0.077

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.733-1.023=0.710
σ0.142-0.139=0.004
min1.505-0.932=0.573
max1.843-1.251=0.592

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.116-465.121=-0.005
σ575.756-575.752=0.004
min177.236-177.240=-0.004
max1328.751-1328.750=0.001
mean79.750
σ7.500
min76.000
max91.000
mean2491.000-2857.000=-366.000
σ0.000
min2491.000-2857.000=-366.000
max2491.000-2857.000=-366.000
mean0.562-0.440=0.122
σ0.566-0.304=0.262
min0.277-0.283=-0.006
max1.410-0.895=0.515
policies=20
mean1772.607-1772.631=-0.024
σ0.332-0.338=-0.007
min1772.380-1772.390=-0.010
max1773.098-1773.126=-0.028
mean760.000
σ0.000
min760.000
max760.000
mean2491.000-2857.000=-366.000
σ0.000
min2491.000-2857.000=-366.000
max2491.000-2857.000=-366.000
mean2.740-2.847=-0.107
σ0.017-0.022=-0.005
min2.722-2.828=-0.106
max2.755-2.879=-0.123
policies=200
mean17732.592-17732.537=0.056
σ0.611-0.496=0.115
min17732.221-17732.162=0.058
max17733.504-17733.266=0.238
mean7600.000
σ0.000
min7600.000
max7600.000
mean2491.000-2857.000=-366.000
σ0.000
min2491.000-2857.000=-366.000
max2491.000-2857.000=-366.000
mean27.718-28.229=-0.511
σ0.134-0.455=-0.321
min27.587-27.837=-0.250
max27.896-28.711=-0.815