Compare commits

Home / Compare d6743edf .. c0c9eb70

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.773-30.773=0.000
σ0.046-0.048=-0.002
min30.747-30.744=0.003
max30.902-30.907=-0.005
mean415.000-410.000=5.000
σ0.000
min415.000-410.000=5.000
max415.000-410.000=5.000
mean0.078-0.079=-0.001
σ0.004-0.003=0.001
min0.072-0.076=-0.004
max0.086-0.084=0.002
cache=y
dps=1
iters=10
policies=100
mean21.058-21.059=-0.001
σ0.003-0.003=-0.000
min21.054-21.056=-0.002
max21.063-21.064=-0.000
mean415.000-410.000=5.000
σ0.000
min415.000-410.000=5.000
max415.000-410.000=5.000
mean0.063-0.064=-0.001
σ0.004-0.002=0.001
min0.057-0.062=-0.005
max0.068-0.070=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.236-1751.236=-0.000
σ0.363-0.364=-0.001
min1750.670-1750.671=-0.001
max1751.809-1751.826=-0.017
mean1654.950-1650.400=4.550
σ643.544-650.332=-6.788
min633.000-616.000=17.000
max2849.000-2754.000=95.000
mean2.840-2.862=-0.022
σ0.144-0.086=0.058
min2.411-2.690=-0.279
max3.004-3.039=-0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.569-275.568=0.001
σ0.007-0.004=0.002
min275.562-275.563=-0.001
max275.577-275.575=0.002
mean2849.000-2754.000=95.000
σ0.000
min2849.000-2754.000=95.000
max2849.000-2754.000=95.000
mean0.391-0.393=-0.002
σ0.009-0.010=-0.001
min0.385-0.384=0.001
max0.405-0.405=-0.000
iters=5
new-facts=1
prior-facts=6402
mean2168.092-2168.099=-0.007
σ0.013-0.010=0.003
min2168.070-2168.088=-0.018
max2168.104-2168.115=-0.010
mean2849.000-2754.000=95.000
σ0.000
min2849.000-2754.000=95.000
max2849.000-2754.000=95.000
mean2.929-2.967=-0.038
σ0.123-0.145=-0.022
min2.775-2.775=0.000
max3.093-3.096=-0.004
iters=5
new-facts=6402
prior-facts=1
mean5047.801-5047.945=-0.145
σ0.999-0.878=0.122
min5047.033-5047.442=-0.410
max5049.550-5049.508=0.043
mean2849.000-2754.000=95.000
σ0.000
min2849.000-2754.000=95.000
max2849.000-2754.000=95.000
mean8.794-9.169=-0.376
σ0.593-0.619=-0.026
min8.018-8.436=-0.418
max9.402-10.059=-0.657
iters=5
new-facts=6402
prior-facts=6402
mean5179.044-5179.055=-0.011
σ0.082-0.094=-0.012
min5178.966-5178.973=-0.007
max5179.141-5179.159=-0.018
mean3253.400-3234.800=18.600
σ337.299-366.324=-29.025
min2849.000-2754.000=95.000
max3711.000-3708.000=3.000
mean9.952-10.037=-0.085
σ0.161-0.078=0.084
min9.687-9.969=-0.282
max10.110-10.150=-0.040

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.009-1.064=-0.055
σ0.139-0.125=0.015
min0.945-0.953=-0.009
max1.258-1.259=-0.000

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.207-463.207=-0.001
σ572.650-572.659=-0.009
min176.875-176.872=0.003
max1322.182-1322.196=-0.014
mean77.500
σ7.000
min74.000
max88.000
mean2849.000-2754.000=95.000
σ0.000
min2849.000-2754.000=95.000
max2849.000-2754.000=95.000
mean0.438-0.539=-0.101
σ0.305-0.524=-0.219
min0.284-0.270=0.014
max0.895-1.325=-0.429
policies=20
mean1769.003-1768.963=0.040
σ0.338-0.332=0.007
min1768.785-1768.750=0.034
max1769.506-1769.458=0.049
mean740.000
σ0.000
min740.000
max740.000
mean2849.000-2754.000=95.000
σ0.000
min2849.000-2754.000=95.000
max2849.000-2754.000=95.000
mean2.817-2.739=0.079
σ0.007-0.025=-0.018
min2.808-2.704=0.104
max2.824-2.766=0.059
policies=200
mean17696.139-17696.102=0.038
σ0.475-0.601=-0.126
min17695.756-17695.778=-0.021
max17696.822-17697.002=-0.180
mean7400.000
σ0.000
min7400.000
max7400.000
mean2849.000-2754.000=95.000
σ0.000
min2849.000-2754.000=95.000
max2849.000-2754.000=95.000
mean28.017-27.704=0.314
σ0.477-0.144=0.332
min27.541-27.596=-0.055
max28.566-27.917=0.649