Compare commits

Home / Compare 0f1d0f87 .. 9b5ddcc5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.993-35.991=0.002
σ0.103-0.103=0.000
min35.948-35.950=-0.002
max36.286-36.283=0.002
mean3952.000-3941.000=11.000
σ0.000
min3952.000-3941.000=11.000
max3952.000-3941.000=11.000
mean0.075-0.072=0.003
σ0.001-0.003=-0.002
min0.074-0.070=0.005
max0.076-0.076=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.218-26.215=0.003
σ0.008-0.002=0.005
min26.211-26.213=-0.002
max26.238-26.219=0.019
mean3952.000-3941.000=11.000
σ0.000
min3952.000-3941.000=11.000
max3952.000-3941.000=11.000
mean0.082-0.060=0.022
σ0.070-0.001=0.070
min0.059-0.059=0.000
max0.283-0.061=0.221

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.368-1756.368=-0.000
σ0.372-0.374=-0.002
min1755.802-1755.789=0.013
max1756.971-1756.966=0.005
mean1659.150-1661.150=-2.000
σ628.014-636.016=-8.002
min618.000-621.000=-3.000
max2642.000-2691.000=-49.000
mean2.289-2.283=0.005
σ0.174-0.130=0.044
min2.152-2.134=0.018
max2.766-2.591=0.175

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.697-278.700=-0.004
σ0.012-0.008=0.005
min278.687-278.690=-0.003
max278.718-278.709=0.008
mean2642.000-2691.000=-49.000
σ0.000
min2642.000-2691.000=-49.000
max2642.000-2691.000=-49.000
mean0.419-0.420=-0.001
σ0.001-0.001=-0.000
min0.418-0.418=-0.000
max0.421-0.422=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2268.876-2268.875=0.001
σ0.006-0.003=0.003
min2268.870-2268.872=-0.002
max2268.883-2268.880=0.004
mean2642.000-2691.000=-49.000
σ0.000
min2642.000-2691.000=-49.000
max2642.000-2691.000=-49.000
mean2.942-2.979=-0.037
σ0.146-0.174=-0.027
min2.818-2.819=-0.001
max3.191-3.276=-0.086
iters=5
new-facts=6402
prior-facts=1
mean4952.180-4952.084=0.096
σ0.802-0.615=0.186
min4951.602-4951.695=-0.093
max4953.594-4953.177=0.416
mean2642.000-2691.000=-49.000
σ0.000
min2642.000-2691.000=-49.000
max2642.000-2691.000=-49.000
mean8.052-8.051=0.001
σ0.577-0.397=0.180
min7.710-7.761=-0.051
max9.072-8.690=0.382
iters=5
new-facts=6402
prior-facts=6402
mean5166.712-5166.781=-0.069
σ0.308-0.294=0.014
min5166.220-5166.256=-0.036
max5166.925-5166.921=0.005
mean3382.800-3396.600=-13.800
σ447.693-446.700=0.993
min2778.000-2769.000=9.000
max3952.000-3941.000=11.000
mean9.254-9.788=-0.534
σ0.419-0.289=0.130
min8.957-9.449=-0.492
max9.989-10.221=-0.232

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.080-1.117=-0.037
σ0.164-0.084=0.080
min0.944-1.061=-0.118
max1.349-1.266=0.083

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.261-460.261=0.000
σ572.608-572.605=0.003
min173.954-173.958=-0.004
max1319.173-1319.168=0.005
mean79.500
σ7.000
min76.000
max90.000
mean437.000
σ0.000
min437.000
max437.000
mean0.554-0.559=-0.005
σ0.559-0.562=-0.004
min0.273-0.274=-0.000
max1.392-1.402=-0.010
policies=20
mean1740.077-1740.080=-0.002
σ0.328-0.340=-0.012
min1739.838-1739.835=0.003
max1740.558-1740.580=-0.022
mean760.000
σ0.000
min760.000
max760.000
mean446.250-447.750=-1.500
σ9.032-9.743=-0.710
min437.000
max454.000-456.000=-2.000
mean2.658-2.680=-0.022
σ0.014-0.014=0.001
min2.644-2.666=-0.022
max2.673-2.698=-0.024
policies=200
mean17410.053-17409.986=0.067
σ0.047-0.100=-0.053
min17410.010-17409.870=0.139
max17410.120-17410.108=0.012
mean7600.000
σ0.000
min7600.000
max7600.000
mean490.000-492.250=-2.250
σ2.828-3.500=-0.672
min486.000-488.000=-2.000
max492.000-496.000=-4.000
mean26.932-26.957=-0.025
σ0.119-0.081=0.037
min26.809-26.876=-0.067
max27.092-27.061=0.032