Compare commits

Home / Compare 04e26a65 .. b659da2b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean55.029-55.029=-0.001
σ0.052-0.052=-0.001
min54.989-54.993=-0.004
max55.169-55.173=-0.004
mean415.600-416.800=-1.200
σ0.843-0.422=0.422
min414.000-416.000=-2.000
max416.000-417.000=-1.000
mean0.139-0.138=0.001
σ0.004-0.004=-0.001
min0.136-0.132=0.003
max0.146-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean44.363-44.363=0.000
σ0.004-0.003=0.000
min44.359-44.356=0.003
max44.372-44.366=0.006
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.121-0.120=0.001
σ0.003-0.004=-0.002
min0.119-0.110=0.009
max0.127-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1767.295-1767.297=-0.002
σ0.364-0.365=-0.002
min1766.717-1766.719=-0.002
max1767.885-1767.885=0.000
mean1649.050-1648.750=0.300
σ629.235-619.673=9.562
min671.000-651.000=20.000
max2729.000-2498.000=231.000
mean2.409-2.371=0.038
σ0.178-0.086=0.092
min2.264-2.278=-0.014
max3.091-2.656=0.436

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean350.829-350.826=0.003
σ0.070-0.071=-0.001
min350.705-350.702=0.003
max350.872-350.876=-0.005
mean2729.000-2498.000=231.000
σ0.000
min2729.000-2498.000=231.000
max2729.000-2498.000=231.000
mean0.458-0.451=0.007
σ0.006-0.001=0.005
min0.452-0.449=0.003
max0.464-0.453=0.012
iters=5
new-facts=1
prior-facts=6402
mean2012.904-2012.902=0.002
σ0.009-0.014=-0.005
min2012.891-2012.885=0.006
max2012.914-2012.922=-0.008
mean2729.000-2498.000=231.000
σ0.000
min2729.000-2498.000=231.000
max2729.000-2498.000=231.000
mean2.713-2.711=0.002
σ0.071-0.039=0.032
min2.606-2.666=-0.061
max2.792-2.763=0.029
iters=5
new-facts=6402
prior-facts=1
mean4837.661-4837.895=-0.234
σ7.867-7.720=0.147
min4833.834-4834.324=-0.490
max4851.725-4851.704=0.021
mean2729.000-2498.000=231.000
σ0.000
min2729.000-2498.000=231.000
max2729.000-2498.000=231.000
mean8.355-8.303=0.052
σ0.446-0.441=0.005
min7.958-8.017=-0.059
max9.089-9.075=0.014
iters=5
new-facts=6402
prior-facts=6402
mean5025.397-5025.392=0.005
σ0.015-0.019=-0.004
min5025.372-5025.372=-0.000
max5025.410-5025.419=-0.009
mean3031.800-2906.000=125.800
σ357.028-379.189=-22.162
min2729.000-2498.000=231.000
max3557.000-3425.000=132.000
mean9.737-9.430=0.307
σ0.352-0.577=-0.224
min9.143-8.575=0.569
max10.076-9.982=0.093

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.027-1.556=-0.529
σ0.126-0.371=-0.245
min0.915-0.939=-0.024
max1.221-1.796=-0.575

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean469.209-469.204=0.005
σ574.769-574.770=-0.002
min181.816-181.813=0.003
max1331.362-1331.359=0.003
mean90.250
σ8.500
min86.000
max103.000
mean2729.000-2498.000=231.000
σ0.000
min2729.000-2498.000=231.000
max2729.000-2498.000=231.000
mean0.555-0.564=-0.009
σ0.529-0.545=-0.017
min0.287-0.288=-0.001
max1.348-1.382=-0.034
policies=20
mean1818.486-1818.491=-0.005
σ0.388-0.381=0.007
min1818.226-1818.239=-0.012
max1819.061-1819.056=0.005
mean860.000
σ0.000
min860.000
max860.000
mean2729.000-2498.000=231.000
σ0.000
min2729.000-2498.000=231.000
max2729.000-2498.000=231.000
mean2.792-2.795=-0.003
σ0.011-0.016=-0.005
min2.781-2.784=-0.003
max2.805-2.818=-0.013
policies=200
mean18192.305-18192.273=0.032
σ0.609-0.437=0.173
min18191.910-18191.911=-0.001
max18193.210-18192.907=0.303
mean8600.000
σ0.000
min8600.000
max8600.000
mean2729.000-2498.000=231.000
σ0.000
min2729.000-2498.000=231.000
max2729.000-2498.000=231.000
mean28.153-28.177=-0.025
σ0.082-0.067=0.015
min28.097-28.096=0.001
max28.274-28.234=0.041