Compare commits

Home / Compare 85388e9e .. 180c8827

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.728-36.728=-0.000
σ0.612-0.846=-0.234
min35.932-35.940=-0.008
max37.211-38.451=-1.239
mean3969.000-3781.000=188.000
σ0.000
min3969.000-3781.000=188.000
max3969.000-3781.000=188.000
mean0.076-0.076=-0.001
σ0.001-0.002=-0.001
min0.074-0.074=-0.001
max0.078-0.080=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.712-26.711=0.001
σ0.646-0.648=-0.002
min26.210-26.208=0.002
max27.469-27.470=-0.001
mean3969.000-3781.000=188.000
σ0.000
min3969.000-3781.000=188.000
max3969.000-3781.000=188.000
mean0.060-0.057=0.003
σ0.001-0.001=-0.000
min0.059-0.055=0.004
max0.061-0.058=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.369-1756.369=-0.000
σ0.372-0.373=-0.001
min1755.789-1755.793=-0.003
max1756.963-1756.960=0.003
mean1654.950-1636.400=18.550
σ627.316-620.978=6.338
min681.000-632.000=49.000
max2605.000-2836.000=-231.000
mean2.267-2.276=-0.010
σ0.157-0.147=0.011
min2.100-2.130=-0.029
max2.779-2.792=-0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.697-278.696=0.001
σ0.015-0.012=0.004
min278.684-278.687=-0.003
max278.721-278.716=0.005
mean2605.000-2836.000=-231.000
σ0.000
min2605.000-2836.000=-231.000
max2605.000-2836.000=-231.000
mean0.419-0.418=0.001
σ0.001-0.001=0.000
min0.417-0.416=0.001
max0.421-0.419=0.001
iters=5
new-facts=1
prior-facts=6402
mean2268.870-2268.855=0.015
σ0.006-0.019=-0.013
min2268.864-2268.829=0.035
max2268.880-2268.872=0.008
mean2605.000-2836.000=-231.000
σ0.000
min2605.000-2836.000=-231.000
max2605.000-2836.000=-231.000
mean2.965-3.108=-0.143
σ0.160-0.112=0.048
min2.866-2.916=-0.049
max3.248-3.185=0.063
iters=5
new-facts=6402
prior-facts=1
mean4952.226-4952.247=-0.021
σ0.985-0.871=0.114
min4951.390-4951.434=-0.044
max4953.932-4953.732=0.201
mean2605.000-2836.000=-231.000
σ0.000
min2605.000-2836.000=-231.000
max2605.000-2836.000=-231.000
mean8.068-7.757=0.311
σ0.350-0.239=0.110
min7.666-7.561=0.105
max8.594-8.147=0.447
iters=5
new-facts=6402
prior-facts=6402
mean5167.006-5167.069=-0.063
σ0.159-0.012=0.147
min5166.722-5167.054=-0.332
max5167.087-5167.088=-0.001
mean3397.800-3370.600=27.200
σ457.379-399.813=57.565
min2765.000-2983.000=-218.000
max3969.000-3781.000=188.000
mean9.494-9.312=0.182
σ0.202-0.472=-0.270
min9.263-8.484=0.779
max9.798-9.622=0.175

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.037-1.598=-0.561
σ0.138-0.338=-0.200
min0.944-1.210=-0.266
max1.260-1.899=-0.639

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.257-460.259=-0.002
σ572.607-572.608=-0.001
min173.953-173.951=0.001
max1319.168-1319.172=-0.003
mean79.500
σ7.000
min76.000
max90.000
mean437.000-435.000=2.000
σ0.000
min437.000-435.000=2.000
max437.000-435.000=2.000
mean0.565-0.543=0.021
σ0.578-0.540=0.038
min0.269-0.269=-0.000
max1.431-1.353=0.078
policies=20
mean1740.034-1740.050=-0.017
σ0.339-0.331=0.008
min1739.791-1739.809=-0.018
max1740.532-1740.536=-0.004
mean760.000
σ0.000
min760.000
max760.000
mean447.500-445.250=2.250
σ9.950-10.178=-0.228
min437.000-435.000=2.000
max456.000-454.000=2.000
mean2.672-2.655=0.017
σ0.019-0.004=0.014
min2.655-2.649=0.006
max2.689-2.659=0.031
policies=200
mean17409.747-17409.704=0.043
σ0.120-0.070=0.050
min17409.599-17409.629=-0.030
max17409.892-17409.797=0.095
mean7600.000
σ0.000
min7600.000
max7600.000
mean490.000-490.750=-0.750
σ1.826-3.775=-1.949
min488.000-486.000=2.000
max492.000-495.000=-3.000
mean26.934-26.856=0.078
σ0.124-0.086=0.039
min26.779-26.742=0.037
max27.077-26.947=0.130