Compare commits

Home / Compare 08a9276c .. 1fda4eec

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.001
σ0.049-0.048=0.001
min33.952-33.947=0.006
max34.116-34.111=0.005
mean418.800-415.000=3.800
σ0.632-0.000=0.632
min417.000-415.000=2.000
max419.000-415.000=4.000
mean0.084-0.082=0.002
σ0.003-0.005=-0.002
min0.081-0.077=0.004
max0.091-0.091=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.003-0.003=-0.000
min23.311-23.312=-0.002
max23.321-23.323=-0.002
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.065-0.064=0.001
σ0.002-0.003=-0.001
min0.064-0.061=0.003
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.428-1757.428=0.000
σ0.367-0.366=0.001
min1756.852-1756.855=-0.003
max1758.019-1758.018=0.000
mean1650.750-1651.050=-0.300
σ625.714-639.991=-14.277
min639.000-628.000=11.000
max2840.000-2789.000=51.000
mean2.369-2.366=0.003
σ0.073-0.127=-0.053
min2.287-2.158=0.129
max2.544-2.630=-0.087

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.569-326.575=-0.007
σ0.065-0.047=0.018
min326.454-326.492=-0.039
max326.614-326.608=0.006
mean2840.000-2789.000=51.000
σ0.000
min2840.000-2789.000=51.000
max2840.000-2789.000=51.000
mean0.429-0.423=0.006
σ0.011-0.001=0.010
min0.421-0.421=-0.000
max0.447-0.424=0.024
iters=5
new-facts=1
prior-facts=6402
mean1988.736-1988.742=-0.006
σ0.009-0.010=-0.001
min1988.726-1988.726=0.001
max1988.747-1988.752=-0.005
mean2840.000-2789.000=51.000
σ0.000
min2840.000-2789.000=51.000
max2840.000-2789.000=51.000
mean2.803-2.704=0.099
σ0.190-0.082=0.109
min2.636-2.618=0.018
max3.039-2.836=0.203
iters=5
new-facts=6402
prior-facts=1
mean4813.549-4813.525=0.025
σ7.454-7.763=-0.310
min4810.033-4809.677=0.356
max4826.878-4827.406=-0.528
mean2840.000-2789.000=51.000
σ0.000
min2840.000-2789.000=51.000
max2840.000-2789.000=51.000
mean8.431-8.253=0.178
σ0.881-0.555=0.326
min7.746-7.851=-0.104
max9.579-9.218=0.361
iters=5
new-facts=6402
prior-facts=6402
mean5001.059-5001.138=-0.079
σ0.152-0.021=0.131
min5000.788-5001.115=-0.326
max5001.151-5001.162=-0.012
mean3066.200-3028.600=37.600
σ307.189-295.535=11.654
min2840.000-2789.000=51.000
max3544.000-3473.000=71.000
mean9.496-9.747=-0.251
σ0.568-0.072=0.496
min8.498-9.622=-1.124
max9.856-9.804=0.052

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.947-1.063=-0.116
σ0.057-0.261=-0.204
min0.909-0.912=-0.003
max1.048-1.518=-0.470

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.567-464.571=-0.003
σ574.774-574.773=0.001
min177.172-177.175=-0.003
max1326.729-1326.731=-0.002
mean88.250
σ8.500
min84.000
max101.000
mean2840.000-2789.000=51.000
σ0.000
min2840.000-2789.000=51.000
max2840.000-2789.000=51.000
mean0.434-0.434=0.000
σ0.309-0.307=0.002
min0.276-0.278=-0.002
max0.898-0.895=0.003
policies=20
mean1772.055-1772.072=-0.018
σ0.365-0.372=-0.007
min1771.803-1771.824=-0.021
max1772.595-1772.625=-0.030
mean840.000
σ0.000
min840.000
max840.000
mean2840.000-2789.000=51.000
σ0.000
min2840.000-2789.000=51.000
max2840.000-2789.000=51.000
mean2.788-2.795=-0.007
σ0.004-0.065=-0.061
min2.784-2.756=0.028
max2.795-2.893=-0.098
policies=200
mean17727.665-17727.606=0.058
σ0.465-0.542=-0.077
min17727.366-17727.265=0.101
max17728.356-17728.406=-0.051
mean8400.000
σ0.000
min8400.000
max8400.000
mean2840.000-2789.000=51.000
σ0.000
min2840.000-2789.000=51.000
max2840.000-2789.000=51.000
mean27.882-27.521=0.360
σ0.403-0.198=0.204
min27.496-27.345=0.152
max28.324-27.799=0.525