Compare commits

Home / Compare 135f5f6f .. 04fd69b6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.708-36.727=-0.019
σ0.614-1.329=-0.714
min35.904-35.920=-0.016
max37.185-39.691=-2.505
mean423.800-3747.000=-3323.200
σ0.422-0.000=0.422
min423.000-3747.000=-3324.000
max424.000-3747.000=-3323.000
mean0.074-0.073=0.001
σ0.005-0.003=0.002
min0.070-0.070=0.000
max0.085-0.078=0.007
cache=y
dps=1
iters=10
policies=100
mean26.699-26.586=0.113
σ0.647-0.605=0.042
min26.192-26.206=-0.013
max27.455-27.464=-0.009
mean424.000-3747.000=-3323.000
σ0.000
min424.000-3747.000=-3323.000
max424.000-3747.000=-3323.000
mean0.061-0.060=0.000
σ0.002-0.000=0.002
min0.059-0.060=-0.000
max0.067-0.061=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.286-1756.356=-0.071
σ0.369-0.373=-0.005
min1755.712-1755.778=-0.066
max1756.879-1756.945=-0.066
mean1688.450-1661.300=27.150
σ638.325-628.600=9.725
min689.000-616.000=73.000
max2705.000-2676.000=29.000
mean2.337-2.278=0.058
σ0.056-0.160=-0.104
min2.263-2.151=0.112
max2.437-2.772=-0.335

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.791-278.677=0.115
σ0.005-0.008=-0.003
min278.787-278.667=0.120
max278.799-278.688=0.111
mean2705.000-2676.000=29.000
σ0.000
min2705.000-2676.000=29.000
max2705.000-2676.000=29.000
mean0.408-0.419=-0.011
σ0.005-0.006=-0.001
min0.404-0.416=-0.011
max0.417-0.429=-0.012
iters=5
new-facts=1
prior-facts=6402
mean2268.857-2268.842=0.015
σ0.008-0.010=-0.002
min2268.848-2268.826=0.022
max2268.867-2268.851=0.016
mean2705.000-2676.000=29.000
σ0.000
min2705.000-2676.000=29.000
max2705.000-2676.000=29.000
mean3.053-3.229=-0.177
σ0.154-0.294=-0.140
min2.901-2.867=0.034
max3.234-3.689=-0.455
iters=5
new-facts=6402
prior-facts=1
mean4954.248-4952.111=2.138
σ0.915-0.238=0.677
min4953.632-4951.967=1.665
max4955.864-4952.529=3.335
mean2705.000-2676.000=29.000
σ0.000
min2705.000-2676.000=29.000
max2705.000-2676.000=29.000
mean8.013-7.766=0.248
σ0.411-0.163=0.248
min7.730-7.624=0.106
max8.728-7.978=0.751
iters=5
new-facts=6402
prior-facts=6402
mean5168.795-5166.985=1.810
σ0.096-0.164=-0.067
min5168.689-5166.696=1.994
max5168.894-5167.098=1.796
mean3324.800-3335.400=-10.600
σ400.169-416.644=-16.475
min2930.000-2914.000=16.000
max3730.000-3747.000=-17.000
mean9.168-9.324=-0.156
σ0.611-0.629=-0.017
min8.584-8.968=-0.384
max10.039-10.432=-0.393

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.116-1.731=-0.615
σ0.192-0.069=0.123
min0.928-1.632=-0.704
max1.349-1.803=-0.454

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.801-460.255=-0.454
σ571.587-572.608=-1.020
min173.995-173.949=0.047
max1317.182-1319.166=-1.985
mean79.500
σ7.000
min76.000
max90.000
mean2705.000-437.000=2268.000
σ0.000
min2705.000-437.000=2268.000
max2705.000-437.000=2268.000
mean0.548-0.565=-0.017
σ0.558-0.578=-0.020
min0.268-0.270=-0.002
max1.385-1.432=-0.047
policies=20
mean1740.268-1740.005=0.263
σ0.311-0.336=-0.025
min1740.049-1739.764=0.285
max1740.729-1740.498=0.231
mean760.000
σ0.000
min760.000
max760.000
mean2705.000-447.500=2257.500
σ0.000-9.950=-9.950
min2705.000-437.000=2268.000
max2705.000-456.000=2249.000
mean2.682-2.666=0.016
σ0.011-0.021=-0.010
min2.667-2.637=0.031
max2.695-2.685=0.011
policies=200
mean17409.503-17409.292=0.211
σ0.454-0.077=0.377
min17409.121-17409.208=-0.087
max17410.162-17409.392=0.770
mean7600.000
σ0.000
min7600.000
max7600.000
mean2705.000-492.750=2212.250
σ0.000-4.272=-4.272
min2705.000-487.000=2218.000
max2705.000-496.000=2209.000
mean26.944-26.824=0.120
σ0.161-0.092=0.070
min26.726-26.724=0.002
max27.111-26.926=0.185