Compare commits

Home / Compare 4433928d .. 388a685a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.727-36.724=0.003
σ0.612-0.880=-0.269
min35.932-35.932=-0.000
max37.214-38.349=-1.134
mean3941.000-3751.000=190.000
σ0.000
min3941.000-3751.000=190.000
max3941.000-3751.000=190.000
mean0.075-0.077=-0.002
σ0.002-0.002=-0.000
min0.074-0.075=-0.002
max0.080-0.082=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.712-26.587=0.125
σ0.645-0.603=0.041
min26.209-26.209=0.001
max27.467-27.464=0.003
mean3941.000-3751.000=190.000
σ0.000
min3941.000-3751.000=190.000
max3941.000-3751.000=190.000
mean0.060-0.061=-0.001
σ0.000-0.000=-0.000
min0.059-0.060=-0.001
max0.061-0.062=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.368-1756.368=0.000
σ0.372-0.371=0.001
min1755.797-1755.797=0.000
max1756.971-1756.964=0.007
mean1659.850-1659.150=0.700
σ627.447-626.723=0.723
min612.000-619.000=-7.000
max2632.000-2637.000=-5.000
mean2.333-2.297=0.036
σ0.216-0.171=0.045
min2.156-2.122=0.033
max2.810-2.779=0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.697-278.696=0.001
σ0.014-0.012=0.002
min278.683-278.686=-0.003
max278.719-278.715=0.005
mean2632.000-2637.000=-5.000
σ0.000
min2632.000-2637.000=-5.000
max2632.000-2637.000=-5.000
mean0.421-0.427=-0.006
σ0.002-0.013=-0.011
min0.419-0.416=0.003
max0.424-0.442=-0.017
iters=5
new-facts=1
prior-facts=6402
mean2268.871-2268.868=0.002
σ0.010-0.014=-0.005
min2268.856-2268.844=0.011
max2268.879-2268.880=-0.001
mean2632.000-2637.000=-5.000
σ0.000
min2632.000-2637.000=-5.000
max2632.000-2637.000=-5.000
mean3.027-3.126=-0.099
σ0.194-0.072=0.123
min2.878-3.024=-0.146
max3.368-3.215=0.153
iters=5
new-facts=6402
prior-facts=1
mean4952.251-4952.263=-0.012
σ0.875-0.907=-0.032
min4951.425-4951.425=-0.000
max4953.743-4953.817=-0.074
mean2632.000-2637.000=-5.000
σ0.000
min2632.000-2637.000=-5.000
max2632.000-2637.000=-5.000
mean7.962-7.849=0.113
σ0.103-0.132=-0.028
min7.809-7.713=0.096
max8.079-8.038=0.041
iters=5
new-facts=6402
prior-facts=6402
mean5166.871-5167.075=-0.204
σ0.314-0.007=0.307
min5166.373-5167.063=-0.691
max5167.085-5167.083=0.002
mean3347.800-3303.000=44.800
σ451.569-487.702=-36.133
min2734.000-2637.000=97.000
max3941.000-3751.000=190.000
mean9.705-9.193=0.512
σ0.527-0.153=0.374
min9.107-9.047=0.060
max10.329-9.409=0.919

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.055-1.501=-0.447
σ0.124-0.330=-0.206
min0.943-1.070=-0.126
max1.246-1.830=-0.584

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.256-460.258=-0.002
σ572.607-572.607=-0.000
min173.951-173.952=-0.002
max1319.166-1319.168=-0.002
mean79.500
σ7.000
min76.000
max90.000
mean438.000-437.000=1.000
σ0.000
min438.000-437.000=1.000
max438.000-437.000=1.000
mean0.572-0.555=0.016
σ0.591-0.570=0.021
min0.269-0.265=0.004
max1.458-1.410=0.048
policies=20
mean1740.024-1740.047=-0.023
σ0.341-0.329=0.012
min1739.777-1739.809=-0.032
max1740.523-1740.530=-0.007
mean760.000
σ0.000
min760.000
max760.000
mean447.750-447.500=0.250
σ9.605-9.950=-0.345
min438.000-437.000=1.000
max456.000
mean2.674-2.669=0.005
σ0.016-0.027=-0.011
min2.660-2.645=0.015
max2.689-2.701=-0.012
policies=200
mean17409.711-17409.686=0.026
σ0.145-0.034=0.111
min17409.540-17409.651=-0.111
max17409.853-17409.728=0.125
mean7600.000
σ0.000
min7600.000
max7600.000
mean491.500-492.250=-0.750
σ1.915-1.258=0.657
min490.000-491.000=-1.000
max494.000
mean26.929-26.940=-0.010
σ0.084-0.126=-0.042
min26.812-26.829=-0.017
max26.995-27.101=-0.105