Compare commits

Home / Compare e3a3a7ad .. b7913ed9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.264=-0.001
σ0.055-0.054=0.001
min35.230-35.234=-0.004
max35.416-35.416=0.000
mean412.200-414.000=-1.800
σ0.632-0.000=0.632
min412.000-414.000=-2.000
max414.000
mean0.083-0.085=-0.002
σ0.005-0.003=0.001
min0.076-0.082=-0.006
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.000
σ0.002-0.003=-0.001
min23.766-23.766=0.000
max23.772-23.774=-0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.067-0.068=-0.001
σ0.004-0.003=0.001
min0.061-0.066=-0.005
max0.076-0.075=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.484=0.001
σ0.366-0.366=0.001
min1755.909-1755.908=0.001
max1757.073-1757.073=0.000
mean1626.700-1648.850=-22.150
σ592.729-642.122=-49.393
min650.000-624.000=26.000
max2424.000-2837.000=-413.000
mean2.327-2.352=-0.025
σ0.082-0.081=0.001
min2.175-2.255=-0.080
max2.512-2.532=-0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.714-324.708=0.007
σ0.034-0.052=-0.018
min324.654-324.616=0.039
max324.735-324.738=-0.004
mean2424.000-2837.000=-413.000
σ0.000
min2424.000-2837.000=-413.000
max2424.000-2837.000=-413.000
mean0.423-0.423=-0.000
σ0.001-0.001=0.000
min0.421-0.421=-0.000
max0.425-0.424=0.000
iters=5
new-facts=1
prior-facts=6402
mean1985.267-1985.264=0.003
σ0.013-0.018=-0.005
min1985.243-1985.232=0.011
max1985.273-1985.277=-0.004
mean2424.000-2837.000=-413.000
σ0.000
min2424.000-2837.000=-413.000
max2424.000-2837.000=-413.000
mean2.606-2.630=-0.023
σ0.084-0.063=0.020
min2.513-2.570=-0.057
max2.733-2.703=0.030
iters=5
new-facts=6402
prior-facts=1
mean4808.858-4808.890=-0.032
σ7.668-7.655=0.013
min4805.415-4805.354=0.061
max4822.575-4822.582=-0.007
mean2424.000-2837.000=-413.000
σ0.000
min2424.000-2837.000=-413.000
max2424.000-2837.000=-413.000
mean8.843-8.809=0.033
σ0.108-0.449=-0.341
min8.747-8.059=0.688
max9.019-9.220=-0.201
iters=5
new-facts=6402
prior-facts=6402
mean4996.324-4996.468=-0.144
σ0.202-0.015=0.187
min4996.089-4996.455=-0.366
max4996.479-4996.489=-0.010
mean2948.200-3041.400=-93.200
σ440.902-210.397=230.505
min2424.000-2837.000=-413.000
max3535.000-3356.000=179.000
mean8.502-8.742=-0.240
σ0.064-0.242=-0.178
min8.430-8.485=-0.054
max8.599-9.021=-0.422

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.672-0.943=0.729
σ0.082-0.068=0.014
min1.557-0.888=0.669
max1.769-1.061=0.708

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.948-462.970=-0.022
σ574.246-574.246=-0.000
min175.819-175.839=-0.020
max1324.317-1324.339=-0.022
mean86.250
σ8.500
min82.000
max99.000
mean2424.000-2837.000=-413.000
σ0.000
min2424.000-2837.000=-413.000
max2424.000-2837.000=-413.000
mean0.546-0.425=0.122
σ0.541-0.286=0.255
min0.273-0.278=-0.004
max1.357-0.853=0.505
policies=20
mean1758.525-1758.723=-0.198
σ0.345-0.351=-0.006
min1758.289-1758.509=-0.220
max1759.035-1759.246=-0.211
mean820.000
σ0.000
min820.000
max820.000
mean2424.000-2837.000=-413.000
σ0.000
min2424.000-2837.000=-413.000
max2424.000-2837.000=-413.000
mean2.715-2.788=-0.073
σ0.013-0.018=-0.005
min2.700-2.773=-0.073
max2.731-2.814=-0.083
policies=200
mean17592.225-17593.387=-1.163
σ0.680-0.622=0.058
min17591.480-17592.545=-1.065
max17593.117-17593.881=-0.764
mean8200.000
σ0.000
min8200.000
max8200.000
mean2424.000-2837.000=-413.000
σ0.000
min2424.000-2837.000=-413.000
max2424.000-2837.000=-413.000
mean27.378-27.846=-0.468
σ0.110-0.352=-0.242
min27.235-27.449=-0.214
max27.499-28.232=-0.733