Compare commits

Home / Compare 18bf9a2f .. c42cb22b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.980=-0.001
σ0.048-0.047=0.001
min33.952-33.954=-0.003
max34.113-34.111=0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.084-0.085=-0.001
σ0.003-0.003=0.000
min0.081-0.083=-0.001
max0.090-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=-0.000
σ0.002-0.002=-0.000
min23.313-23.313=-0.001
max23.320-23.320=-0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.066=-0.000
σ0.002-0.002=-0.000
min0.063-0.064=-0.000
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.427-1757.429=-0.002
σ0.368-0.366=0.002
min1756.854-1756.855=-0.001
max1758.018-1758.021=-0.003
mean1646.650-1646.250=0.400
σ625.217-625.394=-0.178
min637.000-636.000=1.000
max2834.000-2835.000=-1.000
mean2.370-2.360=0.010
σ0.075-0.093=-0.018
min2.261-2.267=-0.006
max2.557-2.673=-0.116

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.577-326.571=0.006
σ0.062-0.056=0.007
min326.466-326.473=-0.007
max326.617-326.609=0.008
mean2834.000-2835.000=-1.000
σ0.000
min2834.000-2835.000=-1.000
max2834.000-2835.000=-1.000
mean0.441-0.424=0.016
σ0.017-0.005=0.012
min0.422-0.421=0.000
max0.457-0.433=0.024
iters=5
new-facts=1
prior-facts=6402
mean1988.746-1988.745=0.002
σ0.007-0.008=-0.000
min1988.740-1988.737=0.003
max1988.758-1988.755=0.003
mean2834.000-2835.000=-1.000
σ0.000
min2834.000-2835.000=-1.000
max2834.000-2835.000=-1.000
mean2.668-2.668=0.000
σ0.113-0.134=-0.021
min2.512-2.511=0.001
max2.789-2.857=-0.068
iters=5
new-facts=6402
prior-facts=1
mean4813.486-4813.466=0.020
σ7.832-7.787=0.045
min4809.562-4809.657=-0.095
max4827.489-4827.391=0.098
mean2834.000-2835.000=-1.000
σ0.000
min2834.000-2835.000=-1.000
max2834.000-2835.000=-1.000
mean8.840-8.777=0.062
σ0.389-0.345=0.044
min8.424-8.270=0.154
max9.364-9.177=0.187
iters=5
new-facts=6402
prior-facts=6402
mean5001.062-5001.136=-0.074
σ0.156-0.020=0.136
min5000.785-5001.109=-0.325
max5001.148-5001.157=-0.010
mean3080.800-3054.600=26.200
σ250.744-188.957=61.787
min2834.000-2835.000=-1.000
max3338.000-3318.000=20.000
mean9.763-9.764=-0.001
σ0.172-0.097=0.075
min9.514-9.670=-0.156
max9.935-9.910=0.025

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.972-0.941=0.031
σ0.066-0.059=0.008
min0.913-0.908=0.005
max1.057-1.045=0.012

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.573-464.562=0.010
σ574.770-574.767=0.004
min177.175-177.175=0.001
max1326.728-1326.713=0.016
mean88.250
σ8.500
min84.000
max101.000
mean2834.000-2835.000=-1.000
σ0.000
min2834.000-2835.000=-1.000
max2834.000-2835.000=-1.000
mean0.440-0.434=0.007
σ0.307-0.300=0.007
min0.279-0.279=0.000
max0.900-0.884=0.016
policies=20
mean1772.076-1772.082=-0.006
σ0.362-0.355=0.008
min1771.835-1771.832=0.004
max1772.614-1772.604=0.010
mean840.000
σ0.000
min840.000
max840.000
mean2834.000-2835.000=-1.000
σ0.000
min2834.000-2835.000=-1.000
max2834.000-2835.000=-1.000
mean2.793-2.800=-0.007
σ0.006-0.011=-0.006
min2.788-2.787=0.001
max2.800-2.815=-0.015
policies=200
mean17727.528-17727.556=-0.028
σ0.558-0.338=0.220
min17727.226-17727.252=-0.027
max17728.364-17728.037=0.327
mean8400.000
σ0.000
min8400.000
max8400.000
mean2834.000-2835.000=-1.000
σ0.000
min2834.000-2835.000=-1.000
max2834.000-2835.000=-1.000
mean27.895-27.872=0.023
σ0.414-0.403=0.011
min27.521-27.517=0.004
max28.354-28.300=0.054