Compare commits

Home / Compare 6b679b4d .. 5a625c02

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.799=0.000
σ0.107-0.106=0.002
min35.751-35.750=0.001
max36.104-36.099=0.005
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.075-0.077=-0.002
σ0.004-0.004=0.001
min0.070-0.075=-0.004
max0.082-0.084=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.065-26.065=-0.000
σ0.004-0.003=0.001
min26.060-26.060=-0.000
max26.071-26.069=0.001
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.061-0.062=-0.001
σ0.002-0.002=-0.000
min0.060-0.060=-0.000
max0.067-0.068=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.924-1755.923=0.001
σ0.365-0.368=-0.003
min1755.351-1755.352=-0.001
max1756.513-1756.513=-0.000
mean1666.300-1645.050=21.250
σ629.443-623.021=6.422
min671.000-611.000=60.000
max2663.000-2650.000=13.000
mean2.797-2.850=-0.053
σ0.159-0.182=-0.023
min2.320-2.303=0.018
max2.977-3.141=-0.165

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.196-277.195=0.001
σ0.006-0.005=0.000
min277.190-277.188=0.003
max277.205-277.202=0.003
mean2663.000-2650.000=13.000
σ0.000
min2663.000-2650.000=13.000
max2663.000-2650.000=13.000
mean0.407-0.397=0.010
σ0.008-0.008=0.000
min0.399-0.392=0.006
max0.416-0.411=0.005
iters=5
new-facts=1
prior-facts=6402
mean2174.427-2174.430=-0.003
σ0.017-0.005=0.011
min2174.410-2174.425=-0.015
max2174.451-2174.436=0.015
mean2663.000-2650.000=13.000
σ0.000
min2663.000-2650.000=13.000
max2663.000-2650.000=13.000
mean3.126-3.055=0.071
σ0.214-0.146=0.068
min2.836-2.809=0.027
max3.433-3.199=0.234
iters=5
new-facts=6402
prior-facts=1
mean5052.602-5052.638=-0.037
σ0.941-0.962=-0.021
min5051.991-5052.036=-0.045
max5054.268-5054.344=-0.076
mean2663.000-2650.000=13.000
σ0.000
min2663.000-2650.000=13.000
max2663.000-2650.000=13.000
mean8.833-8.698=0.136
σ0.591-0.476=0.115
min8.172-8.257=-0.085
max9.372-9.409=-0.037
iters=5
new-facts=6402
prior-facts=6402
mean5188.413-5188.420=-0.007
σ0.073-0.091=-0.018
min5188.359-5188.349=0.010
max5188.526-5188.521=0.004
mean3282.600-3233.000=49.600
σ423.635-385.841=37.794
min2684.000-2696.000=-12.000
max3672.000-3720.000=-48.000
mean8.978-8.992=-0.014
σ0.317-0.407=-0.091
min8.700-8.725=-0.025
max9.493-9.701=-0.208

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.189-1.204=-0.015
σ0.272-0.294=-0.022
min0.947-0.950=-0.003
max1.501-1.702=-0.200

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.863-464.854=0.009
σ572.671-572.657=0.013
min178.524-178.523=0.001
max1323.869-1323.840=0.029
mean79.500
σ7.000
min76.000
max90.000
mean2663.000-2650.000=13.000
σ0.000
min2663.000-2650.000=13.000
max2663.000-2650.000=13.000
mean0.552-0.583=-0.032
σ0.528-0.587=-0.059
min0.282-0.283=-0.000
max1.344-1.464=-0.120
policies=20
mean1785.485-1785.488=-0.003
σ0.348-0.343=0.005
min1785.262-1785.260=0.002
max1786.003-1785.997=0.007
mean760.000
σ0.000
min760.000
max760.000
mean2663.000-2650.000=13.000
σ0.000
min2663.000-2650.000=13.000
max2663.000-2650.000=13.000
mean2.780-2.792=-0.012
σ0.011-0.012=-0.001
min2.766-2.780=-0.014
max2.793-2.806=-0.014
policies=200
mean17861.522-17861.546=-0.023
σ0.393-0.455=-0.061
min17861.314-17861.268=0.046
max17862.112-17862.224=-0.113
mean7600.000
σ0.000
min7600.000
max7600.000
mean2663.000-2650.000=13.000
σ0.000
min2663.000-2650.000=13.000
max2663.000-2650.000=13.000
mean28.109-28.287=-0.178
σ0.386-0.149=0.237
min27.592-28.127=-0.535
max28.478-28.427=0.051