Compare commits

Home / Compare bb804ec1 .. 38e2c5b4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.972=0.001
σ0.107-0.107=0.000
min35.925-35.924=0.001
max36.277-36.275=0.002
mean411.000-414.600=-3.600
σ0.000-0.516=-0.516
min411.000-414.000=-3.000
max411.000-415.000=-4.000
mean0.076-0.075=0.001
σ0.004-0.004=-0.000
min0.070-0.070=0.000
max0.084-0.083=0.001
cache=y
dps=1
iters=10
policies=100
mean26.209-26.208=0.000
σ0.003-0.004=-0.001
min26.204-26.200=0.004
max26.217-26.214=0.003
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.061-0.061=0.000
σ0.002-0.002=-0.000
min0.060-0.059=0.001
max0.067-0.068=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.365-1758.363=0.002
σ0.372-0.373=-0.001
min1757.788-1757.786=0.002
max1758.964-1758.964=-0.000
mean1656.100-1658.900=-2.800
σ624.343-622.005=2.337
min685.000-687.000=-2.000
max2767.000-2743.000=24.000
mean2.396-2.372=0.023
σ0.104-0.103=0.000
min2.283-2.269=0.014
max2.606-2.620=-0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.507-279.510=-0.003
σ0.006-0.007=-0.001
min279.500-279.499=0.001
max279.514-279.516=-0.003
mean2767.000-2743.000=24.000
σ0.000
min2767.000-2743.000=24.000
max2767.000-2743.000=24.000
mean0.409-0.410=-0.001
σ0.005-0.007=-0.002
min0.405-0.401=0.004
max0.417-0.419=-0.002
iters=5
new-facts=1
prior-facts=6402
mean2178.440-2178.442=-0.002
σ0.014-0.012=0.002
min2178.416-2178.422=-0.006
max2178.453-2178.453=-0.000
mean2767.000-2743.000=24.000
σ0.000
min2767.000-2743.000=24.000
max2767.000-2743.000=24.000
mean3.381-3.318=0.063
σ0.333-0.258=0.075
min3.034-2.998=0.035
max3.735-3.718=0.016
iters=5
new-facts=6402
prior-facts=1
mean5056.262-5056.382=-0.120
σ0.719-0.932=-0.213
min5055.813-5055.880=-0.067
max5057.534-5058.045=-0.511
mean2767.000-2743.000=24.000
σ0.000
min2767.000-2743.000=24.000
max2767.000-2743.000=24.000
mean9.191-8.481=0.710
σ0.448-0.392=0.056
min8.463-8.043=0.420
max9.558-9.021=0.537
iters=5
new-facts=6402
prior-facts=6402
mean5193.743-5193.660=0.084
σ0.104-0.134=-0.031
min5193.625-5193.490=0.135
max5193.855-5193.848=0.007
mean3255.000-3232.600=22.400
σ344.751-482.256=-137.506
min2767.000-2743.000=24.000
max3566.000-3923.000=-357.000
mean8.919-8.784=0.135
σ0.144-0.175=-0.031
min8.707-8.635=0.073
max9.096-9.028=0.067

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.981-0.976=0.005
σ0.065-0.063=0.002
min0.940-0.941=-0.001
max1.096-1.088=0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.483-465.481=0.003
σ572.662-572.664=-0.002
min179.143-179.140=0.003
max1324.476-1324.476=-0.000
mean79.500
σ7.000
min76.000
max90.000
mean2767.000-2743.000=24.000
σ0.000
min2767.000-2743.000=24.000
max2767.000-2743.000=24.000
mean0.530-0.483=0.046
σ0.494-0.404=0.091
min0.280-0.280=0.000
max1.271-1.089=0.182
policies=20
mean1791.699-1791.704=-0.005
σ0.319-0.325=-0.006
min1791.510-1791.512=-0.002
max1792.173-1792.188=-0.015
mean760.000
σ0.000
min760.000
max760.000
mean2767.000-2743.000=24.000
σ0.000
min2767.000-2743.000=24.000
max2767.000-2743.000=24.000
mean2.828-2.809=0.019
σ0.072-0.007=0.065
min2.778-2.804=-0.027
max2.932-2.819=0.113
policies=200
mean17923.517-17923.525=-0.007
σ0.511-0.479=0.032
min17923.226-17923.257=-0.031
max17924.284-17924.243=0.041
mean7600.000
σ0.000
min7600.000
max7600.000
mean2767.000-2743.000=24.000
σ0.000
min2767.000-2743.000=24.000
max2767.000-2743.000=24.000
mean28.242-28.269=-0.027
σ0.127-0.110=0.017
min28.092-28.170=-0.078
max28.387-28.364=0.023