Compare commits

Home / Compare 09c5eb2b .. b5f4e1f6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.769=0.000
σ0.048-0.046=0.003
min30.730-30.734=-0.004
max30.904-30.896=0.008
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.076-0.078=-0.002
σ0.004-0.003=0.001
min0.070-0.075=-0.004
max0.084-0.085=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.059-21.060=-0.001
σ0.003-0.001=0.001
min21.056-21.057=-0.001
max21.065-21.062=0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.060-0.061=-0.001
σ0.004-0.003=0.000
min0.057-0.058=-0.001
max0.069-0.069=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.421-1751.416=0.005
σ0.362-0.362=-0.000
min1750.853-1750.853=0.000
max1752.003-1751.997=0.006
mean1669.100-1661.650=7.450
σ642.379-634.667=7.712
min682.000-622.000=60.000
max2705.000-2791.000=-86.000
mean2.853-2.784=0.069
σ0.162-0.116=0.046
min2.535-2.550=-0.015
max3.059-2.943=0.116

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.759-275.761=-0.001
σ0.008-0.011=-0.003
min275.748-275.746=0.002
max275.768-275.774=-0.005
mean2705.000-2791.000=-86.000
σ0.000
min2705.000-2791.000=-86.000
max2705.000-2791.000=-86.000
mean0.407-0.405=0.002
σ0.012-0.010=0.001
min0.393-0.397=-0.005
max0.417-0.418=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2168.283-2168.266=0.016
σ0.007-0.015=-0.009
min2168.271-2168.253=0.018
max2168.287-2168.290=-0.004
mean2705.000-2791.000=-86.000
σ0.000
min2705.000-2791.000=-86.000
max2705.000-2791.000=-86.000
mean2.935-2.868=0.067
σ0.115-0.111=0.004
min2.786-2.785=0.001
max3.067-3.015=0.052
iters=5
new-facts=6402
prior-facts=1
mean5048.097-5048.095=0.002
σ0.910-0.917=-0.006
min5047.540-5047.552=-0.012
max5049.715-5049.715=0.000
mean2705.000-2791.000=-86.000
σ0.000
min2705.000-2791.000=-86.000
max2705.000-2791.000=-86.000
mean8.719-8.905=-0.186
σ0.392-0.513=-0.121
min8.085-8.061=0.024
max9.087-9.451=-0.364
iters=5
new-facts=6402
prior-facts=6402
mean5179.157-5179.238=-0.081
σ0.190-0.088=0.102
min5178.848-5179.160=-0.312
max5179.314-5179.346=-0.032
mean3204.200-3305.600=-101.400
σ345.013-468.722=-123.709
min2716.000-2791.000=-75.000
max3626.000-3958.000=-332.000
mean9.765-10.037=-0.271
σ0.261-0.334=-0.073
min9.434-9.642=-0.208
max10.152-10.543=-0.391

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.097-1.090=0.007
σ0.118-0.111=0.008
min0.942-0.952=-0.010
max1.264-1.262=0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.579-463.568=0.010
σ572.660-572.655=0.005
min177.240-177.238=0.002
max1322.569-1322.551=0.018
mean79.750
σ7.500
min76.000
max91.000
mean2705.000-2791.000=-86.000
σ0.000
min2705.000-2791.000=-86.000
max2705.000-2791.000=-86.000
mean0.561-0.441=0.120
σ0.557-0.306=0.251
min0.278-0.285=-0.007
max1.396-0.900=0.496
policies=20
mean1772.636-1772.638=-0.001
σ0.327-0.286=0.041
min1772.404-1772.428=-0.023
max1773.121-1773.056=0.065
mean760.000
σ0.000
min760.000
max760.000
mean2705.000-2791.000=-86.000
σ0.000
min2705.000-2791.000=-86.000
max2705.000-2791.000=-86.000
mean2.753-2.827=-0.074
σ0.015-0.081=-0.066
min2.742-2.759=-0.017
max2.774-2.937=-0.162
policies=200
mean17732.848-17732.934=-0.086
σ0.581-0.539=0.042
min17732.514-17732.467=0.047
max17733.718-17733.711=0.007
mean7600.000
σ0.000
min7600.000
max7600.000
mean2705.000-2791.000=-86.000
σ0.000
min2705.000-2791.000=-86.000
max2705.000-2791.000=-86.000
mean27.719-27.774=-0.055
σ0.150-0.083=0.067
min27.498-27.667=-0.169
max27.828-27.855=-0.026