Compare commits

Home / Compare d3b993e3 .. 9c531a4e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.964
σ0.107
min35.913
max36.266
mean414.900
σ0.316
min414.000
max415.000
mean0.076
σ0.003
min0.071
max0.083
cache=y
dps=1
iters=10
policies=100
mean26.202
σ0.003
min26.197
max26.206
mean415.000
σ0.000
min415.000
max415.000
mean0.060
σ0.002
min0.059
max0.066

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.923-1755.331=1.592
σ0.368-0.366=0.002
min1756.350-1754.756=1.595
max1757.516-1755.918=1.598
mean1652.350-1656.850=-4.500
σ622.395-627.323=-4.928
min612.000-621.000=-9.000
max2741.000-2747.000=-6.000
mean2.362-2.255=0.107
σ0.123-0.105=0.018
min2.264-2.126=0.138
max2.797-2.571=0.226

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.413-277.738=1.674
σ0.011-0.011=0.000
min279.398-277.725=1.673
max279.428-277.752=1.676
mean2741.000-2747.000=-6.000
σ0.000
min2741.000-2747.000=-6.000
max2741.000-2747.000=-6.000
mean0.416-0.409=0.006
σ0.006-0.001=0.005
min0.410-0.408=0.002
max0.423-0.411=0.012
iters=5
new-facts=1
prior-facts=6402
mean2269.497-2267.893=1.604
σ0.015-0.006=0.009
min2269.473-2267.884=1.589
max2269.512-2267.899=1.613
mean2741.000-2747.000=-6.000
σ0.000
min2741.000-2747.000=-6.000
max2741.000-2747.000=-6.000
mean2.945-3.230=-0.285
σ0.179-0.155=0.024
min2.752-3.061=-0.309
max3.241-3.399=-0.159
iters=5
new-facts=6402
prior-facts=1
mean4954.851-4955.183=-0.332
σ0.812-1.035=-0.223
min4954.425-4954.613=-0.188
max4956.299-4957.025=-0.726
mean2741.000-2747.000=-6.000
σ0.000
min2741.000-2747.000=-6.000
max2741.000-2747.000=-6.000
mean7.957-7.792=0.165
σ0.117-0.165=-0.049
min7.825-7.639=0.186
max8.078-7.976=0.102
iters=5
new-facts=6402
prior-facts=6402
mean5169.370-5169.792=-0.422
σ0.221-0.089=0.132
min5168.999-5169.691=-0.692
max5169.510-5169.872=-0.362
mean3422.000-3315.400=106.600
σ476.750-392.607=84.143
min2762.000-2927.000=-165.000
max4015.000-3712.000=303.000
mean9.321-9.388=-0.067
σ0.332-0.207=0.125
min8.912-9.087=-0.175
max9.726-9.663=0.063

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.948-1.837=-0.890
σ0.010-0.081=-0.071
min0.941-1.712=-0.771
max0.965-1.919=-0.954

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean461.593-456.322=5.271
σ572.652-572.604=0.049
min175.257-170.019=5.238
max1320.572-1315.227=5.344
mean77.500-79.500=-2.000
σ7.000
min74.000-76.000=-2.000
max88.000-90.000=-2.000
mean2741.000-433.000=2308.000
σ0.000
min2741.000-433.000=2308.000
max2741.000-433.000=2308.000
mean0.459-0.560=-0.101
σ0.369-0.579=-0.209
min0.272-0.263=0.009
max1.013-1.428=-0.415
policies=20
mean1752.827-1700.713=52.113
σ0.309-0.304=0.005
min1752.633-1700.488=52.145
max1753.288-1701.159=52.129
mean740.000-760.000=-20.000
σ0.000
min740.000-760.000=-20.000
max740.000-760.000=-20.000
mean2741.000-442.250=2298.750
σ0.000-9.743=-9.743
min2741.000-433.000=2308.000
max2741.000-456.000=2285.000
mean2.721-2.610=0.111
σ0.009-0.016=-0.007
min2.710-2.591=0.119
max2.732-2.630=0.102
policies=200
mean17534.604-17016.707=517.898
σ0.447-0.122=0.325
min17534.236-17016.528=517.708
max17535.256-17016.790=518.465
mean7400.000-7600.000=-200.000
σ0.000
min7400.000-7600.000=-200.000
max7400.000-7600.000=-200.000
mean2741.000-492.000=2249.000
σ0.000-3.742=-3.742
min2741.000-487.000=2254.000
max2741.000-496.000=2245.000
mean27.268-26.390=0.878
σ0.050-0.052=-0.002
min27.226-26.321=0.905
max27.337-26.441=0.895