Compare commits

Home / Compare 01fb574c .. 77f00784

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.773-35.973=-5.200
σ0.045-0.107=-0.062
min30.751-35.922=-5.171
max30.901-36.276=-5.375
mean413.000
σ0.000
min413.000
max413.000
mean0.079-0.078=0.001
σ0.004-0.004=0.000
min0.076-0.075=0.001
max0.085-0.085=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.059-26.208=-5.149
σ0.002-0.002=0.000
min21.056-26.204=-5.147
max21.064-26.211=-5.147
mean413.000
σ0.000
min413.000
max413.000
mean0.063-0.061=0.001
σ0.003-0.003=0.000
min0.059-0.059=-0.000
max0.070-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.236-1758.362=-7.127
σ0.362-0.372=-0.009
min1750.676-1757.786=-7.110
max1751.825-1758.961=-7.136
mean1667.100-1655.150=11.950
σ630.176-620.424=9.752
min679.000-685.000=-6.000
max2640.000-2746.000=-106.000
mean2.837-2.368=0.469
σ0.106-0.114=-0.008
min2.621-2.178=0.443
max2.970-2.634=0.336

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.567-279.512=-3.945
σ0.007-0.007=-0.000
min275.562-279.503=-3.941
max275.578-279.517=-3.939
mean2640.000-2746.000=-106.000
σ0.000
min2640.000-2746.000=-106.000
max2640.000-2746.000=-106.000
mean0.391-0.409=-0.018
σ0.008-0.002=0.006
min0.383-0.405=-0.022
max0.400-0.410=-0.010
iters=5
new-facts=1
prior-facts=6402
mean2168.099-2178.418=-10.318
σ0.009-0.034=-0.024
min2168.089-2178.359=-10.271
max2168.110-2178.443=-10.333
mean2640.000-2746.000=-106.000
σ0.000
min2640.000-2746.000=-106.000
max2640.000-2746.000=-106.000
mean2.997-3.432=-0.435
σ0.161-0.172=-0.011
min2.836-3.271=-0.435
max3.223-3.620=-0.397
iters=5
new-facts=6402
prior-facts=1
mean5047.922-5056.392=-8.470
σ0.896-1.004=-0.108
min5047.391-5055.790=-8.400
max5049.516-5058.177=-8.661
mean2640.000-2746.000=-106.000
σ0.000
min2640.000-2746.000=-106.000
max2640.000-2746.000=-106.000
mean9.018-8.715=0.303
σ0.328-0.657=-0.329
min8.597-8.163=0.434
max9.493-9.736=-0.243
iters=5
new-facts=6402
prior-facts=6402
mean5179.041-5193.689=-14.647
σ0.082-0.212=-0.130
min5178.961-5193.338=-14.377
max5179.131-5193.874=-14.744
mean3218.800-3285.800=-67.000
σ388.112-404.146=-16.034
min2684.000-2746.000=-62.000
max3704.000-3673.000=31.000
mean9.864-8.832=1.032
σ0.271-0.095=0.176
min9.489-8.705=0.784
max10.214-8.970=1.244

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.295-1.001=0.294
σ0.381-0.072=0.309
min0.950-0.937=0.012
max1.871-1.080=0.791

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.203-465.476=-2.273
σ572.661-572.661=-0.000
min176.872-179.137=-2.266
max1322.194-1324.468=-2.273
mean77.500-79.500=-2.000
σ7.000
min74.000-76.000=-2.000
max88.000-90.000=-2.000
mean2640.000-2746.000=-106.000
σ0.000
min2640.000-2746.000=-106.000
max2640.000-2746.000=-106.000
mean0.550-0.474=0.076
σ0.541-0.379=0.163
min0.275-0.282=-0.007
max1.362-1.042=0.320
policies=20
mean1768.970-1791.671=-22.701
σ0.334-0.340=-0.006
min1768.757-1791.474=-22.717
max1769.469-1792.178=-22.709
mean740.000-760.000=-20.000
σ0.000
min740.000-760.000=-20.000
max740.000-760.000=-20.000
mean2640.000-2746.000=-106.000
σ0.000
min2640.000-2746.000=-106.000
max2640.000-2746.000=-106.000
mean2.744-2.818=-0.074
σ0.019-0.006=0.013
min2.718-2.811=-0.093
max2.764-2.824=-0.060
policies=200
mean17696.103-17923.168=-227.066
σ0.589-0.510=0.078
min17695.750-17922.880=-227.130
max17696.981-17923.933=-226.952
mean7400.000-7600.000=-200.000
σ0.000
min7400.000-7600.000=-200.000
max7400.000-7600.000=-200.000
mean2640.000-2746.000=-106.000
σ0.000
min2640.000-2746.000=-106.000
max2640.000-2746.000=-106.000
mean27.657-28.237=-0.580
σ0.132-0.094=0.038
min27.467-28.152=-0.685
max27.772-28.368=-0.596