Compare commits

Home / Compare 2db9101c .. 2aa4e8c6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.773-35.973=-5.201
σ0.046-0.108=-0.062
min30.749-35.924=-5.175
max30.904-36.279=-5.376
mean411.000-416.000=-5.000
σ0.000
min411.000-416.000=-5.000
max411.000-416.000=-5.000
mean0.079-0.078=0.001
σ0.003-0.004=-0.001
min0.076-0.074=0.002
max0.086-0.086=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.060-26.208=-5.149
σ0.003-0.004=-0.001
min21.057-26.202=-5.145
max21.065-26.216=-5.151
mean411.000-416.000=-5.000
σ0.000
min411.000-416.000=-5.000
max411.000-416.000=-5.000
mean0.064-0.061=0.003
σ0.003-0.003=0.000
min0.062-0.060=0.003
max0.070-0.068=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.235-1758.363=-7.128
σ0.364-0.372=-0.008
min1750.671-1757.786=-7.115
max1751.827-1758.965=-7.138
mean1661.900-1659.450=2.450
σ627.285-621.733=5.552
min685.000-690.000=-5.000
max2769.000-2760.000=9.000
mean2.844-2.394=0.449
σ0.129-0.114=0.015
min2.439-2.287=0.152
max3.060-2.665=0.395

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean267.614-279.498=-11.883
σ17.779-0.016=17.763
min235.810-279.480=-43.669
max275.570-279.514=-3.944
mean2769.000-2760.000=9.000
σ0.000
min2769.000-2760.000=9.000
max2769.000-2760.000=9.000
mean0.380-0.410=-0.030
σ0.031-0.002=0.028
min0.326-0.407=-0.081
max0.399-0.414=-0.015
iters=5
new-facts=1
prior-facts=6402
mean2168.085-2178.423=-10.338
σ0.015-0.032=-0.017
min2168.067-2178.378=-10.311
max2168.103-2178.465=-10.363
mean2769.000-2760.000=9.000
σ0.000
min2769.000-2760.000=9.000
max2769.000-2760.000=9.000
mean2.935-3.432=-0.498
σ0.097-0.087=0.011
min2.810-3.291=-0.481
max3.053-3.517=-0.465
iters=5
new-facts=6402
prior-facts=1
mean5047.909-5056.380=-8.471
σ0.878-0.979=-0.101
min5047.334-5055.815=-8.481
max5049.444-5058.125=-8.681
mean2769.000-2760.000=9.000
σ0.000
min2769.000-2760.000=9.000
max2769.000-2760.000=9.000
mean8.903-8.860=0.042
σ0.507-0.612=-0.105
min8.196-8.061=0.135
max9.405-9.556=-0.151
iters=5
new-facts=6402
prior-facts=6402
mean5178.975-5193.747=-14.772
σ0.200-0.101=0.099
min5178.651-5193.641=-14.990
max5179.159-5193.857=-14.698
mean3302.400-3296.000=6.400
σ394.037-400.590=-6.552
min2769.000-2760.000=9.000
max3674.000-3680.000=-6.000
mean9.873-8.879=0.994
σ0.212-0.169=0.043
min9.534-8.611=0.923
max10.106-9.049=1.057

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.056-0.969=0.086
σ0.184-0.054=0.130
min0.944-0.937=0.007
max1.373-1.064=0.308

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.203-465.478=-2.274
σ572.662-572.662=0.000
min176.869-179.140=-2.271
max1322.197-1324.471=-2.274
mean77.500-79.500=-2.000
σ7.000
min74.000-76.000=-2.000
max88.000-90.000=-2.000
mean2769.000-2760.000=9.000
σ0.000
min2769.000-2760.000=9.000
max2769.000-2760.000=9.000
mean0.440-0.480=-0.040
σ0.305-0.397=-0.092
min0.286-0.279=0.007
max0.897-1.075=-0.178
policies=20
mean1768.972-1791.671=-22.699
σ0.302-0.339=-0.037
min1768.762-1791.476=-22.714
max1769.421-1792.177=-22.756
mean740.000-760.000=-20.000
σ0.000
min740.000-760.000=-20.000
max740.000-760.000=-20.000
mean2769.000-2760.000=9.000
σ0.000
min2769.000-2760.000=9.000
max2769.000-2760.000=9.000
mean2.772-2.811=-0.039
σ0.080-0.017=0.063
min2.714-2.790=-0.076
max2.890-2.827=0.063
policies=200
mean17696.272-17923.160=-226.888
σ0.488-0.313=0.175
min17696.005-17922.894=-226.889
max17697.004-17923.612=-226.608
mean7400.000-7600.000=-200.000
σ0.000
min7400.000-7600.000=-200.000
max7400.000-7600.000=-200.000
mean2769.000-2760.000=9.000
σ0.000
min2769.000-2760.000=9.000
max2769.000-2760.000=9.000
mean27.577-28.333=-0.755
σ0.148-0.123=0.025
min27.413-28.220=-0.807
max27.762-28.453=-0.691