Compare commits

Home / Compare 8e6ccb16 .. efd8bfd9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.773-35.973=-5.200
σ0.046-0.108=-0.062
min30.749-35.928=-5.179
max30.902-36.279=-5.377
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.079-0.077=0.002
σ0.004-0.004=0.000
min0.076-0.074=0.001
max0.086-0.083=0.003
cache=y
dps=1
iters=10
policies=100
mean21.059-26.208=-5.149
σ0.003-0.004=-0.001
min21.055-26.203=-5.147
max21.065-26.216=-5.151
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.063-0.060=0.003
σ0.003-0.003=-0.000
min0.059-0.058=0.001
max0.070-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.236-1758.364=-7.128
σ0.362-0.373=-0.011
min1750.675-1757.787=-7.112
max1751.814-1758.964=-7.150
mean1658.100-1655.350=2.750
σ639.035-623.951=15.084
min621.000-683.000=-62.000
max2719.000-2766.000=-47.000
mean2.812-2.379=0.433
σ0.187-0.106=0.081
min2.340-2.162=0.178
max3.077-2.595=0.481

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.566-279.510=-3.943
σ0.005-0.007=-0.001
min275.561-279.501=-3.940
max275.574-279.518=-3.943
mean2719.000-2766.000=-47.000
σ0.000
min2719.000-2766.000=-47.000
max2719.000-2766.000=-47.000
mean0.392-0.412=-0.020
σ0.009-0.006=0.003
min0.386-0.406=-0.020
max0.408-0.419=-0.011
iters=5
new-facts=1
prior-facts=6402
mean2168.098-2178.444=-10.346
σ0.004-0.007=-0.003
min2168.092-2178.438=-10.345
max2168.103-2178.456=-10.354
mean2719.000-2766.000=-47.000
σ0.000
min2719.000-2766.000=-47.000
max2719.000-2766.000=-47.000
mean2.987-3.307=-0.320
σ0.141-0.099=0.042
min2.794-3.218=-0.424
max3.150-3.477=-0.326
iters=5
new-facts=6402
prior-facts=1
mean5047.922-5056.261=-8.339
σ0.887-1.085=-0.198
min5047.346-5055.361=-8.015
max5049.490-5058.142=-8.653
mean2719.000-2766.000=-47.000
σ0.000
min2719.000-2766.000=-47.000
max2719.000-2766.000=-47.000
mean8.782-8.874=-0.092
σ0.521-0.673=-0.152
min8.127-8.028=0.099
max9.539-9.572=-0.033
iters=5
new-facts=6402
prior-facts=6402
mean5179.043-5193.754=-14.711
σ0.084-0.093=-0.009
min5178.972-5193.679=-14.707
max5179.150-5193.859=-14.709
mean3223.600-3227.400=-3.800
σ375.960-359.140=16.819
min2719.000-2838.000=-119.000
max3702.000-3769.000=-67.000
mean9.807-8.725=1.082
σ0.261-0.128=0.133
min9.464-8.566=0.897
max10.057-8.912=1.145

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.080-1.031=0.049
σ0.134-0.141=-0.006
min0.952-0.940=0.012
max1.273-1.263=0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.203-465.481=-2.278
σ572.659-572.658=0.001
min176.867-179.145=-2.278
max1322.192-1324.469=-2.277
mean77.500-79.500=-2.000
σ7.000
min74.000-76.000=-2.000
max88.000-90.000=-2.000
mean2719.000-2766.000=-47.000
σ0.000
min2719.000-2766.000=-47.000
max2719.000-2766.000=-47.000
mean0.557-0.480=0.077
σ0.565-0.400=0.164
min0.273-0.277=-0.004
max1.405-1.081=0.324
policies=20
mean1768.940-1791.697=-22.757
σ0.341-0.327=0.014
min1768.731-1791.508=-22.777
max1769.449-1792.185=-22.736
mean740.000-760.000=-20.000
σ0.000
min740.000-760.000=-20.000
max740.000-760.000=-20.000
mean2719.000-2766.000=-47.000
σ0.000
min2719.000-2766.000=-47.000
max2719.000-2766.000=-47.000
mean2.757-2.792=-0.035
σ0.023-0.027=-0.005
min2.739-2.775=-0.036
max2.789-2.833=-0.044
policies=200
mean17696.202-17923.371=-227.169
σ0.548-0.587=-0.039
min17695.786-17922.973=-227.186
max17697.006-17924.235=-227.229
mean7400.000-7600.000=-200.000
σ0.000
min7400.000-7600.000=-200.000
max7400.000-7600.000=-200.000
mean2719.000-2766.000=-47.000
σ0.000
min2719.000-2766.000=-47.000
max2719.000-2766.000=-47.000
mean27.685-28.178=-0.493
σ0.150-0.120=0.030
min27.541-28.009=-0.468
max27.837-28.294=-0.456