Compare commits

Home / Compare 8ce030dc .. 2f53464f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-35.973=-5.205
σ0.046-0.105=-0.059
min30.733-35.927=-5.194
max30.896-36.271=-5.374
mean414.000-413.200=0.800
σ0.000-0.422=-0.422
min414.000-413.000=1.000
max414.000
mean0.076-0.075=0.001
σ0.004-0.004=-0.000
min0.070-0.070=-0.000
max0.084-0.084=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.061-26.208=-5.148
σ0.002-0.003=-0.000
min21.058-26.205=-5.147
max21.064-26.212=-5.149
mean414.000
σ0.000
min414.000
max414.000
mean0.064-0.061=0.003
σ0.002-0.003=-0.000
min0.062-0.059=0.003
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.421-1758.380=-6.960
σ0.363-0.369=-0.006
min1750.848-1757.803=-6.956
max1752.000-1758.975=-6.975
mean1660.550-1657.950=2.600
σ631.808-620.425=11.383
min681.000-686.000=-5.000
max2689.000-2741.000=-52.000
mean2.860-2.389=0.471
σ0.109-0.123=-0.014
min2.646-2.273=0.374
max3.022-2.797=0.224

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.755-279.539=-3.784
σ0.011-0.006=0.005
min275.741-279.532=-3.792
max275.767-279.546=-3.779
mean2689.000-2741.000=-52.000
σ0.000
min2689.000-2741.000=-52.000
max2689.000-2741.000=-52.000
mean0.405-0.407=-0.002
σ0.009-0.006=0.003
min0.398-0.403=-0.004
max0.418-0.416=0.002
iters=5
new-facts=1
prior-facts=6402
mean2168.286-2178.460=-10.174
σ0.006-0.010=-0.005
min2168.277-2178.452=-10.175
max2168.291-2178.477=-10.185
mean2689.000-2741.000=-52.000
σ0.000
min2689.000-2741.000=-52.000
max2689.000-2741.000=-52.000
mean2.975-3.316=-0.341
σ0.217-0.196=0.021
min2.682-3.085=-0.404
max3.258-3.610=-0.352
iters=5
new-facts=6402
prior-facts=1
mean5048.149-5056.387=-8.238
σ0.916-0.987=-0.071
min5047.544-5055.795=-8.252
max5049.774-5058.142=-8.368
mean2689.000-2741.000=-52.000
σ0.000
min2689.000-2741.000=-52.000
max2689.000-2741.000=-52.000
mean8.761-9.088=-0.327
σ0.539-0.469=0.070
min8.061-8.281=-0.221
max9.301-9.508=-0.207
iters=5
new-facts=6402
prior-facts=6402
mean5179.229-5193.719=-14.490
σ0.076-0.120=-0.044
min5179.143-5193.537=-14.394
max5179.310-5193.875=-14.564
mean3227.400-3284.200=-56.800
σ389.684-405.493=-15.809
min2702.000-2741.000=-39.000
max3736.000-3672.000=64.000
mean9.771-8.798=0.973
σ0.657-0.068=0.589
min8.728-8.708=0.021
max10.438-8.884=1.554

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.126-1.000=0.126
σ0.196-0.066=0.130
min0.948-0.945=0.003
max1.398-1.073=0.325

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.578-465.537=-1.959
σ572.675-572.660=0.015
min177.237-179.201=-1.964
max1322.591-1324.528=-1.937
mean79.750-79.500=0.250
σ7.500-7.000=0.500
min76.000
max91.000-90.000=1.000
mean2689.000-2741.000=-52.000
σ0.000
min2689.000-2741.000=-52.000
max2689.000-2741.000=-52.000
mean0.546-0.482=0.064
σ0.540-0.400=0.140
min0.274-0.279=-0.005
max1.357-1.083=0.274
policies=20
mean1772.631-1792.303=-19.671
σ0.341-0.323=0.019
min1772.389-1792.106=-19.717
max1773.136-1792.783=-19.647
mean760.000
σ0.000
min760.000
max760.000
mean2689.000-2741.000=-52.000
σ0.000
min2689.000-2741.000=-52.000
max2689.000-2741.000=-52.000
mean2.747-2.809=-0.062
σ0.012-0.008=0.004
min2.736-2.799=-0.063
max2.763-2.818=-0.054
policies=200
mean17733.064-17929.429=-196.365
σ0.458-0.457=0.001
min17732.751-17929.030=-196.279
max17733.742-17930.087=-196.345
mean7600.000
σ0.000
min7600.000
max7600.000
mean2689.000-2741.000=-52.000
σ0.000
min2689.000-2741.000=-52.000
max2689.000-2741.000=-52.000
mean27.774-28.335=-0.561
σ0.186-0.069=0.117
min27.603-28.266=-0.663
max28.038-28.403=-0.365