Compare commits

Home / Compare 0ae49363 .. 3427e6d5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.951-36.727=-0.775
σ0.102-0.683=-0.581
min35.908-35.925=-0.016
max36.241-37.523=-1.282
mean414.000-4049.000=-3635.000
σ0.000
min414.000-4049.000=-3635.000
max414.000-4049.000=-3635.000
mean0.076-0.075=0.001
σ0.003-0.001=0.003
min0.074-0.074=-0.000
max0.083-0.076=0.007
cache=y
dps=1
iters=10
policies=100
mean26.200-26.586=-0.386
σ0.004-0.604=-0.600
min26.196-26.206=-0.010
max26.206-27.467=-1.261
mean414.000-4049.000=-3635.000
σ0.000
min414.000-4049.000=-3635.000
max414.000-4049.000=-3635.000
mean0.061-0.060=0.000
σ0.003-0.001=0.002
min0.058-0.059=-0.001
max0.069-0.061=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.300-1756.368=-0.067
σ0.368-0.373=-0.005
min1755.725-1755.766=-0.041
max1756.893-1756.967=-0.074
mean1658.200-1656.200=2.000
σ639.309-627.392=11.916
min609.000-683.000=-74.000
max2697.000-2606.000=91.000
mean2.388-2.261=0.127
σ0.183-0.154=0.029
min2.261-2.128=0.133
max3.095-2.775=0.321

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.818-278.693=0.125
σ0.005-0.012=-0.007
min278.812-278.683=0.129
max278.823-278.713=0.110
mean2697.000-2606.000=91.000
σ0.000
min2697.000-2606.000=91.000
max2697.000-2606.000=91.000
mean0.412-0.424=-0.012
σ0.004-0.009=-0.005
min0.409-0.417=-0.009
max0.417-0.437=-0.020
iters=5
new-facts=1
prior-facts=6402
mean2268.880-2268.862=0.019
σ0.010-0.010=-0.000
min2268.873-2268.846=0.026
max2268.897-2268.871=0.025
mean2697.000-2606.000=91.000
σ0.000
min2697.000-2606.000=91.000
max2697.000-2606.000=91.000
mean3.080-3.004=0.075
σ0.193-0.169=0.024
min2.886-2.900=-0.014
max3.309-3.296=0.013
iters=5
new-facts=6402
prior-facts=1
mean4954.265-4952.127=2.138
σ0.837-0.738=0.099
min4953.856-4951.272=2.584
max4955.760-4953.314=2.446
mean2697.000-2606.000=91.000
σ0.000
min2697.000-2606.000=91.000
max2697.000-2606.000=91.000
mean7.945-7.885=0.060
σ0.358-0.337=0.021
min7.573-7.634=-0.061
max8.532-8.475=0.057
iters=5
new-facts=6402
prior-facts=6402
mean5168.789-5167.003=1.786
σ0.076-0.141=-0.066
min5168.718-5166.750=1.967
max5168.872-5167.077=1.795
mean3301.800-3396.800=-95.000
σ389.066-459.413=-70.347
min2916.000-2808.000=108.000
max3694.000-4049.000=-355.000
mean9.166-9.425=-0.259
σ0.394-0.381=0.012
min8.726-8.997=-0.271
max9.751-9.955=-0.204

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.064-1.055=0.009
σ0.187-0.125=0.062
min0.944-0.936=0.008
max1.384-1.242=0.142

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.808-460.259=-0.450
σ571.584-572.608=-1.024
min174.009-173.953=0.056
max1317.184-1319.170=-1.986
mean79.500
σ7.000
min76.000
max90.000
mean2697.000-435.000=2262.000
σ0.000
min2697.000-435.000=2262.000
max2697.000-435.000=2262.000
mean0.547-0.571=-0.025
σ0.552-0.590=-0.037
min0.268-0.274=-0.006
max1.376-1.456=-0.081
policies=20
mean1740.327-1740.051=0.276
σ0.329-0.326=0.003
min1740.124-1739.817=0.307
max1740.817-1740.529=0.288
mean760.000
σ0.000
min760.000
max760.000
mean2697.000-446.000=2251.000
σ0.000-10.520=-10.520
min2697.000-435.000=2262.000
max2697.000-455.000=2242.000
mean2.698-2.656=0.042
σ0.024-0.022=0.002
min2.675-2.628=0.048
max2.731-2.679=0.052
policies=200
mean17410.195-17409.815=0.380
σ0.499-0.068=0.431
min17409.928-17409.736=0.192
max17410.943-17409.897=1.046
mean7600.000
σ0.000
min7600.000
max7600.000
mean2697.000-489.500=2207.500
σ0.000-3.109=-3.109
min2697.000-486.000=2211.000
max2697.000-493.000=2204.000
mean27.107-26.930=0.177
σ0.056-0.071=-0.015
min27.054-26.824=0.231
max27.186-26.975=0.211