Compare commits

Home / Compare 60e7ec7a .. d6324f8a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-35.617=-1.638
σ0.049-0.052=-0.004
min33.946-35.592=-1.645
max34.113-35.765=-1.653
mean414.000
σ0.000
min414.000
max414.000
mean0.085-0.085=0.001
σ0.004-0.004=-0.000
min0.082-0.081=0.001
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-24.048=-0.731
σ0.003-0.003=-0.000
min23.313-24.040=-0.727
max23.320-24.051=-0.731
mean414.000
σ0.000
min414.000
max414.000
mean0.062-0.068=-0.006
σ0.003-0.003=-0.000
min0.060-0.066=-0.006
max0.069-0.076=-0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1756.489=0.814
σ0.366-0.365=0.001
min1756.728-1755.915=0.813
max1757.896-1757.075=0.821
mean1651.950-1652.200=-0.250
σ627.598-644.668=-17.070
min675.000-649.000=26.000
max2600.000-2840.000=-240.000
mean2.335-2.352=-0.017
σ0.127-0.080=0.048
min2.202-2.267=-0.065
max2.644-2.533=0.112

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.453-324.761=1.692
σ0.032-0.043=-0.012
min326.399-324.684=1.715
max326.475-324.790=1.685
mean2600.000-2840.000=-240.000
σ0.000
min2600.000-2840.000=-240.000
max2600.000-2840.000=-240.000
mean0.423-0.417=0.006
σ0.002-0.002=0.000
min0.420-0.416=0.004
max0.425-0.420=0.005
iters=5
new-facts=1
prior-facts=6402
mean1988.602-1985.313=3.288
σ0.032-0.015=0.016
min1988.549-1985.292=3.257
max1988.626-1985.334=3.292
mean2600.000-2840.000=-240.000
σ0.000
min2600.000-2840.000=-240.000
max2600.000-2840.000=-240.000
mean2.700-2.636=0.064
σ0.178-0.129=0.049
min2.581-2.515=0.066
max3.015-2.817=0.198
iters=5
new-facts=6402
prior-facts=1
mean4813.508-4809.111=4.397
σ7.706-7.773=-0.067
min4809.898-4805.604=4.294
max4827.291-4823.016=4.275
mean2600.000-2840.000=-240.000
σ0.000
min2600.000-2840.000=-240.000
max2600.000-2840.000=-240.000
mean8.407-9.162=-0.755
σ0.609-0.341=0.268
min7.710-8.925=-1.215
max9.314-9.755=-0.442
iters=5
new-facts=6402
prior-facts=6402
mean5001.022-4996.552=4.469
σ0.031-0.151=-0.120
min5000.987-4996.285=4.703
max5001.056-4996.646=4.410
mean2961.200-3047.600=-86.400
σ266.229-270.853=-4.624
min2626.000-2840.000=-214.000
max3323.000-3465.000=-142.000
mean9.927-8.503=1.424
σ0.188-0.114=0.074
min9.706-8.444=1.262
max10.219-8.705=1.514

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.162-0.981=0.181
σ0.334-0.068=0.266
min0.917-0.924=-0.006
max1.731-1.056=0.675

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.437-463.205=1.232
σ574.785-574.774=0.011
min177.039-175.808=1.232
max1326.614-1325.366=1.248
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2600.000-2840.000=-240.000
σ0.000
min2600.000-2840.000=-240.000
max2600.000-2840.000=-240.000
mean0.550-0.430=0.120
σ0.553-0.299=0.255
min0.271-0.278=-0.007
max1.380-0.878=0.502
policies=20
mean1770.769-1758.488=12.281
σ0.358-0.353=0.005
min1770.533-1758.241=12.292
max1771.301-1759.009=12.291
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2600.000-2840.000=-240.000
σ0.000
min2600.000-2840.000=-240.000
max2600.000-2840.000=-240.000
mean2.724-2.788=-0.064
σ0.025-0.005=0.019
min2.694-2.781=-0.086
max2.753-2.792=-0.039
policies=200
mean17714.788-17591.980=122.808
σ0.609-0.432=0.177
min17714.352-17591.725=122.628
max17715.686-17592.626=123.060
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2600.000-2840.000=-240.000
σ0.000
min2600.000-2840.000=-240.000
max2600.000-2840.000=-240.000
mean27.398-27.908=-0.510
σ0.127-0.376=-0.249
min27.224-27.527=-0.303
max27.507-28.323=-0.817