Compare commits

Home / Compare f897af69 .. 2e51daf7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.771=-0.003
σ0.046-0.046=-0.001
min30.733-30.747=-0.015
max30.896-30.902=-0.006
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.076-0.074=0.002
σ0.004-0.005=-0.000
min0.070-0.070=-0.000
max0.084-0.083=0.000
cache=y
dps=1
iters=10
policies=100
mean21.061-21.059=0.001
σ0.002-0.002=0.000
min21.058-21.054=0.003
max21.064-21.062=0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.064-0.063=0.001
σ0.002-0.003=-0.001
min0.062-0.057=0.005
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.421-1751.234=0.186
σ0.363-0.362=0.001
min1750.848-1750.677=0.171
max1752.000-1751.802=0.197
mean1660.550-1649.450=11.100
σ631.808-634.549=-2.741
min681.000-632.000=49.000
max2689.000-2850.000=-161.000
mean2.860-2.783=0.077
σ0.109-0.200=-0.091
min2.646-2.301=0.346
max3.022-3.118=-0.096

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.755-275.571=0.184
σ0.011-0.008=0.002
min275.741-275.562=0.179
max275.767-275.581=0.186
mean2689.000-2850.000=-161.000
σ0.000
min2689.000-2850.000=-161.000
max2689.000-2850.000=-161.000
mean0.405-0.394=0.011
σ0.009-0.009=0.000
min0.398-0.387=0.011
max0.418-0.404=0.014
iters=5
new-facts=1
prior-facts=6402
mean2168.286-2168.101=0.185
σ0.006-0.004=0.002
min2168.277-2168.095=0.182
max2168.291-2168.107=0.185
mean2689.000-2850.000=-161.000
σ0.000
min2689.000-2850.000=-161.000
max2689.000-2850.000=-161.000
mean2.975-2.942=0.033
σ0.217-0.117=0.100
min2.682-2.768=-0.086
max3.258-3.049=0.210
iters=5
new-facts=6402
prior-facts=1
mean5048.149-5047.917=0.232
σ0.916-0.847=0.068
min5047.544-5047.362=0.181
max5049.774-5049.409=0.365
mean2689.000-2850.000=-161.000
σ0.000
min2689.000-2850.000=-161.000
max2689.000-2850.000=-161.000
mean8.761-8.736=0.024
σ0.539-0.503=0.036
min8.061-8.079=-0.018
max9.301-9.457=-0.156
iters=5
new-facts=6402
prior-facts=6402
mean5179.229-5178.919=0.310
σ0.076-0.349=-0.273
min5179.143-5178.312=0.830
max5179.310-5179.158=0.152
mean3227.400-3251.200=-23.800
σ389.684-334.534=55.149
min2702.000-2850.000=-148.000
max3736.000-3706.000=30.000
mean9.771-10.198=-0.427
σ0.657-0.222=0.435
min8.728-9.927=-1.199
max10.438-10.463=-0.025

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.126-1.068=0.058
σ0.196-0.187=0.009
min0.948-0.953=-0.006
max1.398-1.385=0.013

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.578-463.207=0.371
σ572.675-572.651=0.024
min177.237-176.875=0.362
max1322.591-1322.183=0.408
mean79.750-77.500=2.250
σ7.500-7.000=0.500
min76.000-74.000=2.000
max91.000-88.000=3.000
mean2689.000-2850.000=-161.000
σ0.000
min2689.000-2850.000=-161.000
max2689.000-2850.000=-161.000
mean0.546-0.437=0.109
σ0.540-0.313=0.228
min0.274-0.272=0.001
max1.357-0.906=0.451
policies=20
mean1772.631-1769.006=3.625
σ0.341-0.337=0.004
min1772.389-1768.781=3.608
max1773.136-1769.506=3.630
mean760.000-740.000=20.000
σ0.000
min760.000-740.000=20.000
max760.000-740.000=20.000
mean2689.000-2850.000=-161.000
σ0.000
min2689.000-2850.000=-161.000
max2689.000-2850.000=-161.000
mean2.747-2.840=-0.093
σ0.012-0.016=-0.004
min2.736-2.829=-0.093
max2.763-2.863=-0.100
policies=200
mean17733.064-17696.173=36.891
σ0.458-0.586=-0.128
min17732.751-17695.842=36.909
max17733.742-17697.049=36.693
mean7600.000-7400.000=200.000
σ0.000
min7600.000-7400.000=200.000
max7600.000-7400.000=200.000
mean2689.000-2850.000=-161.000
σ0.000
min2689.000-2850.000=-161.000
max2689.000-2850.000=-161.000
mean27.774-28.169=-0.395
σ0.186-0.517=-0.332
min27.603-27.575=0.028
max28.038-28.664=-0.626