Compare commits

Home / Compare 7a796eab .. 4e81fa45

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.770=-0.001
σ0.046-0.048=-0.002
min30.733-30.725=0.008
max30.896-30.901=-0.005
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.076-0.079=-0.003
σ0.004-0.003=0.001
min0.070-0.077=-0.007
max0.084-0.086=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.061-21.061=-0.001
σ0.002-0.002=0.000
min21.058-21.058=-0.001
max21.064-21.063=0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.064-0.064=-0.000
σ0.002-0.003=-0.001
min0.062-0.062=0.000
max0.071-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.421-1751.419=0.002
σ0.363-0.361=0.002
min1750.848-1750.852=-0.005
max1752.000-1751.997=0.003
mean1660.550-1651.750=8.800
σ631.808-615.607=16.201
min681.000-636.000=45.000
max2689.000-2488.000=201.000
mean2.860-2.775=0.086
σ0.109-0.235=-0.126
min2.646-2.293=0.353
max3.022-3.209=-0.187

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.755-275.760=-0.006
σ0.011-0.010=0.001
min275.741-275.750=-0.009
max275.767-275.774=-0.007
mean2689.000-2488.000=201.000
σ0.000
min2689.000-2488.000=201.000
max2689.000-2488.000=201.000
mean0.405-0.407=-0.001
σ0.009-0.011=-0.002
min0.398-0.399=-0.000
max0.418-0.422=-0.004
iters=5
new-facts=1
prior-facts=6402
mean2168.286-2168.290=-0.003
σ0.006-0.008=-0.002
min2168.277-2168.277=0.000
max2168.291-2168.296=-0.004
mean2689.000-2488.000=201.000
σ0.000
min2689.000-2488.000=201.000
max2689.000-2488.000=201.000
mean2.975-2.994=-0.019
σ0.217-0.151=0.066
min2.682-2.772=-0.090
max3.258-3.121=0.137
iters=5
new-facts=6402
prior-facts=1
mean5048.149-5048.103=0.046
σ0.916-0.925=-0.010
min5047.544-5047.572=-0.028
max5049.774-5049.752=0.022
mean2689.000-2488.000=201.000
σ0.000
min2689.000-2488.000=201.000
max2689.000-2488.000=201.000
mean8.761-8.848=-0.088
σ0.539-0.489=0.050
min8.061-8.082=-0.021
max9.301-9.282=0.019
iters=5
new-facts=6402
prior-facts=6402
mean5179.229-5179.238=-0.009
σ0.076-0.079=-0.002
min5179.143-5179.181=-0.038
max5179.310-5179.338=-0.028
mean3227.400-3226.600=0.800
σ389.684-397.394=-7.711
min2702.000-2683.000=19.000
max3736.000-3732.000=4.000
mean9.771-9.923=-0.152
σ0.657-0.291=0.367
min8.728-9.599=-0.870
max10.438-10.243=0.195

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.126-1.787=-0.661
σ0.196-0.195=0.000
min0.948-1.473=-0.525
max1.398-1.943=-0.545

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.578-463.567=0.011
σ572.675-572.654=0.022
min177.237-177.237=-0.000
max1322.591-1322.547=0.044
mean79.750
σ7.500
min76.000
max91.000
mean2689.000-2488.000=201.000
σ0.000
min2689.000-2488.000=201.000
max2689.000-2488.000=201.000
mean0.546-0.561=-0.015
σ0.540-0.569=-0.029
min0.274-0.275=-0.001
max1.357-1.415=-0.059
policies=20
mean1772.631-1772.638=-0.006
σ0.341-0.337=0.004
min1772.389-1772.412=-0.023
max1773.136-1773.138=-0.002
mean760.000
σ0.000
min760.000
max760.000
mean2689.000-2488.000=201.000
σ0.000
min2689.000-2488.000=201.000
max2689.000-2488.000=201.000
mean2.747-2.761=-0.014
σ0.012-0.031=-0.019
min2.736-2.723=0.013
max2.763-2.799=-0.036
policies=200
mean17733.064-17732.898=0.166
σ0.458-0.556=-0.098
min17732.751-17732.565=0.186
max17733.742-17733.729=0.013
mean7600.000
σ0.000
min7600.000
max7600.000
mean2689.000-2488.000=201.000
σ0.000
min2689.000-2488.000=201.000
max2689.000-2488.000=201.000
mean27.774-27.732=0.042
σ0.186-0.141=0.045
min27.603-27.631=-0.028
max28.038-27.931=0.108