Compare commits

Home / Compare 51623f08 .. 1efb0d96

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.977=0.003
σ0.050-0.048=0.002
min33.954-33.953=0.000
max34.120-34.112=0.009
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.085-0.080=0.005
σ0.003-0.004=-0.001
min0.082-0.076=0.006
max0.091-0.087=0.003
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=-0.000
σ0.002-0.004=-0.002
min23.314-23.311=0.002
max23.319-23.323=-0.004
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.065-0.064=0.001
σ0.003-0.004=-0.002
min0.063-0.059=0.004
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.429-1757.426=0.003
σ0.364-0.364=-0.001
min1756.854-1756.855=-0.000
max1758.015-1758.013=0.002
mean1649.150-1655.650=-6.500
σ627.580-643.387=-15.807
min636.000-620.000=16.000
max2823.000-2739.000=84.000
mean2.325-2.401=-0.076
σ0.082-0.235=-0.153
min2.238-2.191=0.047
max2.556-3.335=-0.779

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.586-326.540=0.047
σ0.029-0.051=-0.023
min326.537-326.448=0.088
max326.608-326.570=0.037
mean2823.000-2739.000=84.000
σ0.000
min2823.000-2739.000=84.000
max2823.000-2739.000=84.000
mean0.422-0.430=-0.008
σ0.005-0.007=-0.002
min0.419-0.421=-0.003
max0.431-0.437=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1988.741-1988.734=0.006
σ0.006-0.007=-0.001
min1988.735-1988.726=0.009
max1988.751-1988.745=0.006
mean2823.000-2739.000=84.000
σ0.000
min2823.000-2739.000=84.000
max2823.000-2739.000=84.000
mean2.699-2.768=-0.069
σ0.076-0.146=-0.070
min2.628-2.564=0.064
max2.786-2.932=-0.145
iters=5
new-facts=6402
prior-facts=1
mean4813.374-4813.358=0.016
σ7.562-7.847=-0.286
min4809.578-4809.515=0.063
max4826.894-4827.386=-0.492
mean2823.000-2739.000=84.000
σ0.000
min2823.000-2739.000=84.000
max2823.000-2739.000=84.000
mean8.818-8.475=0.344
σ0.390-0.606=-0.215
min8.283-7.727=0.556
max9.210-9.206=0.003
iters=5
new-facts=6402
prior-facts=6402
mean5001.147-5001.063=0.084
σ0.030-0.165=-0.134
min5001.113-5000.771=0.342
max5001.187-5001.160=0.028
mean3036.800-2983.000=53.800
σ199.371-295.019=-95.649
min2823.000-2739.000=84.000
max3322.000-3423.000=-101.000
mean9.797-9.592=0.204
σ0.253-0.562=-0.309
min9.547-8.598=0.949
max10.217-9.938=0.279

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.940-1.005=-0.065
σ0.060-0.142=-0.083
min0.904-0.912=-0.008
max1.045-1.239=-0.193

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.562-464.566=-0.003
σ574.767-574.768=-0.002
min177.177-177.173=0.003
max1326.712-1326.718=-0.006
mean88.250
σ8.500
min84.000
max101.000
mean2823.000-2739.000=84.000
σ0.000
min2823.000-2739.000=84.000
max2823.000-2739.000=84.000
mean0.434-0.552=-0.118
σ0.304-0.556=-0.252
min0.278-0.272=0.006
max0.889-1.386=-0.496
policies=20
mean1772.045-1772.015=0.030
σ0.353-0.339=0.014
min1771.811-1771.794=0.016
max1772.569-1772.519=0.050
mean840.000
σ0.000
min840.000
max840.000
mean2823.000-2739.000=84.000
σ0.000
min2823.000-2739.000=84.000
max2823.000-2739.000=84.000
mean2.776-2.712=0.064
σ0.007-0.014=-0.007
min2.770-2.696=0.074
max2.787-2.731=0.056
policies=200
mean17727.652-17727.531=0.121
σ0.506-0.520=-0.013
min17727.321-17727.220=0.100
max17728.399-17728.303=0.096
mean8400.000
σ0.000
min8400.000
max8400.000
mean2823.000-2739.000=84.000
σ0.000
min2823.000-2739.000=84.000
max2823.000-2739.000=84.000
mean27.875-27.606=0.269
σ0.441-0.062=0.379
min27.497-27.515=-0.018
max28.389-27.648=0.741