Compare commits

Home / Compare fa536d78 .. c08eb6a1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.782=-0.001
σ0.044-0.044=0.000
min70.753-70.754=-0.001
max70.904-70.905=-0.001
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.161-0.161=0.000
σ0.003-0.003=0.000
min0.156-0.157=-0.001
max0.166-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.492-21.494=-0.002
σ0.003-0.002=0.001
min21.487-21.490=-0.003
max21.496-21.496=0.001
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.065-0.066=-0.001
σ0.003-0.002=0.001
min0.064-0.064=-0.001
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1754.096=-0.001
σ0.361-0.361=-0.000
min1753.530-1753.520=0.009
max1754.675-1754.681=-0.005
mean1664.500-1664.400=0.100
σ628.959-636.374=-7.415
min669.000-630.000=39.000
max2616.000-2783.000=-167.000
mean2.844-2.831=0.013
σ0.225-0.112=0.114
min2.253-2.535=-0.282
max3.406-2.995=0.411

Parser: stress tests (0)

Factorcomma_sep_cases
name=ambiguous_item
mean0.001-0.001=0.000
σ0.000
min0.001-0.001=0.000
max0.001-0.001=0.000
name=error_case
mean0.000-0.000=0.000
σ0.000
min0.000-0.000=0.000
max0.000-0.000=0.000
name=heavy_item
mean0.004-0.004=-0.000
σ0.000
min0.004-0.004=-0.000
max0.004-0.004=-0.000
name=nested_use
mean0.000-0.000=0.000
σ0.000
min0.000-0.000=0.000
max0.000-0.000=0.000

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.954-271.957=-0.003
σ0.005-0.007=-0.002
min271.949-271.947=0.002
max271.961-271.965=-0.003
mean2616.000-2783.000=-167.000
σ0.000
min2616.000-2783.000=-167.000
max2616.000-2783.000=-167.000
mean0.381-0.390=-0.009
σ0.005-0.010=-0.005
min0.378-0.381=-0.003
max0.389-0.401=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1932.327-1932.329=-0.002
σ0.010-0.006=0.004
min1932.314-1932.322=-0.008
max1932.341-1932.338=0.003
mean2616.000-2783.000=-167.000
σ0.000
min2616.000-2783.000=-167.000
max2616.000-2783.000=-167.000
mean3.059-2.909=0.150
σ0.272-0.159=0.113
min2.656-2.733=-0.076
max3.318-3.070=0.248
iters=5
new-facts=6402
prior-facts=1
mean4752.945-4752.993=-0.048
σ0.988-0.609=0.379
min4752.162-4752.655=-0.493
max4754.675-4754.073=0.602
mean2616.000-2783.000=-167.000
σ0.000
min2616.000-2783.000=-167.000
max2616.000-2783.000=-167.000
mean8.601-8.433=0.167
σ0.433-0.516=-0.083
min7.868-7.574=0.294
max8.890-8.948=-0.057
iters=5
new-facts=6402
prior-facts=6402
mean4943.489-4943.421=0.069
σ0.161-0.183=-0.022
min4943.203-4943.221=-0.018
max4943.571-4943.581=-0.010
mean2983.800-3005.000=-21.200
σ274.870-281.948=-7.077
min2616.000-2783.000=-167.000
max3322.000-3441.000=-119.000
mean8.527-8.553=-0.026
σ0.149-0.335=-0.186
min8.353-8.281=0.072
max8.737-9.037=-0.299

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.309-1.077=0.233
σ0.368-0.115=0.253
min0.923-0.928=-0.004
max1.867-1.251=0.616

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.655-468.668=-0.013
σ574.932-574.936=-0.003
min181.185-181.193=-0.008
max1331.054-1331.072=-0.018
mean88.250
σ8.500
min84.000
max101.000
mean2616.000-2783.000=-167.000
σ0.000
min2616.000-2783.000=-167.000
max2616.000-2783.000=-167.000
mean0.556-0.451=0.105
σ0.540-0.303=0.236
min0.284-0.299=-0.014
max1.365-0.906=0.459
policies=20
mean1812.182-1812.243=-0.060
σ0.389-0.374=0.015
min1811.927-1811.970=-0.043
max1812.757-1812.784=-0.027
mean840.000
σ0.000
min840.000
max840.000
mean2616.000-2783.000=-167.000
σ0.000
min2616.000-2783.000=-167.000
max2616.000-2783.000=-167.000
mean2.840-2.931=-0.091
σ0.017-0.092=-0.075
min2.826-2.837=-0.011
max2.865-3.058=-0.193
policies=200
mean18129.211-18129.048=0.163
σ0.537-0.512=0.025
min18128.822-18128.664=0.158
max18130.004-18129.793=0.211
mean8400.000
σ0.000
min8400.000
max8400.000
mean2616.000-2783.000=-167.000
σ0.000
min2616.000-2783.000=-167.000
max2616.000-2783.000=-167.000
mean28.620-28.516=0.104
σ0.103-0.078=0.025
min28.523-28.409=0.113
max28.760-28.591=0.169