Compare commits

Home / Compare c08eb6a1 .. c16f3391

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.785-70.781=0.003
σ0.047-0.044=0.003
min70.757-70.753=0.004
max70.917-70.904=0.013
mean414.000
σ0.000
min414.000
max414.000
mean0.158-0.161=-0.003
σ0.004-0.003=0.000
min0.155-0.156=-0.001
max0.164-0.166=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.409-21.492=-0.083
σ0.002-0.003=-0.000
min21.405-21.487=-0.082
max21.411-21.496=-0.085
mean414.000
σ0.000
min414.000
max414.000
mean0.063-0.065=-0.002
σ0.003-0.003=0.001
min0.059-0.064=-0.005
max0.070-0.072=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.094=0.836
σ0.361-0.361=-0.000
min1754.357-1753.530=0.827
max1755.527-1754.675=0.852
mean1637.950-1664.500=-26.550
σ630.801-628.959=1.842
min627.000-669.000=-42.000
max2790.000-2616.000=174.000
mean2.842-2.844=-0.002
σ0.168-0.225=-0.057
min2.454-2.253=0.201
max3.113-3.406=-0.294

Parser: stress tests (0)

Factorcomma_sep_casesComma Sep (ms)Real World (sec)
name=ambiguous_item
mean0.001
σ0.000
min0.001
max0.001
name=ambiguous_item.art
mean0.001
σ0.000
min0.001
max0.001
name=aon_gpf25.art
mean3137.715
σ0.000
min3137.715
max3137.715
name=cdr_enhanced.art
mean3169.083
σ0.000
min3169.083
max3169.083
name=config.yaml
mean0.071
σ0.000
min0.071
max0.071
name=error_case
mean0.000
σ0.000
min0.000
max0.000
name=error_case.art
mean0.007
σ0.000
min0.007
max0.007
name=heavy_item
mean0.004
σ0.000
min0.004
max0.004
name=heavy_item.art
mean0.005
σ0.000
min0.005
max0.005
name=nested_use
mean0.000
σ0.000
min0.000
max0.000
name=nested_use.art
mean0.008
σ0.000
min0.008
max0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.754-271.954=0.800
σ0.004-0.005=-0.001
min272.751-271.949=0.801
max272.760-271.961=0.798
mean2790.000-2616.000=174.000
σ0.000
min2790.000-2616.000=174.000
max2790.000-2616.000=174.000
mean0.380-0.381=-0.001
σ0.005-0.005=0.000
min0.377-0.378=-0.000
max0.389-0.389=0.000
iters=5
new-facts=1
prior-facts=6402
mean1933.166-1932.327=0.839
σ0.016-0.010=0.006
min1933.145-1932.314=0.831
max1933.189-1932.341=0.848
mean2790.000-2616.000=174.000
σ0.000
min2790.000-2616.000=174.000
max2790.000-2616.000=174.000
mean2.914-3.059=-0.145
σ0.140-0.272=-0.132
min2.731-2.656=0.074
max3.095-3.318=-0.223
iters=5
new-facts=6402
prior-facts=1
mean4756.797-4752.945=3.852
σ7.709-0.988=6.721
min4753.007-4752.162=0.845
max4770.583-4754.675=15.909
mean2790.000-2616.000=174.000
σ0.000
min2790.000-2616.000=174.000
max2790.000-2616.000=174.000
mean8.667-8.601=0.067
σ0.435-0.433=0.002
min7.976-7.868=0.108
max9.043-8.890=0.152
iters=5
new-facts=6402
prior-facts=6402
mean4944.318-4943.489=0.828
σ0.162-0.161=0.002
min4944.029-4943.203=0.826
max4944.406-4943.571=0.835
mean3052.000-2983.800=68.200
σ331.494-274.870=56.624
min2790.000-2616.000=174.000
max3556.000-3322.000=234.000
mean8.435-8.527=-0.092
σ0.125-0.149=-0.023
min8.348-8.353=-0.005
max8.655-8.737=-0.083

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.991-1.309=-0.318
σ0.136-0.368=-0.232
min0.929-0.923=0.006
max1.235-1.867=-0.632

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean479.074-468.655=10.419
σ595.767-574.932=20.835
min181.187-181.185=0.002
max1372.725-1331.054=41.671
mean88.250
σ8.500
min84.000
max101.000
mean2790.000-2616.000=174.000
σ0.000
min2790.000-2616.000=174.000
max2790.000-2616.000=174.000
mean0.566-0.556=0.010
σ0.568-0.540=0.029
min0.280-0.284=-0.005
max1.419-1.365=0.053
policies=20
mean1812.160-1812.182=-0.022
σ0.396-0.389=0.007
min1811.906-1811.927=-0.022
max1812.749-1812.757=-0.008
mean840.000
σ0.000
min840.000
max840.000
mean2790.000-2616.000=174.000
σ0.000
min2790.000-2616.000=174.000
max2790.000-2616.000=174.000
mean2.789-2.840=-0.051
σ0.003-0.017=-0.014
min2.785-2.826=-0.042
max2.793-2.865=-0.072
policies=200
mean18129.080-18129.211=-0.131
σ0.504-0.537=-0.033
min18128.768-18128.822=-0.053
max18129.829-18130.004=-0.176
mean8400.000
σ0.000
min8400.000
max8400.000
mean2790.000-2616.000=174.000
σ0.000
min2790.000-2616.000=174.000
max2790.000-2616.000=174.000
mean28.374-28.620=-0.247
σ0.037-0.103=-0.067
min28.344-28.523=-0.179
max28.427-28.760=-0.333