Compare commits

Home / Compare 1ba14222 .. 9fb9a1a1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.966-54.016=-0.049
σ0.369-0.369=0.000
min53.822-53.872=-0.051
max55.016-55.065=-0.049
mean419.000-420.000=-1.000
σ0.000
min419.000-420.000=-1.000
max419.000-420.000=-1.000
mean0.147-0.139=0.008
σ0.012-0.004=0.008
min0.135-0.136=-0.001
max0.167-0.147=0.021
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.002
σ0.009-0.007=0.002
min43.313-43.307=0.006
max43.343-43.332=0.011
mean419.000-420.000=-1.000
σ0.000
min419.000-420.000=-1.000
max419.000-420.000=-1.000
mean0.125-0.119=0.006
σ0.011-0.004=0.007
min0.115-0.114=0.001
max0.141-0.126=0.015

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.517-1006.306=0.212
σ1.185-1.175=0.010
min1005.960-1005.775=0.185
max1011.481-1011.219=0.263
mean1049.000-1048.700=0.300
σ313.051-312.161=0.891
min600.000-599.000=1.000
max1646.000-1637.000=9.000
mean1.565-1.545=0.020
σ0.066-0.108=-0.042
min1.479-1.456=0.024
max1.731-1.799=-0.068

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.866=0.018
σ0.003
min0.882-0.864=0.018
max0.887-0.869=0.018
mean1646.000-1637.000=9.000
σ0.000
min1646.000-1637.000=9.000
max1646.000-1637.000=9.000
mean0.414-0.467=-0.053
σ0.136-0.173=-0.037
min0.333-0.318=0.015
max0.653-0.660=-0.007
name=error_case.art
mean2.339-2.337=0.001
σ0.003
min2.337-2.336=0.001
max2.342-2.341=0.001
mean1646.000-1637.000=9.000
σ0.000
min1646.000-1637.000=9.000
max1646.000-1637.000=9.000
mean0.911-0.886=0.025
σ0.108-0.136=-0.028
min0.843-0.807=0.036
max1.102-1.127=-0.025
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002
min1.522-1.522=0.001
max1.526-1.526=0.001
mean1646.000-1637.000=9.000
σ0.000
min1646.000-1637.000=9.000
max1646.000-1637.000=9.000
mean0.547-0.529=0.018
σ0.043-0.054=-0.012
min0.517-0.484=0.033
max0.619-0.620=-0.001
name=nested_use.art
mean2.362-2.360=0.002
σ0.001-0.002=-0.000
min2.360-2.359=0.001
max2.364-2.363=0.001
mean1646.000-1637.000=9.000
σ0.000
min1646.000-1637.000=9.000
max1646.000-1637.000=9.000
mean0.890-0.825=0.065
σ0.032-0.037=-0.005
min0.866-0.800=0.066
max0.945-0.889=0.056

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.837-964.114=0.723
σ0.028-0.025=0.003
min964.819-964.094=0.725
max964.887-964.155=0.732
mean1646.000-1637.000=9.000
σ0.000
min1646.000-1637.000=9.000
max1646.000-1637.000=9.000
mean0.797-0.822=-0.025
σ0.065-0.035=0.030
min0.727-0.769=-0.043
max0.861-0.856=0.005
name=cdr_enhanced_4k_loc.art
mean885.510-884.712=0.798
σ0.006-0.007=-0.001
min885.504-884.705=0.799
max885.519-884.721=0.798
mean1646.000-1637.000=9.000
σ0.000
min1646.000-1637.000=9.000
max1646.000-1637.000=9.000
mean0.475-0.715=-0.240
σ0.060-0.030=0.030
min0.387-0.675=-0.288
max0.538-0.740=-0.202

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.715=0.002
σ0.002-0.002=-0.000
min7.715-7.714=0.002
max7.719-7.720=-0.001
mean1646.000-1637.000=9.000
σ0.000
min1646.000-1637.000=9.000
max1646.000-1637.000=9.000
mean1.981-4.199=-2.218
σ0.068-0.139=-0.071
min1.867-3.574=-1.706
max2.250-4.573=-2.322
name=record_render_large_syntax_err.art
mean7.665-7.663=0.002
σ0.002-0.002=0.000
min7.664-7.662=0.002
max7.669-7.666=0.003
mean1646.000-1637.000=9.000
σ0.000
min1646.000-1637.000=9.000
max1646.000-1637.000=9.000
mean1.957-4.232=-2.275
σ0.080-0.080=-0.001
min1.849-4.093=-2.244
max2.529-4.493=-1.964
name=record_render_success.art
mean2.291-2.289=0.001
σ0.002
min2.290-2.289=0.001
max2.294-2.292=0.001
mean1646.000-1637.000=9.000
σ0.000
min1646.000-1637.000=9.000
max1646.000-1637.000=9.000
mean0.303-0.735=-0.432
σ0.009-0.016=-0.007
min0.290-0.702=-0.412
max0.349-0.839=-0.490
name=record_render_syntax_err.art
mean2.166-2.165=0.001
σ0.002
min2.165-2.164=0.001
max2.169-2.168=0.001
mean1646.000-1637.000=9.000
σ0.000
min1646.000-1637.000=9.000
max1646.000-1637.000=9.000
mean0.288-0.693=-0.405
σ0.011-0.017=-0.006
min0.273-0.654=-0.381
max0.360-0.778=-0.419

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.482-296.208=0.274
σ0.241-0.210=0.031
min296.241-296.022=0.219
max297.107-296.775=0.332
mean1914.000-1910.000=4.000
σ0.000
min1914.000-1910.000=4.000
max1914.000-1910.000=4.000
mean0.580-0.573=0.007
σ0.033-0.054=-0.021
min0.507-0.500=0.007
max0.611-0.673=-0.063

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.026-284.699=0.327
σ0.038-0.036=0.002
min284.975-284.655=0.320
max285.064-284.741=0.323
mean1646.000-1637.000=9.000
σ0.000
min1646.000-1637.000=9.000
max1646.000-1637.000=9.000
mean0.395-0.396=-0.001
σ0.009-0.011=-0.002
min0.387-0.384=0.003
max0.409-0.407=0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.409-1295.084=0.325
σ0.109-0.116=-0.007
min1295.282-1294.963=0.319
max1295.540-1295.224=0.316
mean1646.000-1637.000=9.000
σ0.000
min1646.000-1637.000=9.000
max1646.000-1637.000=9.000
mean1.981-1.865=0.116
σ0.129-0.075=0.054
min1.825-1.795=0.029
max2.165-1.969=0.196
iters=5
new-facts=6402
prior-facts=1
mean1539.525-1539.191=0.334
σ6.852-6.852=-0.001
min1536.236-1535.966=0.270
max1551.777-1551.446=0.330
mean1646.000-1637.000=9.000
σ0.000
min1646.000-1637.000=9.000
max1646.000-1637.000=9.000
mean2.227-2.186=0.041
σ0.191-0.173=0.018
min2.049-2.008=0.041
max2.516-2.411=0.105
iters=5
new-facts=6402
prior-facts=6402
mean1857.317-1856.981=0.336
σ0.054-0.065=-0.011
min1857.272-1856.902=0.370
max1857.400-1857.075=0.325
mean1774.200-1776.000=-1.800
σ134.057-131.809=2.248
min1646.000-1637.000=9.000
max1914.000-1910.000=4.000
mean3.079-3.049=0.030
σ0.275-0.324=-0.049
min2.859-2.810=0.048
max3.556-3.607=-0.051

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.267-1.201=0.066
σ0.276-0.367=-0.090
min1.065-0.921=0.144
max1.737-1.809=-0.072

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.192-447.785=0.407
σ581.333-581.213=0.121
min157.524-157.176=0.347
max1320.193-1319.604=0.588
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1637.000=9.000
σ0.000
min1646.000-1637.000=9.000
max1646.000-1637.000=9.000
mean0.560-0.522=0.039
σ0.597-0.521=0.076
min0.260-0.259=0.001
max1.456-1.303=0.152
policies=20
mean1575.574-1572.095=3.479
σ0.360-0.340=0.019
min1575.330-1571.864=3.467
max1576.109-1572.601=3.508
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1637.000=9.000
σ0.000
min1646.000-1637.000=9.000
max1646.000-1637.000=9.000
mean2.643-2.611=0.032
σ0.009-0.029=-0.020
min2.632-2.573=0.059
max2.654-2.643=0.011
policies=200
mean15763.651-15729.067=34.584
σ0.110-0.078=0.032
min15763.519-15729.010=34.508
max15763.781-15729.180=34.601
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1637.000=9.000
σ0.000
min1646.000-1637.000=9.000
max1646.000-1637.000=9.000
mean26.676-26.490=0.186
σ0.107-0.171=-0.064
min26.595-26.381=0.214
max26.833-26.745=0.088