Compare commits

Home / Compare 000d9979 .. 2fe95a3a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.041-54.046=-0.005
σ0.370-0.367=0.003
min53.896-53.906=-0.010
max55.094-55.091=0.003
mean416.000-416.900=-0.900
σ0.000-0.316=-0.316
min416.000
max416.000-417.000=-1.000
mean0.141-0.139=0.002
σ0.004-0.003=0.000
min0.137-0.136=0.001
max0.149-0.145=0.005
cache=y
dps=1
iters=10
policies=100
mean43.384-43.384=-0.000
σ0.007-0.007=-0.001
min43.375-43.374=0.001
max43.400-43.395=0.005
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.123-0.120=0.003
σ0.003-0.006=-0.002
min0.120-0.113=0.007
max0.129-0.129=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.974-1006.982=-0.008
σ0.883-0.868=0.015
min1006.509-1006.480=0.029
max1010.636-1010.572=0.064
mean1046.900-1045.750=1.150
σ315.878-314.043=1.835
min576.000
max1644.000-1640.000=4.000
mean1.576-1.537=0.039
σ0.126-0.105=0.021
min1.472-1.379=0.093
max2.047-1.810=0.237

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.003-0.003=0.000
min0.882
max0.888-0.887=0.001
mean1644.000-1640.000=4.000
σ0.000
min1644.000-1640.000=4.000
max1644.000-1640.000=4.000
mean0.419-0.421=-0.001
σ0.142-0.142=-0.001
min0.335-0.336=-0.001
max0.670-0.674=-0.004
name=error_case.art
mean2.340-2.339=0.001
σ0.003-0.003=0.001
min2.337
max2.344-2.342=0.002
mean1644.000-1640.000=4.000
σ0.000
min1644.000-1640.000=4.000
max1644.000-1640.000=4.000
mean0.877-0.912=-0.035
σ0.089-0.076=0.013
min0.819-0.840=-0.021
max1.034-1.023=0.011
name=heavy_item.art
mean1.523-1.524=-0.000
σ0.001-0.002=-0.001
min1.522
max1.525-1.526=-0.001
mean1644.000-1640.000=4.000
σ0.000
min1644.000-1640.000=4.000
max1644.000-1640.000=4.000
mean0.525-0.535=-0.010
σ0.052-0.051=0.001
min0.488-0.500=-0.012
max0.617-0.624=-0.007
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1644.000-1640.000=4.000
σ0.000
min1644.000-1640.000=4.000
max1644.000-1640.000=4.000
mean0.862-0.841=0.021
σ0.076-0.038=0.038
min0.809-0.819=-0.011
max0.994-0.909=0.085

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.831=-0.000
σ0.027-0.026=0.001
min964.803-964.802=0.001
max964.871-964.864=0.007
mean1644.000-1640.000=4.000
σ0.000
min1644.000-1640.000=4.000
max1644.000-1640.000=4.000
mean0.805-0.792=0.013
σ0.040-0.046=-0.006
min0.756-0.718=0.038
max0.863-0.844=0.019
name=cdr_enhanced_4k_loc.art
mean885.514-885.513=0.001
σ0.005-0.005=-0.000
min885.508-885.505=0.002
max885.520-885.517=0.003
mean1644.000-1640.000=4.000
σ0.000
min1644.000-1640.000=4.000
max1644.000-1640.000=4.000
mean0.718-0.713=0.005
σ0.031-0.025=0.006
min0.668-0.679=-0.012
max0.744-0.739=0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.001
mean1644.000-1640.000=4.000
σ0.000
min1644.000-1640.000=4.000
max1644.000-1640.000=4.000
mean4.247-4.229=0.019
σ0.099-0.081=0.018
min4.090-4.059=0.031
max4.815-4.531=0.283
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1644.000-1640.000=4.000
σ0.000
min1644.000-1640.000=4.000
max1644.000-1640.000=4.000
mean4.195-4.215=-0.019
σ0.084-0.072=0.013
min4.056-4.080=-0.025
max4.482-4.403=0.079
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1644.000-1640.000=4.000
σ0.000
min1644.000-1640.000=4.000
max1644.000-1640.000=4.000
mean0.672-0.737=-0.065
σ0.093-0.020=0.072
min0.504-0.704=-0.200
max0.856-0.881=-0.025
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1644.000-1640.000=4.000
σ0.000
min1644.000-1640.000=4.000
max1644.000-1640.000=4.000
mean0.505-0.699=-0.194
σ0.026-0.020=0.006
min0.478-0.593=-0.115
max0.636-0.782=-0.146

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.526-295.579=-0.053
σ0.228-0.203=0.025
min295.383-295.385=-0.002
max296.132-296.068=0.064
mean1897.000-1911.000=-14.000
σ0.000
min1897.000-1911.000=-14.000
max1897.000-1911.000=-14.000
mean0.592-0.608=-0.016
σ0.023-0.027=-0.004
min0.560-0.584=-0.023
max0.617-0.679=-0.062

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.415-285.406=0.009
σ0.039-0.038=0.001
min285.361-285.354=0.008
max285.454-285.442=0.012
mean1644.000-1640.000=4.000
σ0.000
min1644.000-1640.000=4.000
max1644.000-1640.000=4.000
mean0.396-0.389=0.007
σ0.008-0.009=-0.000
min0.388-0.380=0.008
max0.407-0.401=0.006
iters=5
new-facts=1
prior-facts=6402
mean1295.800-1295.793=0.007
σ0.116-0.105=0.011
min1295.670-1295.675=-0.005
max1295.948-1295.918=0.030
mean1644.000-1640.000=4.000
σ0.000
min1644.000-1640.000=4.000
max1644.000-1640.000=4.000
mean1.884-1.932=-0.047
σ0.133-0.107=0.027
min1.711-1.822=-0.111
max2.018-2.053=-0.035
iters=5
new-facts=6402
prior-facts=1
mean1539.941-1539.919=0.022
σ6.878-6.877=0.000
min1536.620-1536.683=-0.063
max1552.239-1552.218=0.020
mean1644.000-1640.000=4.000
σ0.000
min1644.000-1640.000=4.000
max1644.000-1640.000=4.000
mean2.336-2.227=0.108
σ0.206-0.236=-0.030
min1.984-2.048=-0.064
max2.472-2.513=-0.041
iters=5
new-facts=6402
prior-facts=6402
mean1857.699-1857.707=-0.008
σ0.056-0.052=0.004
min1857.649-1857.656=-0.007
max1857.782-1857.779=0.003
mean1767.800-1782.400=-14.600
σ123.380-132.045=-8.664
min1644.000-1640.000=4.000
max1897.000-1911.000=-14.000
mean3.080-3.087=-0.006
σ0.248-0.276=-0.028
min2.863-2.864=-0.001
max3.499-3.558=-0.058

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.341-1.399=-0.058
σ0.244-0.296=-0.052
min1.108-1.110=-0.002
max1.755-1.816=-0.061

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.741=0.000
σ580.934-580.934=-0.000
min155.273-155.272=0.001
max1317.142-1317.142=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1640.000=4.000
σ0.000
min1644.000-1640.000=4.000
max1644.000-1640.000=4.000
mean0.554-0.529=0.025
σ0.585-0.543=0.042
min0.256-0.255=0.001
max1.431-1.343=0.087
policies=20
mean1552.991-1552.963=0.027
σ0.328-0.321=0.007
min1552.767-1552.750=0.017
max1553.478-1553.442=0.037
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1640.000=4.000
σ0.000
min1644.000-1640.000=4.000
max1644.000-1640.000=4.000
mean2.579-2.585=-0.006
σ0.024-0.011=0.013
min2.557-2.572=-0.015
max2.614-2.598=0.016
policies=200
mean15537.952-15537.969=-0.017
σ0.089-0.162=-0.073
min15537.852-15537.798=0.054
max15538.059-15538.143=-0.084
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1640.000=4.000
σ0.000
min1644.000-1640.000=4.000
max1644.000-1640.000=4.000
mean26.172-26.174=-0.002
σ0.151-0.170=-0.019
min25.984-26.057=-0.074
max26.349-26.426=-0.077