Compare commits

Home / Compare 39ba94d5 .. 0f3056be

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.704-53.728=-0.024
σ0.367-0.369=-0.002
min53.562-53.580=-0.018
max54.747-54.777=-0.030
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.139-0.137=0.002
σ0.005-0.004=0.001
min0.135-0.130=0.005
max0.149-0.142=0.007
cache=y
dps=1
iters=10
policies=100
mean43.058-43.069=-0.011
σ0.004-0.006=-0.002
min43.052-43.061=-0.009
max43.066-43.076=-0.010
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.120-0.122=-0.002
σ0.004-0.005=-0.000
min0.114-0.115=-0.001
max0.127-0.130=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.102-1005.755=-0.652
σ0.896-0.867=0.028
min1004.635-1005.256=-0.620
max1008.817-1009.337=-0.520
mean1049.900-1045.950=3.950
σ321.419-312.979=8.440
min550.000-594.000=-44.000
max1627.000-1639.000=-12.000
mean1.644-1.545=0.099
σ0.105-0.100=0.005
min1.499-1.458=0.041
max1.906-1.798=0.107

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.002-0.002=-0.000
min0.881-0.882=-0.000
max0.886-0.887=-0.001
mean1627.000-1639.000=-12.000
σ0.000
min1627.000-1639.000=-12.000
max1627.000-1639.000=-12.000
mean0.420-0.416=0.004
σ0.147-0.141=0.005
min0.338-0.323=0.014
max0.681-0.666=0.015
name=error_case.art
mean2.333-2.339=-0.006
σ0.003-0.003=0.000
min2.332-2.337=-0.005
max2.337-2.342=-0.005
mean1627.000-1639.000=-12.000
σ0.000
min1627.000-1639.000=-12.000
max1627.000-1639.000=-12.000
mean0.883-0.878=0.004
σ0.087-0.094=-0.007
min0.827-0.809=0.019
max1.036-1.039=-0.003
name=heavy_item.art
mean1.521-1.523=-0.002
σ0.002-0.001=0.001
min1.520-1.522=-0.002
max1.524-1.525=-0.001
mean1627.000-1639.000=-12.000
σ0.000
min1627.000-1639.000=-12.000
max1627.000-1639.000=-12.000
mean0.540-0.532=0.008
σ0.055-0.053=0.002
min0.495-0.493=0.002
max0.635-0.620=0.015
name=nested_use.art
mean2.355-2.362=-0.006
σ0.002-0.002=-0.000
min2.355-2.360=-0.005
max2.358-2.364=-0.005
mean1627.000-1639.000=-12.000
σ0.000
min1627.000-1639.000=-12.000
max1627.000-1639.000=-12.000
mean0.845-0.837=0.008
σ0.039-0.038=0.001
min0.802-0.811=-0.008
max0.909-0.901=0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-964.835=-1.283
σ0.025-0.032=-0.007
min963.523-964.810=-1.288
max963.585-964.889=-1.304
mean1627.000-1639.000=-12.000
σ0.000
min1627.000-1639.000=-12.000
max1627.000-1639.000=-12.000
mean0.818-0.824=-0.007
σ0.030-0.018=0.013
min0.794-0.812=-0.018
max0.852-0.855=-0.003
name=cdr_enhanced_4k_loc.art
mean884.856-885.514=-0.658
σ0.006-0.005=0.001
min884.847-885.508=-0.661
max884.862-885.520=-0.658
mean1627.000-1639.000=-12.000
σ0.000
min1627.000-1639.000=-12.000
max1627.000-1639.000=-12.000
mean0.744-0.691=0.053
σ0.007-0.046=-0.039
min0.736-0.641=0.095
max0.755-0.741=0.014

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.716=-0.010
σ0.002-0.002=-0.000
min7.705-7.715=-0.010
max7.709-7.721=-0.012
mean1627.000-1639.000=-12.000
σ0.000
min1627.000-1639.000=-12.000
max1627.000-1639.000=-12.000
mean4.240-4.217=0.023
σ0.071-0.089=-0.018
min4.110-4.072=0.037
max4.533-4.709=-0.175
name=record_render_large_syntax_err.art
mean7.655-7.665=-0.010
σ0.002
min7.654-7.664=-0.010
max7.658-7.668=-0.010
mean1627.000-1639.000=-12.000
σ0.000
min1627.000-1639.000=-12.000
max1627.000-1639.000=-12.000
mean4.219-4.210=0.009
σ0.073-0.069=0.003
min4.071-4.099=-0.028
max4.561-4.410=0.151
name=record_render_success.art
mean2.288-2.291=-0.003
σ0.002
min2.287-2.290=-0.003
max2.291-2.294=-0.003
mean1627.000-1639.000=-12.000
σ0.000
min1627.000-1639.000=-12.000
max1627.000-1639.000=-12.000
mean0.744-0.749=-0.005
σ0.027-0.017=0.010
min0.713-0.714=-0.001
max0.934-0.857=0.077
name=record_render_syntax_err.art
mean2.163-2.166=-0.002
σ0.002
min2.163-2.165=-0.002
max2.166-2.169=-0.002
mean1627.000-1639.000=-12.000
σ0.000
min1627.000-1639.000=-12.000
max1627.000-1639.000=-12.000
mean0.698-0.705=-0.007
σ0.017-0.016=0.000
min0.664-0.672=-0.008
max0.807-0.789=0.018

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.294-294.162=0.132
σ0.280-0.214=0.066
min294.107-293.976=0.132
max295.052-294.719=0.333
mean1936.000-1890.000=46.000
σ0.000
min1936.000-1890.000=46.000
max1936.000-1890.000=46.000
mean0.595-0.575=0.019
σ0.034-0.050=-0.016
min0.530-0.497=0.033
max0.641-0.663=-0.022

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.495-281.659=-0.164
σ0.033-0.041=-0.008
min281.455-281.604=-0.150
max281.534-281.702=-0.169
mean1627.000-1639.000=-12.000
σ0.000
min1627.000-1639.000=-12.000
max1627.000-1639.000=-12.000
mean0.392-0.385=0.007
σ0.006-0.009=-0.003
min0.387-0.377=0.010
max0.399-0.397=0.002
iters=5
new-facts=1
prior-facts=6402
mean1291.479-1292.084=-0.605
σ0.109-0.113=-0.004
min1291.355-1291.963=-0.608
max1291.611-1292.226=-0.615
mean1627.000-1639.000=-12.000
σ0.000
min1627.000-1639.000=-12.000
max1627.000-1639.000=-12.000
mean1.990-1.901=0.089
σ0.117-0.092=0.025
min1.813-1.811=0.002
max2.119-1.999=0.120
iters=5
new-facts=6402
prior-facts=1
mean1534.338-1536.212=-1.874
σ4.070-6.828=-2.758
min1532.269-1532.912=-0.643
max1541.609-1548.422=-6.813
mean1627.000-1639.000=-12.000
σ0.000
min1627.000-1639.000=-12.000
max1627.000-1639.000=-12.000
mean2.310-2.391=-0.080
σ0.397-0.240=0.157
min1.917-2.022=-0.105
max2.896-2.680=0.216
iters=5
new-facts=6402
prior-facts=6402
mean1853.352-1853.952=-0.600
σ0.050-0.057=-0.007
min1853.302-1853.897=-0.594
max1853.422-1854.032=-0.611
mean1789.600-1775.800=13.800
σ147.619-119.836=27.783
min1627.000-1639.000=-12.000
max1936.000-1890.000=46.000
mean3.141-2.946=0.195
σ0.338-0.156=0.182
min2.857-2.727=0.130
max3.727-3.109=0.618

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.378-1.304=0.074
σ0.198-0.257=-0.060
min1.103-1.107=-0.004
max1.636-1.737=-0.101

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.429-444.556=-2.127
σ577.064-580.935=-3.871
min153.896-154.084=-0.188
max1308.025-1315.958=-7.933
mean96.250
σ8.500
min92.000
max109.000
mean1627.000-1639.000=-12.000
σ0.000
min1627.000-1639.000=-12.000
max1627.000-1639.000=-12.000
mean0.522-0.543=-0.021
σ0.522-0.562=-0.040
min0.257-0.258=-0.001
max1.305-1.385=-0.080
policies=20
mean1539.227-1541.162=-1.936
σ0.327-0.321=0.005
min1539.003-1540.939=-1.937
max1539.712-1541.639=-1.927
mean920.000
σ0.000
min920.000
max920.000
mean1627.000-1639.000=-12.000
σ0.000
min1627.000-1639.000=-12.000
max1627.000-1639.000=-12.000
mean2.585-2.575=0.010
σ0.018-0.009=0.008
min2.563-2.565=-0.002
max2.605-2.587=0.018
policies=200
mean15400.437-15419.962=-19.525
σ0.064-0.087=-0.023
min15400.373-15419.886=-19.512
max15400.520-15420.085=-19.565
mean9200.000
σ0.000
min9200.000
max9200.000
mean1627.000-1639.000=-12.000
σ0.000
min1627.000-1639.000=-12.000
max1627.000-1639.000=-12.000
mean26.075-25.991=0.084
σ0.055-0.093=-0.038
min25.998-25.912=0.086
max26.129-26.117=0.012