Compare commits

Home / Compare 64834fb9 .. df8044a0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.045-54.047=-0.002
σ0.369-0.370=-0.001
min53.901-53.907=-0.006
max55.095-55.100=-0.005
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.138-0.140=-0.002
σ0.006-0.004=0.002
min0.131-0.136=-0.005
max0.147-0.147=0.000
cache=y
dps=1
iters=10
policies=100
mean43.383-43.384=-0.000
σ0.005-0.006=-0.001
min43.375-43.372=0.003
max43.390-43.392=-0.002
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.124-0.122=0.002
σ0.004-0.005=-0.001
min0.120-0.115=0.004
max0.129-0.129=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.978-1006.980=-0.002
σ0.880-0.869=0.011
min1006.484-1006.483=0.001
max1010.628-1010.578=0.051
mean1054.400-1050.450=3.950
σ315.195-307.541=7.654
min574.000-556.000=18.000
max1618.000-1645.000=-27.000
mean1.531-1.571=-0.040
σ0.053-0.097=-0.043
min1.424-1.486=-0.062
max1.619-1.837=-0.218

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.001
σ0.003-0.002=0.000
min0.882
max0.887
mean1618.000-1645.000=-27.000
σ0.000
min1618.000-1645.000=-27.000
max1618.000-1645.000=-27.000
mean0.416-0.409=0.007
σ0.136-0.133=0.004
min0.337-0.331=0.006
max0.656-0.643=0.013
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.003=0.000
min2.337
max2.342
mean1618.000-1645.000=-27.000
σ0.000
min1618.000-1645.000=-27.000
max1618.000-1645.000=-27.000
mean0.878-0.863=0.015
σ0.093-0.081=0.012
min0.806-0.819=-0.013
max1.039-1.007=0.032
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002-0.001=0.001
min1.522
max1.526-1.525=0.001
mean1618.000-1645.000=-27.000
σ0.000
min1618.000-1645.000=-27.000
max1618.000-1645.000=-27.000
mean0.537-0.530=0.007
σ0.042-0.044=-0.002
min0.510-0.500=0.011
max0.608-0.608=0.000
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1618.000-1645.000=-27.000
σ0.000
min1618.000-1645.000=-27.000
max1618.000-1645.000=-27.000
mean0.841-0.837=0.004
σ0.051-0.048=0.003
min0.797-0.800=-0.003
max0.926-0.920=0.006

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.835=0.000
σ0.034-0.031=0.003
min964.802-964.810=-0.008
max964.889-964.887=0.002
mean1618.000-1645.000=-27.000
σ0.000
min1618.000-1645.000=-27.000
max1618.000-1645.000=-27.000
mean0.825-0.833=-0.008
σ0.016-0.024=-0.009
min0.816-0.805=0.011
max0.853-0.853=0.000
name=cdr_enhanced_4k_loc.art
mean885.513-885.514=-0.001
σ0.008-0.004=0.004
min885.504-885.508=-0.004
max885.522-885.518=0.005
mean1618.000-1645.000=-27.000
σ0.000
min1618.000-1645.000=-27.000
max1618.000-1645.000=-27.000
mean0.736-0.708=0.028
σ0.006-0.027=-0.021
min0.729-0.677=0.052
max0.743-0.738=0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1618.000-1645.000=-27.000
σ0.000
min1618.000-1645.000=-27.000
max1618.000-1645.000=-27.000
mean4.256-4.215=0.041
σ0.138-0.075=0.063
min4.082-4.082=-0.001
max5.206-4.523=0.683
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1618.000-1645.000=-27.000
σ0.000
min1618.000-1645.000=-27.000
max1618.000-1645.000=-27.000
mean4.235-4.231=0.004
σ0.085-0.076=0.009
min4.062-4.107=-0.044
max4.496-4.527=-0.031
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1618.000-1645.000=-27.000
σ0.000
min1618.000-1645.000=-27.000
max1618.000-1645.000=-27.000
mean0.734-0.724=0.010
σ0.019-0.048=-0.030
min0.701-0.519=0.181
max0.856-0.865=-0.009
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1618.000-1645.000=-27.000
σ0.000
min1618.000-1645.000=-27.000
max1618.000-1645.000=-27.000
mean0.700-0.690=0.010
σ0.019-0.016=0.003
min0.605-0.657=-0.052
max0.773-0.768=0.006

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.555-295.570=-0.015
σ0.254-0.225=0.029
min295.308-295.422=-0.115
max296.240-296.195=0.045
mean1965.000-1916.000=49.000
σ0.000
min1965.000-1916.000=49.000
max1965.000-1916.000=49.000
mean0.537-0.556=-0.018
σ0.031-0.042=-0.011
min0.502-0.501=0.000
max0.579-0.610=-0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.408-285.415=-0.007
σ0.037-0.036=0.001
min285.357-285.367=-0.010
max285.444-285.454=-0.010
mean1618.000-1645.000=-27.000
σ0.000
min1618.000-1645.000=-27.000
max1618.000-1645.000=-27.000
mean0.387-0.387=0.000
σ0.009-0.008=0.001
min0.380-0.381=-0.000
max0.403-0.397=0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.794-1295.800=-0.006
σ0.103-0.119=-0.016
min1295.676-1295.663=0.013
max1295.912-1295.945=-0.033
mean1618.000-1645.000=-27.000
σ0.000
min1618.000-1645.000=-27.000
max1618.000-1645.000=-27.000
mean1.903-2.007=-0.104
σ0.090-0.277=-0.187
min1.818-1.818=0.000
max2.049-2.489=-0.440
iters=5
new-facts=6402
prior-facts=1
mean1539.929-1539.968=-0.039
σ6.883-6.843=0.039
min1536.581-1536.660=-0.079
max1552.236-1552.205=0.032
mean1618.000-1645.000=-27.000
σ0.000
min1618.000-1645.000=-27.000
max1618.000-1645.000=-27.000
mean2.274-2.398=-0.124
σ0.247-0.235=0.012
min2.044-2.005=0.039
max2.683-2.631=0.052
iters=5
new-facts=6402
prior-facts=6402
mean1857.709-1857.720=-0.011
σ0.057-0.045=0.012
min1857.632-1857.656=-0.023
max1857.774-1857.777=-0.002
mean1765.200-1776.800=-11.600
σ140.484-134.717=5.767
min1618.000-1645.000=-27.000
max1965.000-1916.000=49.000
mean2.941-3.082=-0.141
σ0.086-0.240=-0.155
min2.836-2.863=-0.027
max3.070-3.475=-0.405

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.344-1.303=0.041
σ0.257-0.278=-0.022
min1.102-1.106=-0.004
max1.651-1.782=-0.131

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.739-445.741=-0.002
σ580.934-580.934=-0.001
min155.271-155.272=-0.001
max1317.139-1317.142=-0.003
mean96.250
σ8.500
min92.000
max109.000
mean1618.000-1645.000=-27.000
σ0.000
min1618.000-1645.000=-27.000
max1618.000-1645.000=-27.000
mean0.534-0.553=-0.019
σ0.555-0.581=-0.026
min0.256-0.259=-0.003
max1.367-1.425=-0.058
policies=20
mean1552.973-1552.993=-0.020
σ0.331-0.330=0.000
min1552.750-1552.768=-0.019
max1553.465-1553.484=-0.020
mean920.000
σ0.000
min920.000
max920.000
mean1618.000-1645.000=-27.000
σ0.000
min1618.000-1645.000=-27.000
max1618.000-1645.000=-27.000
mean2.588-2.586=0.002
σ0.027-0.015=0.012
min2.558-2.572=-0.013
max2.617-2.607=0.011
policies=200
mean15537.979-15538.051=-0.072
σ0.137-0.064=0.073
min15537.854-15537.981=-0.127
max15538.119-15538.115=0.004
mean9200.000
σ0.000
min9200.000
max9200.000
mean1618.000-1645.000=-27.000
σ0.000
min1618.000-1645.000=-27.000
max1618.000-1645.000=-27.000
mean26.192-26.266=-0.074
σ0.070-0.184=-0.115
min26.133-26.090=0.043
max26.283-26.490=-0.208