Compare commits

Home / Compare f4f79910 .. 4499503a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.728-53.728=0.001
σ0.369-0.369=0.000
min53.580-53.580=0.000
max54.777-54.777=0.001
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.137-0.134=0.003
σ0.004-0.005=-0.001
min0.130-0.128=0.001
max0.142-0.142=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.069-43.068=0.001
σ0.006-0.006=-0.000
min43.061-43.059=0.002
max43.076-43.077=-0.001
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.122-0.120=0.002
σ0.005-0.005=-0.000
min0.115-0.113=0.002
max0.130-0.127=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.755-1005.757=-0.002
σ0.867-0.871=-0.004
min1005.256-1005.258=-0.002
max1009.337-1009.362=-0.025
mean1045.950-1052.300=-6.350
σ312.979-306.407=6.572
min594.000-576.000=18.000
max1639.000-1646.000=-7.000
mean1.545-1.550=-0.005
σ0.100-0.060=0.040
min1.458-1.491=-0.033
max1.798-1.666=0.132

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.882
max0.887
mean1639.000-1646.000=-7.000
σ0.000
min1639.000-1646.000=-7.000
max1639.000-1646.000=-7.000
mean0.416-0.417=-0.000
σ0.141-0.147=-0.005
min0.323-0.338=-0.015
max0.666-0.678=-0.012
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1639.000-1646.000=-7.000
σ0.000
min1639.000-1646.000=-7.000
max1639.000-1646.000=-7.000
mean0.878-0.878=0.000
σ0.094-0.088=0.006
min0.809-0.806=0.002
max1.039-1.028=0.011
name=heavy_item.art
mean1.523
σ0.001
min1.522
max1.525
mean1639.000-1646.000=-7.000
σ0.000
min1639.000-1646.000=-7.000
max1639.000-1646.000=-7.000
mean0.532-0.542=-0.010
σ0.053-0.061=-0.008
min0.493-0.497=-0.004
max0.620-0.645=-0.025
name=nested_use.art
mean2.362-2.362=-0.001
σ0.002-0.002=-0.000
min2.360
max2.364-2.365=-0.001
mean1639.000-1646.000=-7.000
σ0.000
min1639.000-1646.000=-7.000
max1639.000-1646.000=-7.000
mean0.837-0.857=-0.020
σ0.038-0.048=-0.010
min0.811-0.818=-0.007
max0.901-0.938=-0.038

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.833=0.002
σ0.032-0.031=0.001
min964.810-964.802=0.009
max964.889-964.880=0.009
mean1639.000-1646.000=-7.000
σ0.000
min1639.000-1646.000=-7.000
max1639.000-1646.000=-7.000
mean0.824-0.823=0.001
σ0.018-0.021=-0.004
min0.812-0.802=0.010
max0.855-0.849=0.006
name=cdr_enhanced_4k_loc.art
mean885.514-885.514=0.000
σ0.005-0.004=0.000
min885.508-885.508=0.000
max885.520-885.518=0.002
mean1639.000-1646.000=-7.000
σ0.000
min1639.000-1646.000=-7.000
max1639.000-1646.000=-7.000
mean0.691-0.701=-0.010
σ0.046-0.032=0.014
min0.641-0.662=-0.020
max0.741-0.739=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.722=-0.002
mean1639.000-1646.000=-7.000
σ0.000
min1639.000-1646.000=-7.000
max1639.000-1646.000=-7.000
mean4.217-4.250=-0.033
σ0.089-0.086=0.003
min4.072-4.074=-0.002
max4.709-4.582=0.126
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1639.000-1646.000=-7.000
σ0.000
min1639.000-1646.000=-7.000
max1639.000-1646.000=-7.000
mean4.210-4.175=0.034
σ0.069-0.093=-0.023
min4.099-4.011=0.088
max4.410-4.676=-0.266
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1639.000-1646.000=-7.000
σ0.000
min1639.000-1646.000=-7.000
max1639.000-1646.000=-7.000
mean0.749-0.719=0.030
σ0.017-0.081=-0.064
min0.714-0.529=0.185
max0.857-0.933=-0.076
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1639.000-1646.000=-7.000
σ0.000
min1639.000-1646.000=-7.000
max1639.000-1646.000=-7.000
mean0.705-0.509=0.196
σ0.016-0.015=0.001
min0.672-0.489=0.183
max0.789-0.616=0.173

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.162-294.171=-0.009
σ0.214-0.230=-0.016
min293.976-294.036=-0.061
max294.719-294.807=-0.088
mean1890.000-2027.000=-137.000
σ0.000
min1890.000-2027.000=-137.000
max1890.000-2027.000=-137.000
mean0.575-0.549=0.027
σ0.050-0.033=0.017
min0.497-0.502=-0.006
max0.663-0.600=0.063

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.659-281.659=0.001
σ0.041-0.037=0.004
min281.604-281.606=-0.001
max281.702-281.698=0.004
mean1639.000-1646.000=-7.000
σ0.000
min1639.000-1646.000=-7.000
max1639.000-1646.000=-7.000
mean0.385-0.387=-0.002
σ0.009-0.011=-0.002
min0.377-0.379=-0.002
max0.397-0.406=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1292.084-1292.080=0.004
σ0.113-0.114=-0.001
min1291.963-1291.961=0.002
max1292.226-1292.258=-0.032
mean1639.000-1646.000=-7.000
σ0.000
min1639.000-1646.000=-7.000
max1639.000-1646.000=-7.000
mean1.901-1.873=0.027
σ0.092-0.095=-0.003
min1.811-1.765=0.046
max1.999-2.003=-0.004
iters=5
new-facts=6402
prior-facts=1
mean1536.212-1536.173=0.039
σ6.828-6.875=-0.047
min1532.912-1532.851=0.062
max1548.422-1548.467=-0.045
mean1639.000-1646.000=-7.000
σ0.000
min1639.000-1646.000=-7.000
max1639.000-1646.000=-7.000
mean2.391-2.196=0.195
σ0.240-0.253=-0.014
min2.022-1.934=0.088
max2.680-2.532=0.148
iters=5
new-facts=6402
prior-facts=6402
mean1853.952-1853.945=0.006
σ0.057-0.052=0.005
min1853.897-1853.897=0.000
max1854.032-1854.022=0.010
mean1775.800-1788.200=-12.400
σ119.836-169.609=-49.773
min1639.000-1646.000=-7.000
max1890.000-2027.000=-137.000
mean2.946-2.959=-0.013
σ0.156-0.227=-0.071
min2.727-2.827=-0.100
max3.109-3.356=-0.247

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.304-1.330=-0.027
σ0.257-0.269=-0.012
min1.107-1.111=-0.004
max1.737-1.794=-0.057

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.556-444.555=0.001
σ580.935-580.933=0.002
min154.084-154.087=-0.003
max1315.958-1315.955=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1639.000-1646.000=-7.000
σ0.000
min1639.000-1646.000=-7.000
max1639.000-1646.000=-7.000
mean0.543-0.517=0.026
σ0.562-0.520=0.042
min0.258-0.249=0.010
max1.385-1.297=0.089
policies=20
mean1541.162-1541.153=0.009
σ0.321-0.327=-0.005
min1540.939-1540.931=0.008
max1541.639-1541.639=0.000
mean920.000
σ0.000
min920.000
max920.000
mean1639.000-1646.000=-7.000
σ0.000
min1639.000-1646.000=-7.000
max1639.000-1646.000=-7.000
mean2.575-2.581=-0.006
σ0.009-0.009=0.000
min2.565-2.574=-0.010
max2.587-2.593=-0.007
policies=200
mean15419.962-15419.873=0.090
σ0.087-0.153=-0.067
min15419.886-15419.711=0.174
max15420.085-15420.073=0.012
mean9200.000
σ0.000
min9200.000
max9200.000
mean1639.000-1646.000=-7.000
σ0.000
min1639.000-1646.000=-7.000
max1639.000-1646.000=-7.000
mean25.991-26.074=-0.083
σ0.093-0.111=-0.018
min25.912-25.978=-0.066
max26.117-26.211=-0.094