Compare commits

Home / Compare 688ef236 .. 678e1dd5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.056=0.001
σ0.367-0.368=-0.000
min53.917-53.909=0.008
max55.102-55.102=-0.000
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.139-0.141=-0.002
σ0.003-0.005=-0.002
min0.136-0.131=0.005
max0.144-0.148=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.395-43.392=0.003
σ0.006-0.006=0.000
min43.385-43.384=0.000
max43.404-43.401=0.002
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.123-0.120=0.003
σ0.004-0.004=0.000
min0.117-0.114=0.003
max0.130-0.127=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.979=0.000
σ0.866-0.866=-0.000
min1006.505-1006.504=0.001
max1010.558-1010.563=-0.004
mean1053.650-1048.600=5.050
σ319.689-316.849=2.840
min577.000-576.000=1.000
max1621.000-1650.000=-29.000
mean1.542-1.538=0.005
σ0.124-0.138=-0.014
min1.454-1.346=0.108
max2.044-2.052=-0.008

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean0.409-0.420=-0.011
σ0.098-0.143=-0.045
min0.341-0.329=0.013
max0.581-0.673=-0.092
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean0.886-0.875=0.011
σ0.092-0.089=0.003
min0.807-0.816=-0.009
max1.044-1.031=0.013
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean0.536-0.535=0.000
σ0.057-0.064=-0.007
min0.479-0.483=-0.004
max0.625-0.643=-0.018
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean0.841-0.842=-0.002
σ0.043-0.045=-0.002
min0.809-0.809=-0.000
max0.914-0.919=-0.005

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.831=-0.001
σ0.025-0.025=-0.000
min964.803-964.802=0.001
max964.859-964.862=-0.003
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean0.814-0.817=-0.004
σ0.051-0.046=0.005
min0.734-0.748=-0.015
max0.859-0.867=-0.008
name=cdr_enhanced_4k_loc.art
mean885.513-885.513=-0.001
σ0.008-0.006=0.003
min885.504
max885.523-885.518=0.005
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean0.734-0.725=0.009
σ0.022-0.028=-0.006
min0.695-0.677=0.019
max0.749-0.746=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean4.240-4.190=0.050
σ0.087-0.103=-0.016
min4.105-4.025=0.081
max4.522-4.679=-0.156
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean4.215-4.197=0.017
σ0.085-0.131=-0.046
min4.067-4.023=0.045
max4.495-5.058=-0.563
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean0.742-0.741=0.001
σ0.016-0.032=-0.016
min0.708-0.553=0.154
max0.844-0.865=-0.021
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean0.704-0.696=0.008
σ0.013-0.018=-0.004
min0.680-0.662=0.018
max0.773-0.773=0.000

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.515-295.538=-0.023
σ0.247-0.261=-0.013
min295.327-295.377=-0.049
max296.137-296.250=-0.113
mean1941.000-2026.000=-85.000
σ0.000
min1941.000-2026.000=-85.000
max1941.000-2026.000=-85.000
mean0.587-0.553=0.034
σ0.034-0.031=0.003
min0.541-0.504=0.037
max0.657-0.593=0.064

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.404-285.395=0.009
σ0.039-0.041=-0.003
min285.361-285.335=0.026
max285.446-285.443=0.003
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean0.393-0.382=0.010
σ0.005-0.002=0.003
min0.384-0.381=0.003
max0.397-0.386=0.010
iters=5
new-facts=1
prior-facts=6402
mean1295.793-1295.792=0.001
σ0.104-0.103=0.001
min1295.673-1295.671=0.002
max1295.932-1295.913=0.020
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean1.890-1.889=0.001
σ0.084-0.101=-0.017
min1.795-1.803=-0.008
max1.969-2.055=-0.085
iters=5
new-facts=6402
prior-facts=1
mean1539.941-1539.914=0.027
σ6.859-6.854=0.005
min1536.686-1536.665=0.021
max1552.209-1552.171=0.038
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean2.132-2.217=-0.084
σ0.178-0.208=-0.030
min1.952-2.025=-0.072
max2.421-2.518=-0.097
iters=5
new-facts=6402
prior-facts=6402
mean1857.707-1857.716=-0.009
σ0.061-0.041=0.020
min1857.645-1857.675=-0.031
max1857.779-1857.775=0.005
mean1784.400-1778.000=6.400
σ154.343-165.674=-11.331
min1621.000-1650.000=-29.000
max1941.000-2026.000=-85.000
mean2.971-2.796=0.175
σ0.075-0.060=0.015
min2.882-2.716=0.166
max3.074-2.843=0.231

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.405-1.385=0.020
σ0.272-0.248=0.024
min1.105-1.249=-0.144
max1.769-1.826=-0.057

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.739=0.001
σ580.934-580.935=-0.000
min155.270-155.271=-0.001
max1317.142-1317.142=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean0.538-0.534=0.005
σ0.554-0.547=0.007
min0.259-0.254=0.005
max1.369-1.354=0.015
policies=20
mean1552.991-1552.956=0.035
σ0.330-0.296=0.033
min1552.762-1552.746=0.016
max1553.480-1553.395=0.085
mean920.000
σ0.000
min920.000
max920.000
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean2.593-2.540=0.054
σ0.019-0.077=-0.059
min2.574-2.424=0.150
max2.615-2.584=0.031
policies=200
mean15538.048-15537.977=0.071
σ0.086-0.061=0.024
min15537.935-15537.889=0.045
max15538.140-15538.021=0.119
mean9200.000
σ0.000
min9200.000
max9200.000
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean26.226-26.005=0.221
σ0.234-0.156=0.078
min26.093-25.880=0.213
max26.574-26.231=0.344