Compare commits

Home / Compare 081538d3 .. 52ac541a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.704-54.030=-0.327
σ0.368-0.370=-0.001
min53.558-53.887=-0.329
max54.752-55.082=-0.331
mean416.000
σ0.000
min416.000
max416.000
mean0.138-0.136=0.001
σ0.005-0.006=-0.002
min0.130-0.130=-0.000
max0.146-0.150=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.057-43.382=-0.325
σ0.005-0.006=-0.001
min43.050-43.373=-0.323
max43.064-43.391=-0.326
mean416.000
σ0.000
min416.000
max416.000
mean0.118-0.119=-0.001
σ0.004-0.004=-0.000
min0.112-0.113=-0.001
max0.125-0.127=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.115-1006.330=-1.215
σ0.859-0.883=-0.023
min1004.609-1005.846=-1.237
max1008.651-1009.995=-1.344
mean1053.000-1049.750=3.250
σ309.828-317.891=-8.063
min571.000-546.000=25.000
max1655.000-1650.000=5.000
mean1.615-1.558=0.057
σ0.055-0.079=-0.024
min1.549-1.465=0.084
max1.738-1.792=-0.054

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.882-0.883=-0.001
σ0.002-0.003=-0.001
min0.881
max0.886-0.888=-0.003
mean1655.000-1650.000=5.000
σ0.000
min1655.000-1650.000=5.000
max1655.000-1650.000=5.000
mean0.421-0.418=0.003
σ0.135-0.128=0.007
min0.342-0.340=0.002
max0.661-0.644=0.016
name=error_case.art
mean2.334-2.335=-0.001
σ0.003-0.003=-0.000
min2.332
max2.337-2.339=-0.002
mean1655.000-1650.000=5.000
σ0.000
min1655.000-1650.000=5.000
max1655.000-1650.000=5.000
mean0.884-0.895=-0.012
σ0.089-0.082=0.007
min0.823-0.846=-0.023
max1.039-1.041=-0.002
name=heavy_item.art
mean1.521
σ0.001
min1.520
max1.523
mean1655.000-1650.000=5.000
σ0.000
min1655.000-1650.000=5.000
max1655.000-1650.000=5.000
mean0.543-0.544=-0.001
σ0.054-0.053=0.001
min0.504-0.505=-0.001
max0.636-0.635=0.000
name=nested_use.art
mean2.356
σ0.002
min2.355
max2.358
mean1655.000-1650.000=5.000
σ0.000
min1655.000-1650.000=5.000
max1655.000-1650.000=5.000
mean0.848-0.849=-0.000
σ0.032-0.045=-0.013
min0.821-0.815=0.006
max0.904-0.926=-0.022

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-963.554=-0.002
σ0.025-0.029=-0.004
min963.523
max963.583-963.596=-0.013
mean1655.000-1650.000=5.000
σ0.000
min1655.000-1650.000=5.000
max1655.000-1650.000=5.000
mean0.812-0.853=-0.041
σ0.013-0.015=-0.002
min0.794-0.828=-0.034
max0.824-0.866=-0.042
name=cdr_enhanced_4k_loc.art
mean884.857-884.857=-0.000
σ0.004-0.004=-0.000
min884.851
max884.861
mean1655.000-1650.000=5.000
σ0.000
min1655.000-1650.000=5.000
max1655.000-1650.000=5.000
mean0.717-0.677=0.040
σ0.037-0.040=-0.003
min0.673-0.640=0.033
max0.756-0.731=0.025

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=-0.000
min7.705
max7.710-7.710=-0.001
mean1655.000-1650.000=5.000
σ0.000
min1655.000-1650.000=5.000
max1655.000-1650.000=5.000
mean3.585-4.278=-0.694
σ0.101-0.087=0.013
min3.430-4.107=-0.677
max3.977-4.675=-0.698
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1655.000-1650.000=5.000
σ0.000
min1655.000-1650.000=5.000
max1655.000-1650.000=5.000
mean3.562-4.249=-0.687
σ0.090-0.074=0.015
min3.395-4.142=-0.747
max3.889-4.559=-0.670
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1655.000-1650.000=5.000
σ0.000
min1655.000-1650.000=5.000
max1655.000-1650.000=5.000
mean0.751-0.753=-0.002
σ0.018-0.027=-0.009
min0.724-0.564=0.160
max0.861-0.891=-0.030
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1655.000-1650.000=5.000
σ0.000
min1655.000-1650.000=5.000
max1655.000-1650.000=5.000
mean0.692-0.723=-0.031
σ0.070-0.017=0.053
min0.498-0.694=-0.196
max0.810-0.818=-0.008

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.245-295.512=-1.266
σ0.250-0.193=0.057
min294.037-295.313=-1.275
max294.911-296.017=-1.107
mean1935.000-1896.000=39.000
σ0.000
min1935.000-1896.000=39.000
max1935.000-1896.000=39.000
mean0.569-0.575=-0.005
σ0.048-0.047=0.001
min0.498-0.504=-0.006
max0.631-0.655=-0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.492-285.245=-3.753
σ0.037-0.039=-0.002
min281.441-285.195=-3.753
max281.534-285.286=-3.752
mean1655.000-1650.000=5.000
σ0.000
min1655.000-1650.000=5.000
max1655.000-1650.000=5.000
mean0.389-0.393=-0.004
σ0.011-0.011=0.001
min0.371-0.380=-0.009
max0.401-0.404=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1291.482-1295.193=-3.711
σ0.115-0.106=0.009
min1291.355-1295.078=-3.723
max1291.650-1295.342=-3.692
mean1655.000-1650.000=5.000
σ0.000
min1655.000-1650.000=5.000
max1655.000-1650.000=5.000
mean1.974-1.887=0.087
σ0.122-0.076=0.045
min1.825-1.802=0.023
max2.143-1.979=0.164
iters=5
new-facts=6402
prior-facts=1
mean1534.348-1538.096=-3.748
σ3.997-4.069=-0.072
min1532.343-1536.027=-3.685
max1541.492-1545.365=-3.873
mean1655.000-1650.000=5.000
σ0.000
min1655.000-1650.000=5.000
max1655.000-1650.000=5.000
mean2.170-2.336=-0.166
σ0.146-0.377=-0.231
min2.028-2.021=0.007
max2.385-2.898=-0.513
iters=5
new-facts=6402
prior-facts=6402
mean1853.349-1857.107=-3.758
σ0.054-0.051=0.003
min1853.298-1857.057=-3.759
max1853.422-1857.177=-3.755
mean1795.000-1768.200=26.800
σ139.752-121.816=17.935
min1655.000-1650.000=5.000
max1935.000-1896.000=39.000
mean3.095-3.043=0.052
σ0.419-0.190=0.229
min2.616-2.855=-0.239
max3.771-3.363=0.408

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.410-1.348=0.062
σ0.244-0.203=0.040
min1.108-1.110=-0.002
max1.789-1.659=0.130

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.427-443.608=-1.181
σ577.064-577.066=-0.001
min153.895-155.072=-1.178
max1308.024-1309.206=-1.183
mean96.250
σ8.500
min92.000
max109.000
mean1655.000-1650.000=5.000
σ0.000
min1655.000-1650.000=5.000
max1655.000-1650.000=5.000
mean0.536-0.531=0.005
σ0.556-0.547=0.009
min0.256-0.257=-0.001
max1.369-1.351=0.018
policies=20
mean1539.207-1551.027=-11.820
σ0.319-0.327=-0.009
min1538.984-1550.804=-11.819
max1539.679-1551.513=-11.834
mean920.000
σ0.000
min920.000
max920.000
mean1655.000-1650.000=5.000
σ0.000
min1655.000-1650.000=5.000
max1655.000-1650.000=5.000
mean2.575-2.587=-0.012
σ0.012-0.016=-0.004
min2.557-2.564=-0.006
max2.583-2.599=-0.016
policies=200
mean15400.371-15518.500=-118.129
σ0.104-0.083=0.021
min15400.226-15518.383=-118.157
max15400.463-15518.571=-118.109
mean9200.000
σ0.000
min9200.000
max9200.000
mean1655.000-1650.000=5.000
σ0.000
min1655.000-1650.000=5.000
max1655.000-1650.000=5.000
mean25.987-26.214=-0.227
σ0.059-0.225=-0.166
min25.902-25.996=-0.094
max26.036-26.443=-0.407