Compare commits

Home / Compare f42612d5 .. 29c9f0ab

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.056=0.001
σ0.370-0.368=0.002
min53.910-53.910=-0.001
max55.109-55.103=0.006
mean416.000
σ0.000
min416.000
max416.000
mean0.139-0.140=-0.001
σ0.005-0.004=0.000
min0.134-0.136=-0.002
max0.147-0.147=0.001
cache=y
dps=1
iters=10
policies=100
mean43.396-43.395=0.001
σ0.006-0.005=0.000
min43.386-43.388=-0.001
max43.405-43.403=0.002
mean416.000
σ0.000
min416.000
max416.000
mean0.121-0.122=-0.001
σ0.005-0.004=0.001
min0.114-0.117=-0.003
max0.130-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.964-1006.961=0.003
σ0.858-0.876=-0.018
min1006.463-1006.462=0.000
max1010.509-1010.595=-0.086
mean1044.550-1048.650=-4.100
σ304.850-317.442=-12.593
min565.000-546.000=19.000
max1660.000-1648.000=12.000
mean1.520-1.540=-0.020
σ0.066-0.095=-0.029
min1.365-1.449=-0.085
max1.649-1.793=-0.144

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1660.000-1648.000=12.000
σ0.000
min1660.000-1648.000=12.000
max1660.000-1648.000=12.000
mean0.405-0.438=-0.033
σ0.141-0.190=-0.049
min0.333-0.331=0.002
max0.656-0.777=-0.120
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1660.000-1648.000=12.000
σ0.000
min1660.000-1648.000=12.000
max1660.000-1648.000=12.000
mean0.885-0.924=-0.040
σ0.094-0.167=-0.073
min0.831-0.821=0.010
max1.050-1.219=-0.169
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1660.000-1648.000=12.000
σ0.000
min1660.000-1648.000=12.000
max1660.000-1648.000=12.000
mean0.532-0.546=-0.014
σ0.050-0.059=-0.009
min0.503-0.509=-0.005
max0.621-0.650=-0.029
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1660.000-1648.000=12.000
σ0.000
min1660.000-1648.000=12.000
max1660.000-1648.000=12.000
mean0.851-0.853=-0.002
σ0.045-0.037=0.008
min0.814-0.822=-0.008
max0.926-0.915=0.011

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.837-964.840=-0.003
σ0.030-0.035=-0.005
min964.809-964.810=-0.001
max964.887-964.898=-0.011
mean1660.000-1648.000=12.000
σ0.000
min1660.000-1648.000=12.000
max1660.000-1648.000=12.000
mean0.835-0.831=0.004
σ0.026-0.021=0.006
min0.805-0.797=0.009
max0.858-0.849=0.008
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.006-0.007=-0.001
min885.505-885.504=0.001
max885.520-885.522=-0.002
mean1660.000-1648.000=12.000
σ0.000
min1660.000-1648.000=12.000
max1660.000-1648.000=12.000
mean0.739-0.715=0.025
σ0.015-0.025=-0.010
min0.721-0.682=0.039
max0.761-0.735=0.026

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.719
mean1660.000-1648.000=12.000
σ0.000
min1660.000-1648.000=12.000
max1660.000-1648.000=12.000
mean4.265-3.552=0.713
σ0.100-0.243=-0.143
min4.090-3.362=0.728
max4.645-4.328=0.317
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1660.000-1648.000=12.000
σ0.000
min1660.000-1648.000=12.000
max1660.000-1648.000=12.000
mean4.242-4.206=0.037
σ0.082-0.070=0.012
min4.083-4.078=0.005
max4.525-4.417=0.108
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1660.000-1648.000=12.000
σ0.000
min1660.000-1648.000=12.000
max1660.000-1648.000=12.000
mean0.737-0.733=0.004
σ0.019-0.049=-0.031
min0.702-0.523=0.179
max0.862-0.848=0.014
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1660.000-1648.000=12.000
σ0.000
min1660.000-1648.000=12.000
max1660.000-1648.000=12.000
mean0.698-0.526=0.173
σ0.014-0.061=-0.047
min0.668-0.484=0.185
max0.777-0.773=0.004

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.690-295.669=0.021
σ0.155-0.202=-0.047
min295.576-295.472=0.104
max296.090-296.136=-0.046
mean2017.000-2020.000=-3.000
σ0.000
min2017.000-2020.000=-3.000
max2017.000-2020.000=-3.000
mean0.578-0.569=0.009
σ0.027-0.037=-0.009
min0.523-0.509=0.014
max0.601-0.623=-0.022

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.395-285.376=0.019
σ0.033-0.042=-0.009
min285.353-285.315=0.038
max285.431-285.422=0.009
mean1660.000-1648.000=12.000
σ0.000
min1660.000-1648.000=12.000
max1660.000-1648.000=12.000
mean0.388-0.389=-0.000
σ0.008-0.008=0.000
min0.380-0.380=0.000
max0.398-0.397=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.783-1295.775=0.008
σ0.122-0.107=0.014
min1295.657-1295.656=0.002
max1295.942-1295.900=0.042
mean1660.000-1648.000=12.000
σ0.000
min1660.000-1648.000=12.000
max1660.000-1648.000=12.000
mean1.913-1.932=-0.019
σ0.104-0.114=-0.010
min1.793-1.811=-0.018
max2.033-2.053=-0.021
iters=5
new-facts=6402
prior-facts=1
mean1539.986-1539.902=0.084
σ6.820-6.848=-0.028
min1536.720-1536.641=0.079
max1552.180-1552.148=0.032
mean1660.000-1648.000=12.000
σ0.000
min1660.000-1648.000=12.000
max1660.000-1648.000=12.000
mean2.453-2.214=0.240
σ0.302-0.266=0.036
min2.057-2.028=0.029
max2.897-2.663=0.234
iters=5
new-facts=6402
prior-facts=6402
mean1857.679-1857.692=-0.012
σ0.068-0.062=0.005
min1857.592-1857.592=-0.001
max1857.759-1857.757=0.003
mean1788.600-1785.600=3.000
σ154.481-160.813=-6.332
min1660.000-1648.000=12.000
max2017.000-2020.000=-3.000
mean3.042-3.007=0.035
σ0.331-0.222=0.108
min2.700-2.840=-0.140
max3.536-3.313=0.223

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.235-1.209=0.026
σ0.384-0.322=0.062
min0.936-0.936=0.000
max1.888-1.746=0.142

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.706-445.705=0.001
σ580.935-580.934=0.000
min155.236-155.234=0.001
max1317.108-1317.106=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1660.000-1648.000=12.000
σ0.000
min1660.000-1648.000=12.000
max1660.000-1648.000=12.000
mean0.537-0.533=0.004
σ0.554-0.557=-0.003
min0.259-0.253=0.006
max1.368-1.369=-0.001
policies=20
mean1552.657-1552.633=0.023
σ0.319-0.318=0.002
min1552.437-1552.417=0.019
max1553.131-1553.105=0.025
mean920.000
σ0.000
min920.000
max920.000
mean1660.000-1648.000=12.000
σ0.000
min1660.000-1648.000=12.000
max1660.000-1648.000=12.000
mean2.575-2.568=0.006
σ0.009-0.020=-0.012
min2.565-2.543=0.023
max2.586-2.590=-0.005
policies=200
mean15534.653-15534.663=-0.010
σ0.165-0.114=0.050
min15534.513-15534.514=-0.001
max15534.865-15534.763=0.102
mean9200.000
σ0.000
min9200.000
max9200.000
mean1660.000-1648.000=12.000
σ0.000
min1660.000-1648.000=12.000
max1660.000-1648.000=12.000
mean26.011-25.972=0.039
σ0.235-0.132=0.103
min25.824-25.842=-0.018
max26.355-26.138=0.217