Compare commits

Home / Compare 5e6a015c .. 9423f85f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.017-54.015=0.003
σ0.371-0.370=0.001
min53.878-53.876=0.002
max55.073-55.068=0.004
mean418.000
σ0.000
min418.000
max418.000
mean0.151-0.139=0.013
σ0.012-0.004=0.008
min0.133-0.132=0.001
max0.171-0.147=0.025
cache=y
dps=1
iters=10
policies=100
mean43.326-43.322=0.004
σ0.007-0.007=-0.000
min43.318-43.313=0.005
max43.336-43.339=-0.003
mean418.000
σ0.000
min418.000
max418.000
mean0.134-0.123=0.011
σ0.011-0.004=0.007
min0.115-0.120=-0.005
max0.146-0.129=0.017

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.310-1006.308=0.002
σ1.202-1.169=0.033
min1005.778-1005.772=0.005
max1011.341-1011.188=0.153
mean1048.100-1047.800=0.300
σ312.147-313.388=-1.240
min600.000-597.000=3.000
max1636.000-1646.000=-10.000
mean1.597-1.579=0.017
σ0.099-0.087=0.012
min1.504-1.491=0.013
max1.814-1.817=-0.003

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean0.407-0.411=-0.004
σ0.133-0.133=0.000
min0.334-0.326=0.008
max0.644-0.646=-0.002
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean0.878-0.911=-0.033
σ0.092-0.151=-0.059
min0.821-0.816=0.005
max1.040-1.176=-0.136
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean0.543-0.543=0.000
σ0.056-0.049=0.006
min0.498-0.503=-0.005
max0.639-0.625=0.014
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean0.841-0.841=0.000
σ0.035-0.033=0.002
min0.812-0.805=0.007
max0.898-0.890=0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.112=0.003
σ0.033-0.022=0.010
min964.088-964.086=0.002
max964.168-964.137=0.031
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean0.818-0.813=0.005
σ0.032-0.035=-0.003
min0.783-0.759=0.024
max0.852-0.855=-0.003
name=cdr_enhanced_4k_loc.art
mean884.711-884.714=-0.002
σ0.008-0.008=-0.001
min884.703
max884.722-884.727=-0.005
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean0.715-0.715=0.000
σ0.030-0.031=-0.001
min0.676-0.666=0.010
max0.743-0.744=-0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.719=-0.001
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean4.242-4.244=-0.002
σ0.081-0.079=0.002
min4.120-4.091=0.029
max4.581-4.514=0.066
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean4.230-4.242=-0.012
σ0.071-0.068=0.003
min4.102-4.118=-0.016
max4.464-4.405=0.059
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean0.738-0.750=-0.012
σ0.018-0.018=-0.001
min0.709-0.716=-0.007
max0.855-0.864=-0.009
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean0.694-0.702=-0.008
σ0.016-0.017=-0.000
min0.668-0.670=-0.001
max0.775-0.794=-0.019

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.325-296.303=0.022
σ0.197-0.218=-0.021
min296.132-296.164=-0.033
max296.840-296.902=-0.063
mean1904.000-1907.000=-3.000
σ0.000
min1904.000-1907.000=-3.000
max1904.000-1907.000=-3.000
mean0.593-0.564=0.029
σ0.045-0.038=0.007
min0.508-0.508=0.001
max0.692-0.611=0.080

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.694-284.694=-0.001
σ0.036-0.033=0.003
min284.644-284.657=-0.013
max284.734-284.731=0.003
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean0.396-0.400=-0.004
σ0.010-0.016=-0.006
min0.384-0.385=-0.001
max0.404-0.425=-0.021
iters=5
new-facts=1
prior-facts=6402
mean1295.083-1295.087=-0.004
σ0.112-0.115=-0.003
min1294.960-1294.960=-0.000
max1295.223-1295.238=-0.015
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean1.900-1.869=0.032
σ0.065-0.071=-0.007
min1.818-1.807=0.010
max1.970-1.986=-0.017
iters=5
new-facts=6402
prior-facts=1
mean1539.185-1539.190=-0.005
σ6.838-6.866=-0.028
min1535.966-1535.942=0.024
max1551.414-1551.469=-0.055
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean2.201-2.236=-0.034
σ0.149-0.192=-0.043
min2.040-2.039=0.001
max2.366-2.500=-0.134
iters=5
new-facts=6402
prior-facts=6402
mean1856.989-1856.981=0.008
σ0.054-0.066=-0.011
min1856.934-1856.896=0.038
max1857.064-1857.057=0.007
mean1771.600-1775.200=-3.600
σ130.234-128.954=1.279
min1636.000-1646.000=-10.000
max1904.000-1907.000=-3.000
mean3.068-3.043=0.025
σ0.291-0.173=0.117
min2.824-2.859=-0.035
max3.564-3.319=0.245

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.228-1.055=0.173
σ0.323-0.134=0.188
min0.942-0.943=-0.001
max1.768-1.263=0.505

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.784=0.002
σ581.212-581.212=-0.000
min157.179-157.177=0.002
max1319.604-1319.603=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean0.553-0.548=0.005
σ0.580-0.570=0.009
min0.260-0.259=0.000
max1.422-1.403=0.019
policies=20
mean1572.106-1572.078=0.028
σ0.356-0.342=0.014
min1571.865-1571.847=0.019
max1572.635-1572.586=0.049
mean920.000
σ0.000
min920.000
max920.000
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean2.632-2.610=0.022
σ0.014-0.017=-0.004
min2.620-2.589=0.030
max2.650-2.632=0.018
policies=200
mean15729.083-15729.078=0.005
σ0.081-0.101=-0.020
min15729.016-15729.023=-0.006
max15729.193-15729.229=-0.036
mean9200.000
σ0.000
min9200.000
max9200.000
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean26.640-26.561=0.079
σ0.088-0.049=0.039
min26.568-26.488=0.080
max26.768-26.593=0.175