Compare commits

Home / Compare 298cff29 .. 6325bb86

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-54.016=0.000
σ0.369-0.370=-0.001
min53.870-53.874=-0.003
max55.064-55.067=-0.003
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.140-0.139=0.001
σ0.004-0.003=0.001
min0.136-0.135=0.001
max0.149-0.145=0.003
cache=y
dps=1
iters=10
policies=100
mean43.322-43.321=0.001
σ0.006-0.008=-0.002
min43.311-43.312=-0.001
max43.331-43.340=-0.009
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.119-0.120=-0.001
σ0.003-0.001=0.002
min0.113-0.119=-0.006
max0.121-0.121=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.307-1006.305=0.001
σ1.180-1.224=-0.044
min1005.769-1005.772=-0.003
max1011.248-1011.441=-0.193
mean1042.000-1050.300=-8.300
σ312.329-313.210=-0.881
min594.000-597.000=-3.000
max1630.000-1646.000=-16.000
mean1.561-1.598=-0.037
σ0.095-0.145=-0.050
min1.486-1.496=-0.010
max1.845-2.059=-0.214

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean0.415-0.419=-0.003
σ0.144-0.149=-0.005
min0.311-0.325=-0.014
max0.668-0.679=-0.011
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean0.882-0.881=0.001
σ0.086-0.097=-0.011
min0.829-0.827=0.003
max1.035-1.051=-0.017
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean0.548-0.553=-0.006
σ0.047-0.048=-0.001
min0.500-0.513=-0.013
max0.626-0.635=-0.009
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean0.839-0.845=-0.007
σ0.045-0.047=-0.002
min0.806-0.814=-0.008
max0.915-0.923=-0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.115=-0.001
σ0.033-0.034=-0.001
min964.087-964.086=0.000
max964.170-964.172=-0.001
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean0.837-0.828=0.008
σ0.048-0.040=0.008
min0.752-0.776=-0.024
max0.866-0.862=0.004
name=cdr_enhanced_4k_loc.art
mean884.711-884.712=-0.001
σ0.008-0.007=0.000
min884.703-884.705=-0.001
max884.723-884.722=0.001
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean0.722-0.691=0.031
σ0.023-0.048=-0.024
min0.688-0.629=0.059
max0.739-0.743=-0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.719-7.718=0.001
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean3.505-4.297=-0.792
σ0.069-0.094=-0.025
min3.399-4.133=-0.734
max3.867-4.614=-0.747
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean3.498-4.280=-0.782
σ0.069-0.071=-0.002
min3.384-4.142=-0.759
max3.705-4.588=-0.883
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean0.733-0.739=-0.007
σ0.027-0.016=0.011
min0.696-0.710=-0.014
max0.935-0.848=0.087
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean0.696-0.705=-0.009
σ0.012-0.020=-0.007
min0.667-0.640=0.028
max0.739-0.773=-0.034

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.312-296.319=-0.007
σ0.214-0.186=0.028
min296.129-296.148=-0.019
max296.888-296.780=0.108
mean1914.000-1897.000=17.000
σ0.000
min1914.000-1897.000=17.000
max1914.000-1897.000=17.000
mean0.565-0.584=-0.019
σ0.060-0.055=0.005
min0.502-0.510=-0.008
max0.696-0.711=-0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.702-284.688=0.014
σ0.029-0.036=-0.007
min284.678-284.642=0.036
max284.740-284.729=0.011
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean0.396-0.394=0.003
σ0.011-0.008=0.003
min0.382-0.386=-0.004
max0.405-0.402=0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.075-1295.074=0.000
σ0.106-0.101=0.004
min1294.960-1294.962=-0.002
max1295.206-1295.206=-0.000
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean1.906-1.883=0.023
σ0.094-0.096=-0.003
min1.800-1.805=-0.005
max2.017-2.011=0.006
iters=5
new-facts=6402
prior-facts=1
mean1539.239-1539.205=0.034
σ6.805-6.829=-0.025
min1535.971-1535.961=0.010
max1551.406-1551.419=-0.013
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean2.380-2.150=0.230
σ0.302-0.148=0.154
min2.159-2.035=0.123
max2.897-2.398=0.500
iters=5
new-facts=6402
prior-facts=6402
mean1856.990-1856.994=-0.003
σ0.050-0.052=-0.002
min1856.943-1856.941=0.002
max1857.069-1857.066=0.003
mean1771.000-1768.400=2.600
σ138.759-122.824=15.935
min1630.000-1646.000=-16.000
max1914.000-1897.000=17.000
mean3.089-3.085=0.004
σ0.355-0.281=0.074
min2.838-2.857=-0.019
max3.717-3.562=0.154

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.232-1.208=0.024
σ0.332-0.297=0.034
min0.943-0.940=0.003
max1.786-1.681=0.105

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.784=0.002
σ581.212-581.210=0.002
min157.176-157.177=-0.001
max1319.604-1319.599=0.005
mean96.250
σ8.500
min92.000
max109.000
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean0.548-0.546=0.002
σ0.574-0.549=0.025
min0.258-0.267=-0.009
max1.409-1.370=0.039
policies=20
mean1572.108-1572.087=0.020
σ0.363-0.353=0.010
min1571.866-1571.849=0.017
max1572.648-1572.612=0.036
mean920.000
σ0.000
min920.000
max920.000
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean2.643-2.626=0.017
σ0.015-0.020=-0.005
min2.627-2.598=0.030
max2.662-2.643=0.019
policies=200
mean15728.929-15729.072=-0.142
σ0.098-0.142=-0.044
min15728.851-15728.937=-0.086
max15729.072-15729.268=-0.196
mean9200.000
σ0.000
min9200.000
max9200.000
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean26.559-26.487=0.072
σ0.051-0.060=-0.009
min26.483-26.412=0.072
max26.591-26.556=0.035