Compare commits

Home / Compare b1d96e49 .. 91597c73

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.055=0.002
σ0.368-0.368=-0.000
min53.911-53.916=-0.004
max55.104-55.103=0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.138-0.139=-0.001
σ0.003-0.004=-0.001
min0.133-0.135=-0.002
max0.144-0.147=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.001
σ0.006-0.007=-0.001
min43.386-43.385=0.001
max43.405-43.406=-0.000
mean416.000
σ0.000
min416.000
max416.000
mean0.122-0.122=0.001
σ0.004-0.003=0.001
min0.119-0.119=-0.000
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.986-1006.984=0.002
σ0.851-0.855=-0.004
min1006.482-1006.483=-0.001
max1010.485-1010.507=-0.022
mean1046.300-1047.200=-0.900
σ313.787-314.016=-0.229
min577.000
max1639.000-1645.000=-6.000
mean1.537-1.534=0.003
σ0.081-0.082=-0.002
min1.391-1.404=-0.013
max1.730-1.798=-0.068

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.001
σ0.002-0.002=-0.000
min0.882
max0.887
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.406-0.430=-0.025
σ0.100-0.144=-0.043
min0.344-0.326=0.018
max0.582-0.684=-0.101
name=error_case.art
mean2.339-2.340=-0.001
σ0.003-0.003=-0.000
min2.337
max2.342-2.343=-0.001
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.901-0.887=0.014
σ0.087-0.091=-0.004
min0.834-0.812=0.022
max1.048-1.046=0.003
name=heavy_item.art
mean1.523-1.524=-0.001
σ0.001-0.001=0.000
min1.522
max1.525
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.547-0.545=0.002
σ0.039-0.054=-0.015
min0.512-0.496=0.016
max0.613-0.632=-0.019
name=nested_use.art
mean2.362
σ0.002
min2.360
max2.364
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.850-0.865=-0.015
σ0.037-0.033=0.004
min0.809-0.843=-0.034
max0.910-0.924=-0.013

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.832=0.003
σ0.030-0.028=0.003
min964.808-964.810=-0.002
max964.886-964.876=0.010
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.784-0.808=-0.024
σ0.059-0.048=0.011
min0.694-0.748=-0.054
max0.851-0.864=-0.013
name=cdr_enhanced_4k_loc.art
mean885.515-885.514=0.001
σ0.008-0.007=0.001
min885.504
max885.522-885.520=0.002
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.718-0.686=0.032
σ0.028-0.057=-0.029
min0.672-0.608=0.063
max0.743-0.758=-0.014

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean4.247-4.233=0.014
σ0.095-0.099=-0.004
min4.097-4.098=-0.001
max4.566-4.633=-0.067
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean4.217-4.236=-0.019
σ0.078-0.077=0.000
min4.054-4.113=-0.059
max4.464-4.536=-0.071
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.749-0.747=0.002
σ0.018-0.019=-0.000
min0.720-0.685=0.035
max0.857-0.851=0.006
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.707-0.706=0.001
σ0.016-0.016=-0.000
min0.676-0.635=0.041
max0.798-0.764=0.033

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.415-295.627=-0.212
σ0.195-0.258=-0.062
min295.214-295.377=-0.163
max295.913-296.311=-0.398
mean1939.000-1913.000=26.000
σ0.000
min1939.000-1913.000=26.000
max1939.000-1913.000=26.000
mean0.579-0.575=0.004
σ0.060-0.053=0.007
min0.499-0.513=-0.014
max0.705-0.694=0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-285.406=0.004
σ0.037-0.032=0.005
min285.360-285.365=-0.005
max285.448-285.441=0.007
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.386-0.391=-0.006
σ0.006-0.009=-0.004
min0.381-0.381=0.001
max0.393-0.401=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1295.792-1295.795=-0.003
σ0.099-0.114=-0.015
min1295.678-1295.666=0.012
max1295.896-1295.947=-0.051
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean1.946-1.978=-0.032
σ0.132-0.124=0.008
min1.808-1.843=-0.035
max2.112-2.132=-0.021
iters=5
new-facts=6402
prior-facts=1
mean1539.951-1539.936=0.015
σ6.843-6.890=-0.047
min1536.722-1536.634=0.088
max1552.189-1552.255=-0.066
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean2.129-2.345=-0.216
σ0.162-0.207=-0.044
min2.007-2.102=-0.095
max2.396-2.618=-0.223
iters=5
new-facts=6402
prior-facts=6402
mean1857.712-1857.705=0.007
σ0.062-0.059=0.003
min1857.643-1857.642=0.001
max1857.789-1857.785=0.004
mean1785.400-1772.800=12.600
σ149.783-134.715=15.067
min1639.000-1645.000=-6.000
max1939.000-1913.000=26.000
mean2.939-2.971=-0.032
σ0.084-0.212=-0.128
min2.851-2.677=0.174
max3.059-3.277=-0.218

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.304-1.344=-0.040
σ0.267-0.221=0.047
min1.105-1.107=-0.002
max1.758-1.702=0.056

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.741=-0.001
σ580.935-580.934=0.001
min155.270-155.272=-0.002
max1317.143-1317.142=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.527-0.534=-0.007
σ0.528-0.549=-0.021
min0.258-0.255=0.003
max1.320-1.358=-0.039
policies=20
mean1552.997-1552.990=0.007
σ0.341-0.328=0.013
min1552.765-1552.767=-0.002
max1553.504-1553.478=0.026
mean920.000
σ0.000
min920.000
max920.000
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean2.605-2.590=0.015
σ0.050-0.024=0.026
min2.567-2.569=-0.002
max2.678-2.620=0.058
policies=200
mean15538.024-15537.931=0.093
σ0.088-0.082=0.006
min15537.922-15537.839=0.083
max15538.137-15538.012=0.125
mean9200.000
σ0.000
min9200.000
max9200.000
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean26.141-26.122=0.018
σ0.095-0.106=-0.011
min26.074-26.029=0.044
max26.280-26.272=0.008