Compare commits

Home / Compare 22b3334e .. 9a71e525

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.058=-0.002
σ0.368-0.368=0.001
min53.912-53.921=-0.008
max55.104-55.104=0.000
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.137-0.142=-0.004
σ0.004-0.003=0.001
min0.131-0.140=-0.009
max0.143-0.149=-0.006
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.006-0.007=-0.000
min43.382-43.383=-0.000
max43.406-43.406=0.000
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.120-0.124=-0.004
σ0.004-0.004=0.000
min0.114-0.118=-0.004
max0.128-0.130=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.924-1006.926=-0.002
σ0.880-0.876=0.003
min1006.435-1006.429=0.006
max1010.570-1010.557=0.013
mean1048.700-1054.450=-5.750
σ309.560-315.111=-5.551
min576.000-575.000=1.000
max1640.000-1619.000=21.000
mean1.531-1.527=0.003
σ0.082-0.055=0.027
min1.448-1.467=-0.019
max1.785-1.635=0.150

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1640.000-1619.000=21.000
σ0.000
min1640.000-1619.000=21.000
max1640.000-1619.000=21.000
mean0.405-0.445=-0.040
σ0.113-0.209=-0.096
min0.338-0.325=0.013
max0.606-0.818=-0.212
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1640.000-1619.000=21.000
σ0.000
min1640.000-1619.000=21.000
max1640.000-1619.000=21.000
mean0.885-0.905=-0.020
σ0.095-0.158=-0.062
min0.819-0.802=0.016
max1.050-1.184=-0.134
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1640.000-1619.000=21.000
σ0.000
min1640.000-1619.000=21.000
max1640.000-1619.000=21.000
mean0.528-0.528=-0.000
σ0.054-0.053=0.001
min0.483-0.488=-0.005
max0.616-0.618=-0.003
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1640.000-1619.000=21.000
σ0.000
min1640.000-1619.000=21.000
max1640.000-1619.000=21.000
mean0.841-0.845=-0.004
σ0.036-0.041=-0.005
min0.813-0.818=-0.004
max0.902-0.917=-0.015

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.840=-0.001
σ0.034-0.035=-0.001
min964.811-964.811=-0.001
max964.895-964.897=-0.003
mean1640.000-1619.000=21.000
σ0.000
min1640.000-1619.000=21.000
max1640.000-1619.000=21.000
mean0.832-0.803=0.029
σ0.029-0.032=-0.002
min0.787-0.762=0.025
max0.856-0.847=0.009
name=cdr_enhanced_4k_loc.art
mean885.511-885.512=-0.001
σ0.006-0.007=-0.001
min885.504-885.506=-0.001
max885.520-885.522=-0.002
mean1640.000-1619.000=21.000
σ0.000
min1640.000-1619.000=21.000
max1640.000-1619.000=21.000
mean0.719-0.665=0.054
σ0.042-0.076=-0.034
min0.644-0.542=0.102
max0.744-0.744=-0.000

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.719
mean1640.000-1619.000=21.000
σ0.000
min1640.000-1619.000=21.000
max1640.000-1619.000=21.000
mean4.267-4.234=0.033
σ0.087-0.076=0.011
min4.109-4.104=0.005
max4.479-4.502=-0.023
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1640.000-1619.000=21.000
σ0.000
min1640.000-1619.000=21.000
max1640.000-1619.000=21.000
mean4.245-4.212=0.033
σ0.079-0.067=0.012
min4.100-4.079=0.021
max4.548-4.506=0.041
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1640.000-1619.000=21.000
σ0.000
min1640.000-1619.000=21.000
max1640.000-1619.000=21.000
mean0.742-0.729=0.013
σ0.018-0.055=-0.037
min0.712-0.520=0.192
max0.831-0.858=-0.028
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1640.000-1619.000=21.000
σ0.000
min1640.000-1619.000=21.000
max1640.000-1619.000=21.000
mean0.698-0.693=0.006
σ0.016-0.020=-0.004
min0.663-0.563=0.100
max0.775-0.724=0.051

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.470-295.526=-0.055
σ0.227-0.218=0.009
min295.315-295.347=-0.031
max296.102-296.050=0.052
mean1903.000-1905.000=-2.000
σ0.000
min1903.000-1905.000=-2.000
max1903.000-1905.000=-2.000
mean0.576-0.594=-0.019
σ0.044-0.050=-0.006
min0.504-0.515=-0.011
max0.647-0.698=-0.051

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.356-285.365=-0.009
σ0.037-0.036=0.001
min285.309-285.320=-0.011
max285.393-285.407=-0.014
mean1640.000-1619.000=21.000
σ0.000
min1640.000-1619.000=21.000
max1640.000-1619.000=21.000
mean0.388-0.392=-0.004
σ0.006-0.008=-0.001
min0.382-0.381=0.001
max0.396-0.401=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.744-1295.748=-0.004
σ0.113-0.120=-0.008
min1295.629-1295.617=0.012
max1295.885-1295.897=-0.012
mean1640.000-1619.000=21.000
σ0.000
min1640.000-1619.000=21.000
max1640.000-1619.000=21.000
mean1.901-1.936=-0.035
σ0.074-0.092=-0.018
min1.819-1.841=-0.023
max1.982-2.049=-0.067
iters=5
new-facts=6402
prior-facts=1
mean1539.837-1539.853=-0.016
σ6.815-6.816=-0.001
min1536.591-1536.647=-0.056
max1552.024-1552.042=-0.018
mean1640.000-1619.000=21.000
σ0.000
min1640.000-1619.000=21.000
max1640.000-1619.000=21.000
mean2.232-2.192=0.040
σ0.187-0.169=0.018
min2.047-2.033=0.015
max2.471-2.389=0.082
iters=5
new-facts=6402
prior-facts=6402
mean1857.649-1857.646=0.003
σ0.068-0.062=0.006
min1857.571-1857.573=-0.003
max1857.740-1857.730=0.010
mean1770.800-1773.400=-2.600
σ128.439-135.192=-6.752
min1640.000-1619.000=21.000
max1903.000-1905.000=-2.000
mean3.082-3.091=-0.009
σ0.272-0.276=-0.004
min2.881-2.872=0.010
max3.549-3.571=-0.022

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.236-1.234=0.002
σ0.339-0.397=-0.058
min0.941-0.949=-0.009
max1.806-1.905=-0.099

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.488-445.489=-0.001
σ580.640-580.641=-0.000
min155.166-155.166=0.001
max1316.449-1316.450=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1640.000-1619.000=21.000
σ0.000
min1640.000-1619.000=21.000
max1640.000-1619.000=21.000
mean0.548-0.512=0.037
σ0.571-0.504=0.067
min0.259-0.258=0.001
max1.405-1.267=0.137
policies=20
mean1551.934-1551.954=-0.020
σ0.326-0.332=-0.005
min1551.710-1551.728=-0.019
max1552.419-1552.447=-0.028
mean920.000
σ0.000
min920.000
max920.000
mean1640.000-1619.000=21.000
σ0.000
min1640.000-1619.000=21.000
max1640.000-1619.000=21.000
mean2.584-2.589=-0.005
σ0.010-0.009=0.000
min2.577-2.576=0.000
max2.598-2.598=-0.000
policies=200
mean15527.606-15527.573=0.033
σ0.075-0.090=-0.014
min15527.509-15527.451=0.058
max15527.678-15527.651=0.027
mean9200.000
σ0.000
min9200.000
max9200.000
mean1640.000-1619.000=21.000
σ0.000
min1640.000-1619.000=21.000
max1640.000-1619.000=21.000
mean26.190-26.172=0.018
σ0.154-0.180=-0.026
min26.064-26.064=-0.000
max26.407-26.441=-0.034