Compare commits

Home / Compare 756c95b8 .. 3b96988d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.046-54.044=0.001
σ0.369-0.367=0.002
min53.899-53.901=-0.002
max55.097-55.089=0.008
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.138-0.140=-0.002
σ0.005-0.006=-0.000
min0.131-0.132=-0.000
max0.148-0.150=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.384-43.384=-0.000
σ0.007-0.005=0.002
min43.372-43.378=-0.006
max43.395-43.392=0.003
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.124-0.121=0.003
σ0.004-0.005=-0.001
min0.121-0.115=0.006
max0.130-0.129=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.983=-0.004
σ0.870-0.884=-0.014
min1006.481-1006.481=0.000
max1010.576-1010.639=-0.063
mean1045.850-1045.100=0.750
σ307.258-306.886=0.372
min547.000-555.000=-8.000
max1602.000-1660.000=-58.000
mean1.561-1.551=0.010
σ0.095-0.113=-0.018
min1.485-1.366=0.119
max1.815-1.838=-0.022

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1602.000-1660.000=-58.000
σ0.000
min1602.000-1660.000=-58.000
max1602.000-1660.000=-58.000
mean0.454-0.437=0.017
σ0.129-0.154=-0.025
min0.360-0.345=0.015
max0.677-0.711=-0.033
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1602.000-1660.000=-58.000
σ0.000
min1602.000-1660.000=-58.000
max1602.000-1660.000=-58.000
mean0.887-0.902=-0.015
σ0.091-0.092=-0.001
min0.807-0.849=-0.043
max1.041-1.066=-0.026
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1602.000-1660.000=-58.000
σ0.000
min1602.000-1660.000=-58.000
max1602.000-1660.000=-58.000
mean0.543-0.538=0.005
σ0.055-0.044=0.011
min0.497-0.505=-0.009
max0.635-0.615=0.020
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1602.000-1660.000=-58.000
σ0.000
min1602.000-1660.000=-58.000
max1602.000-1660.000=-58.000
mean0.862-0.849=0.013
σ0.037-0.043=-0.006
min0.832-0.811=0.021
max0.923-0.919=0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.836=-0.006
σ0.037-0.031=0.006
min964.806-964.810=-0.004
max964.896-964.890=0.006
mean1602.000-1660.000=-58.000
σ0.000
min1602.000-1660.000=-58.000
max1602.000-1660.000=-58.000
mean0.827-0.822=0.006
σ0.051-0.022=0.029
min0.744-0.794=-0.050
max0.878-0.854=0.023
name=cdr_enhanced_4k_loc.art
mean885.511-885.514=-0.003
σ0.009-0.006=0.003
min885.504
max885.524-885.519=0.005
mean1602.000-1660.000=-58.000
σ0.000
min1602.000-1660.000=-58.000
max1602.000-1660.000=-58.000
mean0.716-0.713=0.003
σ0.030-0.044=-0.015
min0.672-0.635=0.037
max0.743-0.740=0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.720=0.000
mean1602.000-1660.000=-58.000
σ0.000
min1602.000-1660.000=-58.000
max1602.000-1660.000=-58.000
mean4.284-4.295=-0.011
σ0.067-0.097=-0.029
min4.168-4.114=0.054
max4.498-4.618=-0.121
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.670-7.668=0.002
mean1602.000-1660.000=-58.000
σ0.000
min1602.000-1660.000=-58.000
max1602.000-1660.000=-58.000
mean4.294-4.241=0.053
σ0.074-0.077=-0.003
min4.128-4.080=0.048
max4.506-4.474=0.032
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1602.000-1660.000=-58.000
σ0.000
min1602.000-1660.000=-58.000
max1602.000-1660.000=-58.000
mean0.753-0.749=0.003
σ0.017-0.018=-0.001
min0.718-0.717=0.001
max0.853-0.858=-0.006
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1602.000-1660.000=-58.000
σ0.000
min1602.000-1660.000=-58.000
max1602.000-1660.000=-58.000
mean0.716-0.710=0.006
σ0.018-0.014=0.004
min0.671-0.683=-0.012
max0.776-0.775=0.000

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.516-295.564=-0.048
σ0.188-0.230=-0.042
min295.354-295.384=-0.029
max296.004-296.197=-0.193
mean1910.000-1905.000=5.000
σ0.000
min1910.000-1905.000=5.000
max1910.000-1905.000=5.000
mean0.559-0.572=-0.012
σ0.049-0.055=-0.006
min0.500-0.504=-0.004
max0.614-0.674=-0.060

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.408-285.410=-0.003
σ0.036-0.041=-0.005
min285.360-285.360=-0.001
max285.442-285.452=-0.011
mean1602.000-1660.000=-58.000
σ0.000
min1602.000-1660.000=-58.000
max1602.000-1660.000=-58.000
mean0.388-0.388=-0.000
σ0.007-0.007=-0.000
min0.382-0.383=-0.001
max0.395-0.396=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.796-1295.799=-0.003
σ0.115-0.118=-0.003
min1295.682-1295.667=0.015
max1295.967-1295.937=0.030
mean1602.000-1660.000=-58.000
σ0.000
min1602.000-1660.000=-58.000
max1602.000-1660.000=-58.000
mean1.961-1.954=0.006
σ0.120-0.086=0.034
min1.862-1.850=0.012
max2.137-2.079=0.059
iters=5
new-facts=6402
prior-facts=1
mean1538.640-1538.664=-0.024
σ3.993-3.978=0.016
min1536.611-1536.639=-0.028
max1545.771-1545.769=0.002
mean1602.000-1660.000=-58.000
σ0.000
min1602.000-1660.000=-58.000
max1602.000-1660.000=-58.000
mean2.267-2.314=-0.047
σ0.202-0.211=-0.009
min2.089-2.039=0.050
max2.585-2.623=-0.038
iters=5
new-facts=6402
prior-facts=6402
mean1857.717-1857.695=0.022
σ0.055-0.051=0.004
min1857.651-1857.645=0.005
max1857.779-1857.774=0.005
mean1758.000-1774.400=-16.400
σ152.026-123.832=28.195
min1602.000-1660.000=-58.000
max1910.000-1905.000=5.000
mean3.115-2.978=0.136
σ0.345-0.093=0.251
min2.899-2.905=-0.006
max3.725-3.141=0.584

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.497-1.329=0.168
σ0.158-0.299=-0.142
min1.270-1.122=0.148
max1.677-1.845=-0.168

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.059-444.059=0.000
σ577.575-577.573=0.002
min155.269-155.271=-0.002
max1310.422-1310.419=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1602.000-1660.000=-58.000
σ0.000
min1602.000-1660.000=-58.000
max1602.000-1660.000=-58.000
mean0.533-0.540=-0.007
σ0.548-0.553=-0.005
min0.257-0.261=-0.004
max1.355-1.369=-0.014
policies=20
mean1552.992-1552.973=0.019
σ0.337-0.332=0.005
min1552.755-1552.748=0.007
max1553.492-1553.466=0.025
mean920.000
σ0.000
min920.000
max920.000
mean1602.000-1660.000=-58.000
σ0.000
min1602.000-1660.000=-58.000
max1602.000-1660.000=-58.000
mean2.602-2.592=0.009
σ0.012-0.022=-0.010
min2.590-2.560=0.030
max2.619-2.612=0.006
policies=200
mean15538.069-15538.035=0.034
σ0.089-0.107=-0.018
min15538.014-15537.904=0.111
max15538.201-15538.164=0.037
mean9200.000
σ0.000
min9200.000
max9200.000
mean1602.000-1660.000=-58.000
σ0.000
min1602.000-1660.000=-58.000
max1602.000-1660.000=-58.000
mean26.195-26.212=-0.018
σ0.048-0.065=-0.017
min26.131-26.141=-0.010
max26.247-26.299=-0.052