Compare commits

Home / Compare df2a9228 .. e6584365

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.055=0.002
σ0.369-0.369=0.000
min53.922-53.908=0.015
max55.106-55.103=0.003
mean418.000-419.000=-1.000
σ0.000
min418.000-419.000=-1.000
max418.000-419.000=-1.000
mean0.141-0.138=0.003
σ0.007-0.004=0.003
min0.133-0.132=0.001
max0.156-0.145=0.012
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=0.000
σ0.006-0.006=-0.001
min43.385-43.386=-0.001
max43.401-43.402=-0.001
mean418.000-419.000=-1.000
σ0.000
min418.000-419.000=-1.000
max418.000-419.000=-1.000
mean0.122-0.120=0.002
σ0.003-0.004=-0.000
min0.119-0.115=0.003
max0.128-0.126=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.980-1006.979=0.001
σ0.870-0.925=-0.055
min1006.481-1006.507=-0.026
max1010.582-1010.827=-0.245
mean1048.250-1055.650=-7.400
σ311.486-306.148=5.338
min577.000-576.000=1.000
max1650.000-1457.000=193.000
mean1.542-1.568=-0.026
σ0.096-0.135=-0.039
min1.460-1.469=-0.009
max1.791-2.021=-0.230

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.000
σ0.002-0.003=-0.000
min0.882
max0.887
mean1650.000-1457.000=193.000
σ0.000
min1650.000-1457.000=193.000
max1650.000-1457.000=193.000
mean0.445-0.441=0.005
σ0.181-0.126=0.055
min0.346-0.352=-0.005
max0.767-0.659=0.108
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1650.000-1457.000=193.000
σ0.000
min1650.000-1457.000=193.000
max1650.000-1457.000=193.000
mean0.921-0.886=0.035
σ0.155-0.097=0.057
min0.830-0.826=0.004
max1.197-1.058=0.139
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1650.000-1457.000=193.000
σ0.000
min1650.000-1457.000=193.000
max1650.000-1457.000=193.000
mean0.529-0.532=-0.003
σ0.046-0.051=-0.005
min0.494-0.482=0.012
max0.607-0.616=-0.010
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1650.000-1457.000=193.000
σ0.000
min1650.000-1457.000=193.000
max1650.000-1457.000=193.000
mean0.839-0.843=-0.004
σ0.038-0.040=-0.002
min0.802-0.816=-0.014
max0.902-0.911=-0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.822=0.012
σ0.030-0.026=0.005
min964.811-964.802=0.009
max964.886-964.864=0.022
mean1650.000-1457.000=193.000
σ0.000
min1650.000-1457.000=193.000
max1650.000-1457.000=193.000
mean0.785-0.829=-0.044
σ0.058-0.032=0.027
min0.708-0.795=-0.087
max0.864-0.865=-0.001
name=cdr_enhanced_4k_loc.art
mean885.514-885.511=0.003
σ0.009-0.006=0.002
min885.504
max885.525-885.518=0.007
mean1650.000-1457.000=193.000
σ0.000
min1650.000-1457.000=193.000
max1650.000-1457.000=193.000
mean0.710-0.736=-0.026
σ0.064-0.008=0.056
min0.598-0.723=-0.125
max0.755-0.745=0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.719=-0.000
mean1650.000-1457.000=193.000
σ0.000
min1650.000-1457.000=193.000
max1650.000-1457.000=193.000
mean4.224-3.535=0.689
σ0.070-0.084=-0.014
min4.093-3.395=0.698
max4.591-3.894=0.697
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.668
mean1650.000-1457.000=193.000
σ0.000
min1650.000-1457.000=193.000
max1650.000-1457.000=193.000
mean4.231-3.523=0.708
σ0.069-0.064=0.005
min4.106-3.386=0.720
max4.511-3.734=0.778
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1650.000-1457.000=193.000
σ0.000
min1650.000-1457.000=193.000
max1650.000-1457.000=193.000
mean0.742-0.540=0.202
σ0.025-0.015=0.009
min0.575-0.520=0.056
max0.859-0.638=0.221
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1650.000-1457.000=193.000
σ0.000
min1650.000-1457.000=193.000
max1650.000-1457.000=193.000
mean0.704-0.506=0.198
σ0.015-0.016=-0.002
min0.676-0.475=0.201
max0.802-0.569=0.233

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.572-295.628=-0.056
σ0.240-0.285=-0.045
min295.411-295.466=-0.056
max296.235-296.421=-0.187
mean2031.000-1905.000=126.000
σ0.000
min2031.000-1905.000=126.000
max2031.000-1905.000=126.000
mean0.545-0.583=-0.037
σ0.029-0.046=-0.018
min0.505-0.500=0.005
max0.574-0.645=-0.071

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-285.398=0.011
σ0.031-0.030=0.001
min285.375-285.360=0.015
max285.442-285.431=0.011
mean1650.000-1457.000=193.000
σ0.000
min1650.000-1457.000=193.000
max1650.000-1457.000=193.000
mean0.386-0.403=-0.017
σ0.007-0.005=0.002
min0.380-0.396=-0.015
max0.398-0.410=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1295.807-1295.765=0.041
σ0.111-0.069=0.043
min1295.682-1295.676=0.006
max1295.951-1295.838=0.112
mean1650.000-1457.000=193.000
σ0.000
min1650.000-1457.000=193.000
max1650.000-1457.000=193.000
mean1.893-1.913=-0.020
σ0.089-0.102=-0.013
min1.805-1.819=-0.014
max2.023-2.048=-0.024
iters=5
new-facts=6402
prior-facts=1
mean1539.915-1539.992=-0.077
σ6.882-6.860=0.023
min1536.608-1536.776=-0.168
max1552.221-1552.261=-0.039
mean1650.000-1457.000=193.000
σ0.000
min1650.000-1457.000=193.000
max1650.000-1457.000=193.000
mean2.297-2.503=-0.205
σ0.235-0.156=0.079
min2.037-2.248=-0.211
max2.587-2.645=-0.058
iters=5
new-facts=6402
prior-facts=6402
mean1857.710-1857.700=0.010
σ0.048-0.051=-0.002
min1857.660-1857.654=0.005
max1857.768-1857.774=-0.006
mean1789.200-1744.600=44.600
σ165.069-171.144=-6.075
min1650.000-1505.000=145.000
max2031.000-1905.000=126.000
mean3.037-3.058=-0.021
σ0.252-0.264=-0.012
min2.839-2.869=-0.030
max3.461-3.524=-0.062

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.305-1.759=-0.455
σ0.216-0.129=0.087
min1.107-1.608=-0.502
max1.628-1.917=-0.289

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.741=-0.001
σ580.934-580.934=0.000
min155.270-155.272=-0.002
max1317.142-1317.142=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1457.000=193.000
σ0.000
min1650.000-1457.000=193.000
max1650.000-1457.000=193.000
mean0.524-0.542=-0.017
σ0.537-0.558=-0.021
min0.254-0.262=-0.008
max1.330-1.378=-0.048
policies=20
mean1552.987-1552.986=0.001
σ0.328-0.317=0.011
min1552.761-1552.769=-0.008
max1553.474-1553.457=0.017
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1457.000=193.000
σ0.000
min1650.000-1457.000=193.000
max1650.000-1457.000=193.000
mean2.587-2.572=0.015
σ0.015-0.017=-0.002
min2.572-2.557=0.015
max2.606-2.595=0.011
policies=200
mean15537.993-15538.060=-0.067
σ0.070-0.060=0.011
min15537.897-15538.014=-0.117
max15538.064-15538.147=-0.083
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1457.000=193.000
σ0.000
min1650.000-1457.000=193.000
max1650.000-1457.000=193.000
mean26.155-26.140=0.015
σ0.190-0.018=0.173
min26.021-26.118=-0.096
max26.433-26.161=0.272