Compare commits

Home / Compare 47bd904b .. 2b127fbf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=0.001
σ0.368-0.369=-0.001
min53.909-53.908=0.001
max55.102-55.103=-0.001
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.140-0.138=0.002
σ0.003-0.004=-0.000
min0.136-0.132=0.004
max0.145-0.145=0.000
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.005-0.006=-0.001
min43.385-43.386=-0.001
max43.401-43.402=-0.001
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.120-0.120=0.000
σ0.004-0.004=0.000
min0.114-0.115=-0.001
max0.126-0.126=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.978-1006.979=-0.000
σ0.869-0.925=-0.056
min1006.501-1006.507=-0.005
max1010.575-1010.827=-0.252
mean1046.650-1055.650=-9.000
σ314.988-306.148=8.840
min577.000-576.000=1.000
max1645.000-1457.000=188.000
mean1.538-1.568=-0.030
σ0.100-0.135=-0.036
min1.460-1.469=-0.008
max1.893-2.021=-0.127

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.002-0.003=-0.001
min0.882
max0.887
mean1645.000-1457.000=188.000
σ0.000
min1645.000-1457.000=188.000
max1645.000-1457.000=188.000
mean0.436-0.441=-0.004
σ0.131-0.126=0.005
min0.348-0.352=-0.004
max0.661-0.659=0.002
name=error_case.art
mean2.340-2.339=0.001
σ0.002-0.003=-0.000
min2.337
max2.342
mean1645.000-1457.000=188.000
σ0.000
min1645.000-1457.000=188.000
max1645.000-1457.000=188.000
mean0.876-0.886=-0.010
σ0.082-0.097=-0.015
min0.819-0.826=-0.007
max1.020-1.058=-0.039
name=heavy_item.art
mean1.523-1.524=-0.000
σ0.001-0.002=-0.001
min1.522
max1.525-1.526=-0.001
mean1645.000-1457.000=188.000
σ0.000
min1645.000-1457.000=188.000
max1645.000-1457.000=188.000
mean0.529-0.532=-0.003
σ0.048-0.051=-0.003
min0.492-0.482=0.010
max0.612-0.616=-0.005
name=nested_use.art
mean2.362-2.361=0.001
σ0.003-0.002=0.001
min2.360
max2.366-2.364=0.002
mean1645.000-1457.000=188.000
σ0.000
min1645.000-1457.000=188.000
max1645.000-1457.000=188.000
mean0.837-0.843=-0.006
σ0.042-0.040=0.001
min0.796-0.816=-0.020
max0.903-0.911=-0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.822=0.008
σ0.025-0.026=-0.001
min964.803-964.802=0.001
max964.862-964.864=-0.002
mean1645.000-1457.000=188.000
σ0.000
min1645.000-1457.000=188.000
max1645.000-1457.000=188.000
mean0.860-0.829=0.031
σ0.004-0.032=-0.028
min0.855-0.795=0.059
max0.865-0.865=-0.000
name=cdr_enhanced_4k_loc.art
mean885.515-885.511=0.004
σ0.008-0.006=0.002
min885.504
max885.525-885.518=0.007
mean1645.000-1457.000=188.000
σ0.000
min1645.000-1457.000=188.000
max1645.000-1457.000=188.000
mean0.715-0.736=-0.021
σ0.030-0.008=0.021
min0.669-0.723=-0.054
max0.747-0.745=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.002
mean1645.000-1457.000=188.000
σ0.000
min1645.000-1457.000=188.000
max1645.000-1457.000=188.000
mean4.230-3.535=0.694
σ0.093-0.084=0.009
min4.086-3.395=0.691
max4.727-3.894=0.833
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1645.000-1457.000=188.000
σ0.000
min1645.000-1457.000=188.000
max1645.000-1457.000=188.000
mean4.239-3.523=0.716
σ0.111-0.064=0.047
min3.630-3.386=0.244
max4.558-3.734=0.825
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1645.000-1457.000=188.000
σ0.000
min1645.000-1457.000=188.000
max1645.000-1457.000=188.000
mean0.750-0.540=0.211
σ0.018-0.015=0.003
min0.721-0.520=0.201
max0.862-0.638=0.224
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1645.000-1457.000=188.000
σ0.000
min1645.000-1457.000=188.000
max1645.000-1457.000=188.000
mean0.708-0.506=0.202
σ0.015-0.016=-0.001
min0.681-0.475=0.206
max0.798-0.569=0.229

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.513-295.628=-0.116
σ0.237-0.285=-0.048
min295.343-295.466=-0.124
max296.159-296.421=-0.262
mean1940.000-1905.000=35.000
σ0.000
min1940.000-1905.000=35.000
max1940.000-1905.000=35.000
mean0.568-0.583=-0.014
σ0.041-0.046=-0.005
min0.505-0.500=0.005
max0.657-0.645=0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.407-285.398=0.009
σ0.034-0.030=0.004
min285.364-285.360=0.004
max285.442-285.431=0.011
mean1645.000-1457.000=188.000
σ0.000
min1645.000-1457.000=188.000
max1645.000-1457.000=188.000
mean0.388-0.403=-0.015
σ0.009-0.005=0.004
min0.381-0.396=-0.015
max0.398-0.410=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1295.795-1295.765=0.030
σ0.104-0.069=0.035
min1295.676-1295.676=-0.000
max1295.921-1295.838=0.083
mean1645.000-1457.000=188.000
σ0.000
min1645.000-1457.000=188.000
max1645.000-1457.000=188.000
mean1.900-1.913=-0.013
σ0.089-0.102=-0.013
min1.812-1.819=-0.007
max2.016-2.048=-0.031
iters=5
new-facts=6402
prior-facts=1
mean1539.921-1539.992=-0.071
σ6.901-6.860=0.041
min1536.584-1536.776=-0.193
max1552.260-1552.261=-0.001
mean1645.000-1457.000=188.000
σ0.000
min1645.000-1457.000=188.000
max1645.000-1457.000=188.000
mean2.343-2.503=-0.159
σ0.271-0.156=0.115
min2.044-2.248=-0.204
max2.685-2.645=0.040
iters=5
new-facts=6402
prior-facts=6402
mean1857.714-1857.700=0.014
σ0.066-0.051=0.015
min1857.642-1857.654=-0.012
max1857.800-1857.774=0.026
mean1788.000-1744.600=43.400
σ147.843-171.144=-23.301
min1645.000-1505.000=140.000
max1940.000-1905.000=35.000
mean2.947-3.058=-0.111
σ0.128-0.264=-0.136
min2.828-2.869=-0.041
max3.109-3.524=-0.415

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.362-1.759=-0.398
σ0.285-0.129=0.156
min1.116-1.608=-0.492
max1.855-1.917=-0.062

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.739-445.741=-0.002
σ580.934-580.934=0.000
min155.269-155.272=-0.004
max1317.140-1317.142=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1457.000=188.000
σ0.000
min1645.000-1457.000=188.000
max1645.000-1457.000=188.000
mean0.532-0.542=-0.009
σ0.547-0.558=-0.010
min0.257-0.262=-0.005
max1.353-1.378=-0.025
policies=20
mean1552.972-1552.986=-0.013
σ0.311-0.317=-0.006
min1552.756-1552.769=-0.013
max1553.434-1553.457=-0.022
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1457.000=188.000
σ0.000
min1645.000-1457.000=188.000
max1645.000-1457.000=188.000
mean2.567-2.572=-0.005
σ0.013-0.017=-0.004
min2.554-2.557=-0.003
max2.580-2.595=-0.015
policies=200
mean15537.980-15538.060=-0.080
σ0.087-0.060=0.028
min15537.856-15538.014=-0.158
max15538.059-15538.147=-0.089
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1457.000=188.000
σ0.000
min1645.000-1457.000=188.000
max1645.000-1457.000=188.000
mean26.065-26.140=-0.075
σ0.147-0.018=0.130
min25.881-26.118=-0.237
max26.238-26.161=0.077