Compare commits

Home / Compare 81b56783 .. 68bfdd77

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-53.966=-0.003
σ0.367-0.369=-0.002
min53.819-53.822=-0.003
max55.009-55.016=-0.007
mean420.000-419.000=1.000
σ0.000
min420.000-419.000=1.000
max420.000-419.000=1.000
mean0.139-0.147=-0.008
σ0.004-0.012=-0.008
min0.134-0.135=-0.001
max0.146-0.167=-0.022
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.002
σ0.007-0.009=-0.002
min43.311-43.313=-0.003
max43.334-43.343=-0.010
mean420.000-419.000=1.000
σ0.000
min420.000-419.000=1.000
max420.000-419.000=1.000
mean0.121-0.125=-0.004
σ0.004-0.011=-0.006
min0.114-0.115=-0.001
max0.129-0.141=-0.012

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.513-1006.517=-0.005
σ1.183-1.185=-0.002
min1005.975-1005.960=0.015
max1011.453-1011.481=-0.028
mean1042.000-1049.000=-7.000
σ311.068-313.051=-1.983
min552.000-600.000=-48.000
max1510.000-1646.000=-136.000
mean1.563-1.565=-0.002
σ0.084-0.066=0.018
min1.475-1.479=-0.004
max1.831-1.731=0.100

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1510.000-1646.000=-136.000
σ0.000
min1510.000-1646.000=-136.000
max1510.000-1646.000=-136.000
mean0.418-0.414=0.004
σ0.133-0.136=-0.002
min0.340-0.333=0.007
max0.655-0.653=0.002
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1510.000-1646.000=-136.000
σ0.000
min1510.000-1646.000=-136.000
max1510.000-1646.000=-136.000
mean0.877-0.911=-0.034
σ0.097-0.108=-0.012
min0.809-0.843=-0.033
max1.046-1.102=-0.056
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1510.000-1646.000=-136.000
σ0.000
min1510.000-1646.000=-136.000
max1510.000-1646.000=-136.000
mean0.538-0.547=-0.009
σ0.052-0.043=0.009
min0.497-0.517=-0.020
max0.625-0.619=0.006
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.001=0.000
min2.360-2.360=-0.000
max2.364
mean1510.000-1646.000=-136.000
σ0.000
min1510.000-1646.000=-136.000
max1510.000-1646.000=-136.000
mean0.852-0.890=-0.038
σ0.047-0.032=0.014
min0.817-0.866=-0.049
max0.933-0.945=-0.013

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.829-964.837=-0.008
σ0.039-0.028=0.011
min964.806-964.819=-0.013
max964.897-964.887=0.010
mean1510.000-1646.000=-136.000
σ0.000
min1510.000-1646.000=-136.000
max1510.000-1646.000=-136.000
mean0.805-0.797=0.008
σ0.042-0.065=-0.022
min0.734-0.727=0.007
max0.842-0.861=-0.018
name=cdr_enhanced_4k_loc.art
mean885.510-885.510=0.001
σ0.009-0.006=0.003
min885.504
max885.525-885.519=0.006
mean1510.000-1646.000=-136.000
σ0.000
min1510.000-1646.000=-136.000
max1510.000-1646.000=-136.000
mean0.700-0.475=0.225
σ0.045-0.060=-0.015
min0.632-0.387=0.245
max0.745-0.538=0.208

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719
mean1510.000-1646.000=-136.000
σ0.000
min1510.000-1646.000=-136.000
max1510.000-1646.000=-136.000
mean4.234-1.981=2.252
σ0.085-0.068=0.017
min4.106-1.867=2.239
max4.710-2.250=2.460
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.669=0.000
mean1510.000-1646.000=-136.000
σ0.000
min1510.000-1646.000=-136.000
max1510.000-1646.000=-136.000
mean4.230-1.957=2.273
σ0.079-0.080=-0.000
min4.077-1.849=2.228
max4.529-2.529=2.000
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1510.000-1646.000=-136.000
σ0.000
min1510.000-1646.000=-136.000
max1510.000-1646.000=-136.000
mean0.747-0.303=0.444
σ0.017-0.009=0.009
min0.718-0.290=0.428
max0.864-0.349=0.515
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1510.000-1646.000=-136.000
σ0.000
min1510.000-1646.000=-136.000
max1510.000-1646.000=-136.000
mean0.706-0.288=0.418
σ0.014-0.011=0.002
min0.677-0.273=0.404
max0.779-0.360=0.419

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.429-296.482=-0.053
σ0.189-0.241=-0.052
min296.270-296.241=0.029
max296.939-297.107=-0.168
mean1898.000-1914.000=-16.000
σ0.000
min1898.000-1914.000=-16.000
max1898.000-1914.000=-16.000
mean0.598-0.580=0.019
σ0.037-0.033=0.004
min0.557-0.507=0.050
max0.693-0.611=0.082

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.029-285.026=0.003
σ0.037-0.038=-0.001
min284.981-284.975=0.006
max285.071-285.064=0.007
mean1510.000-1646.000=-136.000
σ0.000
min1510.000-1646.000=-136.000
max1510.000-1646.000=-136.000
mean0.395-0.395=0.001
σ0.006-0.009=-0.003
min0.388-0.387=0.001
max0.403-0.409=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1295.445-1295.409=0.036
σ0.061-0.109=-0.047
min1295.374-1295.282=0.092
max1295.532-1295.540=-0.008
mean1510.000-1646.000=-136.000
σ0.000
min1510.000-1646.000=-136.000
max1510.000-1646.000=-136.000
mean2.110-1.981=0.129
σ0.094-0.129=-0.034
min1.995-1.825=0.170
max2.235-2.165=0.070
iters=5
new-facts=6402
prior-facts=1
mean1539.563-1539.525=0.038
σ6.814-6.852=-0.038
min1536.329-1536.236=0.092
max1551.748-1551.777=-0.029
mean1510.000-1646.000=-136.000
σ0.000
min1510.000-1646.000=-136.000
max1510.000-1646.000=-136.000
mean2.310-2.227=0.083
σ0.241-0.191=0.051
min2.001-2.049=-0.048
max2.650-2.516=0.133
iters=5
new-facts=6402
prior-facts=6402
mean1857.329-1857.317=0.012
σ0.068-0.054=0.014
min1857.240-1857.272=-0.032
max1857.408-1857.400=0.009
mean1741.000-1774.200=-33.200
σ165.366-134.057=31.310
min1510.000-1646.000=-136.000
max1898.000-1914.000=-16.000
mean3.254-3.079=0.175
σ0.347-0.275=0.072
min2.858-2.859=-0.000
max3.617-3.556=0.061

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.534-1.267=0.267
σ0.184-0.276=-0.092
min1.254-1.065=0.188
max1.699-1.737=-0.038

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.190-448.192=-0.003
σ581.331-581.333=-0.002
min157.523-157.524=-0.001
max1320.187-1320.193=-0.006
mean96.250
σ8.500
min92.000
max109.000
mean1510.000-1646.000=-136.000
σ0.000
min1510.000-1646.000=-136.000
max1510.000-1646.000=-136.000
mean0.553-0.560=-0.007
σ0.567-0.597=-0.030
min0.266-0.260=0.006
max1.404-1.456=-0.052
policies=20
mean1575.552-1575.574=-0.022
σ0.354-0.360=-0.006
min1575.312-1575.330=-0.018
max1576.079-1576.109=-0.030
mean920.000
σ0.000
min920.000
max920.000
mean1510.000-1646.000=-136.000
σ0.000
min1510.000-1646.000=-136.000
max1510.000-1646.000=-136.000
mean2.639-2.643=-0.005
σ0.013-0.009=0.004
min2.628-2.632=-0.004
max2.656-2.654=0.001
policies=200
mean15763.749-15763.651=0.098
σ0.117-0.110=0.008
min15763.632-15763.519=0.113
max15763.904-15763.781=0.123
mean9200.000
σ0.000
min9200.000
max9200.000
mean1510.000-1646.000=-136.000
σ0.000
min1510.000-1646.000=-136.000
max1510.000-1646.000=-136.000
mean26.593-26.676=-0.083
σ0.070-0.107=-0.038
min26.502-26.595=-0.093
max26.666-26.833=-0.168