Compare commits

Home / Compare e424fb28 .. 638c1216

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.046-54.046=0.000
σ0.370-0.368=0.002
min53.903-53.899=0.004
max55.097-55.093=0.005
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.139-0.137=0.002
σ0.003-0.003=0.000
min0.135-0.133=0.002
max0.144-0.142=0.002
cache=y
dps=1
iters=10
policies=100
mean43.383-43.384=-0.001
σ0.006-0.006=0.000
min43.373-43.375=-0.001
max43.395-43.392=0.003
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.122-0.125=-0.002
σ0.004-0.005=-0.001
min0.119-0.119=-0.001
max0.129-0.133=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.976-1006.977=-0.002
σ0.939-0.876=0.062
min1006.507-1006.512=-0.005
max1010.880-1010.613=0.267
mean1050.350-1045.300=5.050
σ307.919-314.261=-6.343
min575.000
max1642.000-1639.000=3.000
mean1.575-1.584=-0.009
σ0.161-0.145=0.016
min1.447-1.476=-0.029
max2.135-2.073=0.062

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.001
σ0.003-0.002=0.000
min0.882
max0.887
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean0.410-0.413=-0.003
σ0.133-0.139=-0.006
min0.334-0.326=0.008
max0.647-0.658=-0.011
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.003=0.000
min2.337
max2.342
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean0.870-1.079=-0.209
σ0.080-0.321=-0.241
min0.812-0.836=-0.024
max1.005-1.636=-0.631
name=heavy_item.art
mean1.524-1.524=0.000
σ0.002-0.002=-0.000
min1.522
max1.526-1.527=-0.001
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean0.532-0.623=-0.091
σ0.046-0.173=-0.127
min0.496-0.522=-0.026
max0.608-0.931=-0.323
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean0.841-0.907=-0.066
σ0.052-0.098=-0.046
min0.794-0.811=-0.017
max0.925-1.038=-0.113

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.828-964.831=-0.002
σ0.025-0.026=-0.000
min964.802
max964.869-964.864=0.005
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean0.765-0.832=-0.067
σ0.030-0.022=0.009
min0.726-0.815=-0.089
max0.796-0.861=-0.065
name=cdr_enhanced_4k_loc.art
mean885.513-885.514=-0.002
σ0.008-0.004=0.005
min885.504-885.509=-0.005
max885.522-885.518=0.005
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean0.738-0.737=0.001
σ0.006-0.010=-0.004
min0.728-0.719=0.009
max0.743-0.745=-0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.720=0.000
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean4.202-4.197=0.006
σ0.071-0.080=-0.009
min4.074-4.064=0.009
max4.529-4.467=0.062
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean4.167-4.161=0.005
σ0.065-0.069=-0.003
min4.037-4.028=0.009
max4.376-4.345=0.030
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean0.729-0.731=-0.002
σ0.021-0.020=0.001
min0.693-0.697=-0.004
max0.858-0.865=-0.006
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean0.627-0.694=-0.067
σ0.092-0.016=0.076
min0.480-0.668=-0.188
max0.787-0.776=0.011

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.364-295.545=-0.181
σ0.218-0.282=-0.064
min295.250-295.298=-0.048
max295.976-296.304=-0.327
mean2057.000-1913.000=144.000
σ0.000
min2057.000-1913.000=144.000
max2057.000-1913.000=144.000
mean0.548-0.575=-0.028
σ0.039-0.054=-0.015
min0.500-0.500=-0.000
max0.592-0.692=-0.100

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-285.385=0.024
σ0.036-0.036=0.000
min285.363-285.341=0.022
max285.446-285.426=0.020
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean0.393-0.388=0.005
σ0.007-0.005=0.002
min0.386-0.382=0.004
max0.402-0.394=0.008
iters=5
new-facts=1
prior-facts=6402
mean1295.798-1295.797=0.001
σ0.109-0.102=0.007
min1295.680-1295.679=0.001
max1295.942-1295.931=0.011
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean1.908-1.920=-0.013
σ0.093-0.039=0.053
min1.805-1.866=-0.061
max2.021-1.961=0.059
iters=5
new-facts=6402
prior-facts=1
mean1539.938-1539.923=0.016
σ6.876-6.888=-0.012
min1536.623-1536.621=0.003
max1552.232-1552.239=-0.006
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean2.318-2.307=0.011
σ0.189-0.218=-0.029
min2.092-2.090=0.002
max2.549-2.593=-0.043
iters=5
new-facts=6402
prior-facts=6402
mean1857.696-1857.702=-0.006
σ0.064-0.054=0.010
min1857.623-1857.657=-0.034
max1857.774-1857.783=-0.008
mean1796.000-1773.000=23.000
σ179.570-137.164=42.406
min1642.000-1639.000=3.000
max2057.000-1913.000=144.000
mean2.982-3.038=-0.055
σ0.118-0.247=-0.129
min2.863-2.850=0.013
max3.148-3.471=-0.324

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.493-1.344=0.149
σ0.242-0.256=-0.014
min1.267-1.110=0.157
max1.853-1.783=0.070

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.739=0.002
σ580.934-580.934=-0.000
min155.272-155.271=0.001
max1317.142-1317.140=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean0.532-0.524=0.008
σ0.561-0.531=0.030
min0.246-0.257=-0.011
max1.374-1.320=0.053
policies=20
mean1552.986-1552.975=0.012
σ0.321-0.326=-0.005
min1552.766-1552.750=0.015
max1553.464-1553.459=0.005
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean2.582-2.588=-0.006
σ0.026-0.030=-0.004
min2.563-2.557=0.006
max2.620-2.628=-0.008
policies=200
mean15538.061-15538.042=0.019
σ0.127-0.078=0.048
min15537.945-15537.950=-0.005
max15538.241-15538.137=0.103
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1639.000=3.000
σ0.000
min1642.000-1639.000=3.000
max1642.000-1639.000=3.000
mean26.123-26.173=-0.051
σ0.056-0.240=-0.184
min26.044-26.012=0.032
max26.169-26.528=-0.358