Compare commits

Home / Compare 0f30dde2 .. e424fb28

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.046-54.046=-0.000
σ0.368-0.369=-0.001
min53.899-53.900=-0.001
max55.093-55.097=-0.004
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.137-0.139=-0.002
σ0.003-0.004=-0.001
min0.133-0.135=-0.002
max0.142-0.146=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.384-43.383=0.001
σ0.006-0.005=0.001
min43.375-43.377=-0.002
max43.392-43.395=-0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.125-0.121=0.004
σ0.005-0.004=0.001
min0.119-0.115=0.005
max0.133-0.127=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.977-1006.978=-0.001
σ0.876-0.898=-0.022
min1006.512-1006.507=0.005
max1010.613-1010.713=-0.100
mean1045.300-1041.800=3.500
σ314.261-313.995=0.266
min575.000-572.000=3.000
max1639.000
mean1.584-1.576=0.008
σ0.145-0.108=0.038
min1.476-1.443=0.033
max2.073-1.805=0.268

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.001
σ0.002-0.003=-0.000
min0.882
max0.887
mean1639.000
σ0.000
min1639.000
max1639.000
mean0.413-0.405=0.008
σ0.139-0.117=0.022
min0.326-0.331=-0.005
max0.658-0.613=0.045
name=error_case.art
mean2.339-2.339=0.001
σ0.003-0.003=-0.000
min2.337
max2.342
mean1639.000
σ0.000
min1639.000
max1639.000
mean1.079-0.900=0.179
σ0.321-0.083=0.238
min0.836-0.816=0.020
max1.636-0.995=0.640
name=heavy_item.art
mean1.524-1.524=-0.000
σ0.002-0.002=0.000
min1.522
max1.527-1.526=0.001
mean1639.000
σ0.000
min1639.000
max1639.000
mean0.623-0.535=0.088
σ0.173-0.047=0.127
min0.522-0.497=0.025
max0.931-0.612=0.319
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1639.000
σ0.000
min1639.000
max1639.000
mean0.907-0.840=0.068
σ0.098-0.043=0.055
min0.811-0.808=0.003
max1.038-0.910=0.128

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.831=0.000
σ0.026-0.025=0.001
min964.802
max964.864-964.862=0.001
mean1639.000
σ0.000
min1639.000
max1639.000
mean0.832-0.830=0.002
σ0.022-0.025=-0.004
min0.815-0.797=0.018
max0.861-0.851=0.009
name=cdr_enhanced_4k_loc.art
mean885.514-885.513=0.001
σ0.004-0.006=-0.002
min885.509-885.504=0.005
max885.518-885.518=-0.000
mean1639.000
σ0.000
min1639.000
max1639.000
mean0.737-0.720=0.017
σ0.010-0.045=-0.035
min0.719-0.641=0.078
max0.745-0.755=-0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.722=-0.002
mean1639.000
σ0.000
min1639.000
max1639.000
mean4.197-4.190=0.007
σ0.080-0.098=-0.018
min4.064-4.024=0.040
max4.467-4.624=-0.157
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1639.000
σ0.000
min1639.000
max1639.000
mean4.161-4.147=0.014
σ0.069-0.079=-0.010
min4.028-3.995=0.033
max4.345-4.453=-0.108
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1639.000
σ0.000
min1639.000
max1639.000
mean0.731-0.733=-0.003
σ0.020-0.028=-0.009
min0.697-0.698=-0.001
max0.865-0.928=-0.064
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1639.000
σ0.000
min1639.000
max1639.000
mean0.694-0.692=0.002
σ0.016-0.016=-0.000
min0.668-0.662=0.005
max0.776-0.775=0.001

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.545-295.596=-0.051
σ0.282-0.216=0.066
min295.298-295.395=-0.097
max296.304-296.175=0.129
mean1913.000-1921.000=-8.000
σ0.000
min1913.000-1921.000=-8.000
max1913.000-1921.000=-8.000
mean0.575-0.599=-0.024
σ0.054-0.037=0.017
min0.500-0.548=-0.048
max0.692-0.686=0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.385-285.414=-0.029
σ0.036-0.036=0.001
min285.341-285.366=-0.025
max285.426-285.452=-0.026
mean1639.000
σ0.000
min1639.000
max1639.000
mean0.388-0.388=0.000
σ0.005-0.009=-0.003
min0.382-0.380=0.002
max0.394-0.402=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1295.797-1295.792=0.005
σ0.102-0.106=-0.004
min1295.679-1295.672=0.007
max1295.931-1295.922=0.009
mean1639.000
σ0.000
min1639.000
max1639.000
mean1.920-1.945=-0.025
σ0.039-0.106=-0.067
min1.866-1.829=0.036
max1.961-2.070=-0.109
iters=5
new-facts=6402
prior-facts=1
mean1539.923-1539.924=-0.001
σ6.888-6.899=-0.011
min1536.621-1536.574=0.046
max1552.239-1552.259=-0.020
mean1639.000
σ0.000
min1639.000
max1639.000
mean2.307-2.416=-0.109
σ0.218-0.358=-0.140
min2.090-2.053=0.037
max2.593-2.898=-0.306
iters=5
new-facts=6402
prior-facts=6402
mean1857.702-1857.714=-0.012
σ0.054-0.051=0.003
min1857.657-1857.641=0.016
max1857.783-1857.780=0.003
mean1773.000-1775.800=-2.800
σ137.164-141.312=-4.148
min1639.000
max1913.000-1921.000=-8.000
mean3.038-3.040=-0.002
σ0.247-0.121=0.126
min2.850-2.879=-0.029
max3.471-3.157=0.314

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.344-1.358=-0.014
σ0.256-0.303=-0.046
min1.110-1.104=0.006
max1.783-1.882=-0.099

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.739-445.739=-0.000
σ580.934-580.935=-0.001
min155.271-155.270=0.001
max1317.140-1317.143=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1639.000
σ0.000
min1639.000
max1639.000
mean0.524-0.523=0.001
σ0.531-0.522=0.009
min0.257-0.258=-0.002
max1.320-1.307=0.014
policies=20
mean1552.975-1552.970=0.005
σ0.326-0.316=0.010
min1552.750-1552.766=-0.016
max1553.459-1553.441=0.018
mean920.000
σ0.000
min920.000
max920.000
mean1639.000
σ0.000
min1639.000
max1639.000
mean2.588-2.586=0.002
σ0.030-0.016=0.014
min2.557-2.572=-0.015
max2.628-2.609=0.019
policies=200
mean15538.042-15537.976=0.066
σ0.078-0.152=-0.073
min15537.950-15537.842=0.108
max15538.137-15538.174=-0.037
mean9200.000
σ0.000
min9200.000
max9200.000
mean1639.000
σ0.000
min1639.000
max1639.000
mean26.173-26.152=0.021
σ0.240-0.105=0.135
min26.012-26.038=-0.027
max26.528-26.290=0.237