Compare commits

Home / Compare de41d701 .. df21bc6d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.056=-0.002
σ0.368-0.369=-0.001
min53.910-53.919=-0.008
max55.101-55.105=-0.004
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.141-0.142=-0.001
σ0.004-0.005=-0.001
min0.135-0.138=-0.002
max0.148-0.149=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=-0.000
σ0.006-0.008=-0.002
min43.385-43.384=0.002
max43.402-43.406=-0.004
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.122-0.119=0.003
σ0.004-0.003=0.001
min0.116-0.113=0.003
max0.128-0.122=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1007.007=-0.002
σ1.199-1.189=0.010
min1006.439-1006.433=0.006
max1012.035-1011.990=0.045
mean1055.300-1054.700=0.600
σ309.411-308.097=1.314
min579.000
max1653.000-1647.000=6.000
mean1.534-1.536=-0.003
σ0.081-0.095=-0.014
min1.452-1.372=0.080
max1.771-1.774=-0.003

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean0.416-0.421=-0.005
σ0.125-0.137=-0.012
min0.342-0.327=0.016
max0.636-0.662=-0.026
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean0.877-0.874=0.003
σ0.092-0.100=-0.009
min0.820-0.806=0.014
max1.035-1.050=-0.015
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean0.540-0.539=0.001
σ0.049-0.054=-0.005
min0.504-0.491=0.013
max0.620-0.632=-0.012
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean0.836-0.858=-0.022
σ0.047-0.033=0.013
min0.796-0.839=-0.043
max0.910-0.917=-0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.840=-0.000
σ0.023-0.035=-0.012
min964.818-964.811=0.008
max964.876-964.898=-0.021
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean0.826-0.828=-0.001
σ0.038-0.037=0.001
min0.781-0.786=-0.005
max0.873-0.859=0.014
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.007=0.000
min885.504-885.505=-0.001
max885.521-885.522=-0.001
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean0.695-0.722=-0.027
σ0.051-0.016=0.034
min0.633-0.703=-0.069
max0.742-0.739=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean3.552-4.245=-0.693
σ0.088-0.073=0.015
min3.369-4.128=-0.759
max3.831-4.505=-0.674
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean3.549-4.241=-0.692
σ0.070-0.082=-0.012
min3.421-4.124=-0.703
max3.812-4.613=-0.802
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean0.539-0.737=-0.198
σ0.013-0.044=-0.031
min0.515-0.530=-0.014
max0.614-0.843=-0.229
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean0.512-0.709=-0.197
σ0.011-0.028=-0.017
min0.485-0.506=-0.020
max0.559-0.794=-0.236

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.841-296.883=-0.042
σ0.248-0.263=-0.015
min296.661-296.712=-0.052
max297.503-297.583=-0.079
mean1902.000-1947.000=-45.000
σ0.000
min1902.000-1947.000=-45.000
max1902.000-1947.000=-45.000
mean0.601-0.589=0.012
σ0.032-0.046=-0.014
min0.568-0.514=0.054
max0.682-0.690=-0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.824-286.824=0.001
σ0.034-0.036=-0.001
min286.782-286.774=0.008
max286.867-286.861=0.006
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean0.401-0.398=0.003
σ0.013-0.005=0.008
min0.390-0.391=-0.001
max0.419-0.402=0.017
iters=5
new-facts=1
prior-facts=6402
mean1297.226-1297.247=-0.022
σ0.074-0.073=0.001
min1297.143-1297.167=-0.024
max1297.327-1297.326=0.001
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean2.079-2.097=-0.018
σ0.065-0.087=-0.022
min2.014-2.001=0.013
max2.174-2.182=-0.008
iters=5
new-facts=6402
prior-facts=1
mean1541.396-1541.311=0.085
σ6.823-6.837=-0.014
min1538.199-1538.077=0.122
max1553.598-1553.537=0.061
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean2.397-2.182=0.215
σ0.175-0.090=0.085
min2.139-2.114=0.025
max2.542-2.322=0.220
iters=5
new-facts=6402
prior-facts=6402
mean1859.117-1859.116=0.001
σ0.063-0.080=-0.018
min1859.040-1859.005=0.035
max1859.193-1859.198=-0.005
mean1773.000-1791.000=-18.000
σ123.219-150.599=-27.379
min1653.000-1647.000=6.000
max1902.000-1947.000=-45.000
mean3.080-2.994=0.086
σ0.264-0.115=0.149
min2.789-2.855=-0.065
max3.420-3.167=0.254

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.184-1.214=-0.030
σ0.352-0.326=0.026
min0.926-0.937=-0.011
max1.763-1.761=0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.819=0.001
σ581.372-581.372=-0.000
min158.133-158.129=0.004
max1320.877-1320.877=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean0.537-0.533=0.004
σ0.551-0.534=0.017
min0.259-0.262=-0.002
max1.364-1.335=0.029
policies=20
mean1581.609-1581.611=-0.002
σ0.357-0.377=-0.020
min1581.369-1581.360=0.009
max1582.140-1582.172=-0.032
mean920.000
σ0.000
min920.000
max920.000
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean2.633-2.656=-0.023
σ0.013-0.025=-0.011
min2.620-2.630=-0.010
max2.650-2.687=-0.037
policies=200
mean15824.211-15824.208=0.003
σ0.147-0.169=-0.022
min15824.075-15824.056=0.019
max15824.416-15824.448=-0.032
mean9200.000
σ0.000
min9200.000
max9200.000
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean26.600-26.640=-0.041
σ0.039-0.030=0.009
min26.557-26.607=-0.050
max26.645-26.679=-0.034