Compare commits

Home / Compare 0a3bd03e .. 3600c6f6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.054=0.000
σ0.370-0.369=0.002
min53.909-53.911=-0.002
max55.108-55.103=0.005
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.140-0.137=0.003
σ0.005-0.006=-0.002
min0.132-0.132=-0.000
max0.147-0.151=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=-0.000
σ0.007-0.006=0.001
min43.384-43.382=0.002
max43.407-43.404=0.003
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.121-0.122=-0.001
σ0.004-0.004=0.001
min0.115-0.119=-0.003
max0.130-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1007.003=0.002
σ1.200-1.191=0.009
min1006.443-1006.430=0.012
max1012.039-1011.998=0.040
mean1050.200-1045.950=4.250
σ309.011-316.414=-7.403
min574.000-588.000=-14.000
max1647.000
mean1.557-1.528=0.029
σ0.080-0.067=0.013
min1.481-1.402=0.079
max1.777-1.695=0.082

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.419-0.419=0.000
σ0.137-0.143=-0.006
min0.332-0.326=0.006
max0.661-0.672=-0.011
name=error_case.art
mean2.339-2.339=0.001
σ0.002-0.003=-0.000
min2.337
max2.342
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.865-0.882=-0.017
σ0.099-0.097=0.002
min0.802-0.813=-0.011
max1.039-1.052=-0.012
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.522-0.543=-0.021
σ0.050-0.049=0.001
min0.486-0.496=-0.010
max0.607-0.624=-0.017
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=0.000
min2.360
max2.364-2.364=-0.000
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.838-0.853=-0.015
σ0.040-0.043=-0.003
min0.795-0.825=-0.030
max0.901-0.929=-0.027

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=0.000
σ0.035-0.019=0.016
min964.811-964.824=-0.013
max964.897-964.870=0.027
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.842-0.848=-0.006
σ0.031-0.018=0.012
min0.788-0.816=-0.028
max0.865-0.863=0.002
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.007=0.001
min885.504-885.506=-0.001
max885.523-885.523=0.000
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.726-0.738=-0.013
σ0.030-0.004=0.025
min0.675-0.733=-0.057
max0.753-0.744=0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.721=-0.000
mean1647.000
σ0.000
min1647.000
max1647.000
mean4.208-4.263=-0.056
σ0.090-0.088=0.001
min4.046-4.112=-0.066
max4.575-4.604=-0.029
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1647.000
σ0.000
min1647.000
max1647.000
mean4.215-4.223=-0.008
σ0.092-0.088=0.004
min4.030-4.076=-0.047
max4.599-4.543=0.056
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.739-0.751=-0.012
σ0.018-0.022=-0.005
min0.700-0.632=0.068
max0.848-0.867=-0.019
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.694-0.717=-0.023
σ0.016-0.017=-0.001
min0.665-0.671=-0.007
max0.785-0.788=-0.003

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.833-296.888=-0.054
σ0.221-0.196=0.025
min296.701-296.758=-0.056
max297.428-297.414=0.014
mean1902.000-1952.000=-50.000
σ0.000
min1902.000-1952.000=-50.000
max1902.000-1952.000=-50.000
mean0.587-0.541=0.047
σ0.054-0.027=0.027
min0.509-0.504=0.006
max0.702-0.578=0.125

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.820-286.829=-0.009
σ0.037-0.028=0.009
min286.770-286.798=-0.028
max286.857-286.861=-0.004
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.393-0.396=-0.003
σ0.006-0.007=-0.001
min0.386-0.388=-0.002
max0.400-0.404=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1297.271-1297.239=0.032
σ0.091-0.077=0.014
min1297.158-1297.153=0.005
max1297.397-1297.335=0.062
mean1647.000
σ0.000
min1647.000
max1647.000
mean2.269-2.120=0.149
σ0.159-0.063=0.095
min2.139-2.024=0.115
max2.544-2.177=0.367
iters=5
new-facts=6402
prior-facts=1
mean1541.344-1541.341=0.002
σ6.841-6.825=0.016
min1538.091-1538.089=0.003
max1553.578-1553.546=0.031
mean1647.000
σ0.000
min1647.000
max1647.000
mean2.242-2.322=-0.079
σ0.170-0.141=0.029
min2.130-2.153=-0.023
max2.544-2.489=0.055
iters=5
new-facts=6402
prior-facts=6402
mean1859.119-1859.114=0.004
σ0.066-0.070=-0.004
min1859.030-1859.003=0.028
max1859.196-1859.181=0.015
mean1777.400-1778.800=-1.400
σ125.801-114.362=11.438
min1647.000
max1902.000-1952.000=-50.000
mean3.123-2.978=0.145
σ0.285-0.160=0.126
min2.833-2.864=-0.031
max3.550-3.251=0.299

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.194-1.159=0.035
σ0.318-0.313=0.005
min0.930-0.922=0.008
max1.612-1.669=-0.057

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.821=0.001
σ581.372-581.372=-0.000
min158.134-158.133=0.001
max1320.879
mean96.250
σ8.500
min92.000
max109.000
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.562-0.567=-0.005
σ0.598-0.595=0.002
min0.261-0.265=-0.004
max1.459-1.460=-0.002
policies=20
mean1581.629-1581.589=0.040
σ0.360-0.298=0.062
min1581.386-1581.378=0.008
max1582.163-1582.030=0.133
mean920.000
σ0.000
min920.000
max920.000
mean1647.000
σ0.000
min1647.000
max1647.000
mean2.638-2.635=0.003
σ0.014-0.012=0.002
min2.630-2.618=0.012
max2.659-2.645=0.014
policies=200
mean15824.126-15824.158=-0.032
σ0.166-0.106=0.060
min15824.024-15824.012=0.012
max15824.373-15824.260=0.113
mean9200.000
σ0.000
min9200.000
max9200.000
mean1647.000
σ0.000
min1647.000
max1647.000
mean26.630-26.592=0.038
σ0.038-0.052=-0.013
min26.603-26.552=0.051
max26.686-26.666=0.021