Compare commits

Home / Compare cc364589 .. fc5ea1ca

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.055=-0.001
σ0.369-0.369=-0.000
min53.913-53.912=0.002
max55.104-55.105=-0.002
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.135-0.141=-0.006
σ0.004-0.004=-0.000
min0.133-0.137=-0.005
max0.144-0.149=-0.005
cache=y
dps=1
iters=10
policies=100
mean43.396-43.393=0.003
σ0.007-0.007=-0.001
min43.387-43.382=0.005
max43.407-43.408=-0.001
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.128-0.124=0.003
σ0.008-0.004=0.005
min0.120-0.121=-0.001
max0.142-0.131=0.012

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.010-1007.003=0.007
σ1.191-1.197=-0.006
min1006.432-1006.430=0.002
max1011.995-1012.025=-0.030
mean1051.900-1051.750=0.150
σ308.521-309.106=-0.584
min577.000-576.000=1.000
max1648.000-1649.000=-1.000
mean1.522-1.533=-0.011
σ0.072-0.069=0.003
min1.444-1.472=-0.028
max1.698-1.752=-0.054

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1648.000-1649.000=-1.000
σ0.000
min1648.000-1649.000=-1.000
max1648.000-1649.000=-1.000
mean0.422-0.415=0.007
σ0.135-0.138=-0.002
min0.342-0.328=0.014
max0.664-0.659=0.005
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1648.000-1649.000=-1.000
σ0.000
min1648.000-1649.000=-1.000
max1648.000-1649.000=-1.000
mean0.888-0.884=0.004
σ0.094-0.096=-0.003
min0.835-0.813=0.023
max1.053-1.051=0.002
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1648.000-1649.000=-1.000
σ0.000
min1648.000-1649.000=-1.000
max1648.000-1649.000=-1.000
mean0.533-0.536=-0.003
σ0.049-0.048=0.001
min0.495-0.499=-0.005
max0.618-0.617=0.001
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1648.000-1649.000=-1.000
σ0.000
min1648.000-1649.000=-1.000
max1648.000-1649.000=-1.000
mean0.844-0.851=-0.007
σ0.032-0.038=-0.007
min0.816-0.814=0.002
max0.899-0.913=-0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.834-964.840=-0.005
σ0.024-0.020=0.004
min964.807-964.817=-0.010
max964.872-964.872=0.000
mean1648.000-1649.000=-1.000
σ0.000
min1648.000-1649.000=-1.000
max1648.000-1649.000=-1.000
mean0.747-0.847=-0.100
σ0.032-0.018=0.014
min0.707-0.817=-0.110
max0.781-0.862=-0.081
name=cdr_enhanced_4k_loc.art
mean885.517-885.512=0.005
σ0.006-0.007=-0.000
min885.513-885.505=0.007
max885.528-885.522=0.007
mean1648.000-1649.000=-1.000
σ0.000
min1648.000-1649.000=-1.000
max1648.000-1649.000=-1.000
mean0.717-0.712=0.004
σ0.026-0.044=-0.018
min0.673-0.650=0.024
max0.736-0.745=-0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1648.000-1649.000=-1.000
σ0.000
min1648.000-1649.000=-1.000
max1648.000-1649.000=-1.000
mean4.222-4.217=0.004
σ0.088-0.081=0.007
min4.090-4.082=0.009
max4.522-4.565=-0.043
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1648.000-1649.000=-1.000
σ0.000
min1648.000-1649.000=-1.000
max1648.000-1649.000=-1.000
mean4.206-4.222=-0.017
σ0.093-0.075=0.017
min4.072-4.095=-0.023
max4.549-4.532=0.016
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1648.000-1649.000=-1.000
σ0.000
min1648.000-1649.000=-1.000
max1648.000-1649.000=-1.000
mean0.745-0.749=-0.004
σ0.018-0.024=-0.006
min0.719-0.718=0.001
max0.857-0.908=-0.050
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1648.000-1649.000=-1.000
σ0.000
min1648.000-1649.000=-1.000
max1648.000-1649.000=-1.000
mean0.710-0.709=0.001
σ0.017-0.016=0.001
min0.682-0.677=0.005
max0.789-0.785=0.004

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.850-296.962=-0.112
σ0.223-0.276=-0.052
min296.713-296.794=-0.081
max297.456-297.728=-0.272
mean2035.000-1919.000=116.000
σ0.000
min2035.000-1919.000=116.000
max2035.000-1919.000=116.000
mean0.560-0.579=-0.019
σ0.028-0.050=-0.022
min0.514-0.519=-0.005
max0.586-0.686=-0.100

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.825-286.823=0.002
σ0.035-0.033=0.002
min286.782-286.780=0.002
max286.862-286.858=0.004
mean1648.000-1649.000=-1.000
σ0.000
min1648.000-1649.000=-1.000
max1648.000-1649.000=-1.000
mean0.394-0.399=-0.005
σ0.007-0.010=-0.003
min0.389-0.388=0.000
max0.402-0.411=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1297.204-1297.213=-0.009
σ0.097-0.074=0.023
min1297.090-1297.118=-0.027
max1297.317-1297.304=0.013
mean1648.000-1649.000=-1.000
σ0.000
min1648.000-1649.000=-1.000
max1648.000-1649.000=-1.000
mean1.938-2.047=-0.110
σ0.136-0.052=0.084
min1.794-1.983=-0.188
max2.109-2.105=0.004
iters=5
new-facts=6402
prior-facts=1
mean1541.315-1541.336=-0.021
σ6.818-6.819=-0.001
min1538.071-1538.133=-0.062
max1553.508-1553.531=-0.023
mean1648.000-1649.000=-1.000
σ0.000
min1648.000-1649.000=-1.000
max1648.000-1649.000=-1.000
mean2.213-2.253=-0.040
σ0.204-0.190=0.014
min2.032-2.097=-0.065
max2.542-2.571=-0.029
iters=5
new-facts=6402
prior-facts=6402
mean1859.128-1859.119=0.009
σ0.048-0.066=-0.017
min1859.063-1859.035=0.028
max1859.189-1859.194=-0.005
mean1784.800-1779.000=5.800
σ168.035-135.261=32.774
min1648.000-1649.000=-1.000
max2035.000-1919.000=116.000
mean2.852-3.096=-0.244
σ0.077-0.232=-0.155
min2.759-2.827=-0.068
max2.972-3.445=-0.473

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.181-1.159=0.022
σ0.343-0.228=0.114
min0.930-0.935=-0.005
max1.747-1.515=0.232

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.821=0.000
σ581.372-581.373=-0.001
min158.134-158.131=0.003
max1320.879-1320.880=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1648.000-1649.000=-1.000
σ0.000
min1648.000-1649.000=-1.000
max1648.000-1649.000=-1.000
mean0.553-0.532=0.022
σ0.580-0.540=0.040
min0.259-0.257=0.002
max1.423-1.341=0.082
policies=20
mean1581.620-1581.614=0.006
σ0.352-0.342=0.010
min1581.388-1581.389=-0.001
max1582.144-1582.123=0.020
mean920.000
σ0.000
min920.000
max920.000
mean1648.000-1649.000=-1.000
σ0.000
min1648.000-1649.000=-1.000
max1648.000-1649.000=-1.000
mean2.632-2.636=-0.004
σ0.013-0.020=-0.007
min2.621-2.617=0.005
max2.650-2.660=-0.010
policies=200
mean15824.167-15824.167=-0.000
σ0.084-0.182=-0.098
min15824.044-15823.958=0.085
max15824.224-15824.401=-0.176
mean9200.000
σ0.000
min9200.000
max9200.000
mean1648.000-1649.000=-1.000
σ0.000
min1648.000-1649.000=-1.000
max1648.000-1649.000=-1.000
mean26.473-26.512=-0.039
σ0.055-0.061=-0.006
min26.435-26.425=0.009
max26.554-26.563=-0.009