Compare commits

Home / Compare 207b5aee .. 12c6572a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.054=-0.000
σ0.369-0.368=0.001
min53.911-53.912=-0.001
max55.105-55.102=0.003
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.139-0.142=-0.003
σ0.003-0.004=-0.001
min0.135-0.139=-0.004
max0.146-0.149=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.392-43.392=0.000
σ0.007-0.005=0.002
min43.383-43.386=-0.002
max43.408-43.399=0.008
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.123-0.122=0.001
σ0.004-0.004=-0.000
min0.118-0.115=0.002
max0.130-0.128=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.008-1007.008=-0.000
σ1.198-1.178=0.020
min1006.430-1006.430=-0.001
max1012.028-1011.938=0.090
mean1047.300-1051.000=-3.700
σ313.194-307.003=6.191
min593.000-590.000=3.000
max1644.000-1649.000=-5.000
mean1.551-1.513=0.037
σ0.116-0.067=0.050
min1.370-1.394=-0.024
max1.819-1.649=0.170

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean0.454-0.422=0.032
σ0.129-0.142=-0.013
min0.370-0.343=0.027
max0.679-0.675=0.004
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean0.929-0.881=0.047
σ0.082-0.095=-0.013
min0.862-0.813=0.049
max1.048-1.046=0.001
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean0.539-0.549=-0.010
σ0.047-0.044=0.004
min0.498-0.503=-0.006
max0.617-0.621=-0.004
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean0.860-0.850=0.010
σ0.027-0.048=-0.021
min0.840-0.819=0.021
max0.908-0.935=-0.027

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.837=0.002
σ0.034-0.035=-0.001
min964.810-964.816=-0.006
max964.894-964.896=-0.002
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean0.843-0.837=0.006
σ0.016-0.027=-0.011
min0.818-0.793=0.025
max0.861-0.859=0.002
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.007-0.007=0.001
min885.504
max885.522-885.521=0.002
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean0.706-0.717=-0.011
σ0.041-0.034=0.007
min0.658-0.663=-0.005
max0.742-0.748=-0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716
σ0.002-0.002=-0.000
min7.715
max7.719-7.722=-0.002
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean3.475-3.450=0.025
σ0.104-0.070=0.034
min3.321-3.269=0.052
max4.249-3.610=0.639
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean3.493-3.457=0.036
σ0.070-0.072=-0.002
min3.359-3.340=0.019
max3.748-3.730=0.018
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean0.736-0.532=0.203
σ0.038-0.015=0.023
min0.526-0.507=0.018
max0.833-0.630=0.203
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean0.694-0.517=0.178
σ0.021-0.021=0.000
min0.544-0.487=0.057
max0.768-0.631=0.137

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.130-296.882=0.249
σ0.185-0.272=-0.087
min296.914-296.681=0.232
max297.595-297.635=-0.040
mean1899.000-1944.000=-45.000
σ0.000
min1899.000-1944.000=-45.000
max1899.000-1944.000=-45.000
mean0.610-0.582=0.028
σ0.038-0.035=0.003
min0.578-0.519=0.059
max0.713-0.614=0.099

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.819-286.819=0.000
σ0.039-0.038=0.001
min286.768-286.773=-0.005
max286.859-286.860=-0.001
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean0.395-0.394=0.002
σ0.008-0.008=0.001
min0.388-0.385=0.003
max0.407-0.402=0.004
iters=5
new-facts=1
prior-facts=6402
mean1297.227-1297.182=0.045
σ0.071-0.080=-0.010
min1297.151-1297.093=0.058
max1297.322-1297.302=0.019
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean2.078-1.935=0.143
σ0.058-0.154=-0.096
min2.006-1.809=0.196
max2.151-2.182=-0.031
iters=5
new-facts=6402
prior-facts=1
mean1541.339-1541.327=0.012
σ6.821-6.827=-0.006
min1538.132-1538.089=0.043
max1553.538-1553.536=0.002
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean2.265-2.182=0.083
σ0.196-0.112=0.084
min2.119-2.087=0.031
max2.569-2.366=0.203
iters=5
new-facts=6402
prior-facts=6402
mean1859.113-1859.116=-0.003
σ0.083-0.060=0.023
min1858.990-1859.057=-0.067
max1859.194-1859.194=0.000
mean1769.400-1790.000=-20.600
σ124.211-148.214=-24.004
min1644.000-1649.000=-5.000
max1899.000-1944.000=-45.000
mean3.136-2.949=0.187
σ0.277-0.184=0.094
min2.859-2.809=0.050
max3.557-3.255=0.302

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.209-1.255=-0.046
σ0.324-0.342=-0.017
min0.940-1.032=-0.092
max1.732-1.845=-0.113

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.820=0.001
σ581.372-581.372=-0.000
min158.132-158.132=0.000
max1320.879-1320.878=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean0.555-0.558=-0.003
σ0.573-0.584=-0.011
min0.263-0.262=0.002
max1.414-1.434=-0.020
policies=20
mean1581.632-1581.617=0.015
σ0.365-0.363=0.002
min1581.386-1581.371=0.015
max1582.175-1582.156=0.019
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean2.641-2.641=0.001
σ0.009-0.012=-0.002
min2.632-2.625=0.007
max2.655-2.653=0.001
policies=200
mean15824.052-15824.263=-0.211
σ0.276-0.122=0.154
min15823.738-15824.159=-0.421
max15824.411-15824.429=-0.018
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean26.574-26.599=-0.025
σ0.107-0.063=0.044
min26.457-26.543=-0.086
max26.705-26.672=0.033