Compare commits

Home / Compare b334a502 .. 11914be5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.054=0.001
σ0.367-0.370=-0.003
min53.915-53.909=0.006
max55.099-55.106=-0.007
mean420.000-413.000=7.000
σ0.000
min420.000-413.000=7.000
max420.000-413.000=7.000
mean0.139-0.136=0.003
σ0.005-0.005=-0.000
min0.133-0.132=0.001
max0.149-0.146=0.004
cache=y
dps=1
iters=10
policies=100
mean43.393-43.395=-0.002
σ0.005-0.004=0.001
min43.388-43.390=-0.002
max43.405-43.402=0.002
mean420.000-413.000=7.000
σ0.000
min420.000-413.000=7.000
max420.000-413.000=7.000
mean0.121-0.123=-0.002
σ0.004-0.004=-0.000
min0.116-0.119=-0.003
max0.127-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.001-1007.014=-0.013
σ1.229-1.175=0.054
min1006.462-1006.428=0.033
max1012.158-1011.918=0.241
mean1053.850-1050.450=3.400
σ308.691-308.921=-0.230
min578.000-574.000=4.000
max1651.000-1647.000=4.000
mean1.546-1.532=0.014
σ0.101-0.075=0.026
min1.463-1.468=-0.005
max1.841-1.760=0.081

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1651.000-1647.000=4.000
σ0.000
min1651.000-1647.000=4.000
max1651.000-1647.000=4.000
mean0.426-0.420=0.006
σ0.154-0.152=0.002
min0.341-0.326=0.015
max0.700-0.690=0.010
name=error_case.art
mean2.339-2.339=0.000
σ0.002-0.003=-0.000
min2.337
max2.342
mean1651.000-1647.000=4.000
σ0.000
min1651.000-1647.000=4.000
max1651.000-1647.000=4.000
mean0.891-0.886=0.006
σ0.109-0.096=0.013
min0.828-0.830=-0.002
max1.084-1.056=0.028
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1651.000-1647.000=4.000
σ0.000
min1651.000-1647.000=4.000
max1651.000-1647.000=4.000
mean0.538-0.545=-0.007
σ0.052-0.053=-0.001
min0.501-0.492=0.008
max0.629-0.632=-0.003
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1651.000-1647.000=4.000
σ0.000
min1651.000-1647.000=4.000
max1651.000-1647.000=4.000
mean0.862-0.859=0.002
σ0.039-0.046=-0.007
min0.831-0.819=0.012
max0.929-0.937=-0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.840=-0.000
σ0.035-0.036=-0.001
min964.810-964.811=-0.000
max964.897-964.899=-0.003
mean1651.000-1647.000=4.000
σ0.000
min1651.000-1647.000=4.000
max1651.000-1647.000=4.000
mean0.824-0.819=0.004
σ0.037-0.088=-0.051
min0.775-0.662=0.112
max0.862-0.863=-0.001
name=cdr_enhanced_4k_loc.art
mean885.512-885.511=0.001
σ0.007-0.007=-0.000
min885.505-885.504=0.001
max885.522-885.522=0.000
mean1651.000-1647.000=4.000
σ0.000
min1651.000-1647.000=4.000
max1651.000-1647.000=4.000
mean0.717-0.693=0.024
σ0.030-0.041=-0.011
min0.678-0.645=0.033
max0.745-0.739=0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1651.000-1647.000=4.000
σ0.000
min1651.000-1647.000=4.000
max1651.000-1647.000=4.000
mean3.475-4.231=-0.756
σ0.090-0.086=0.005
min3.349-4.089=-0.740
max3.866-4.616=-0.750
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1651.000-1647.000=4.000
σ0.000
min1651.000-1647.000=4.000
max1651.000-1647.000=4.000
mean3.501-4.253=-0.752
σ0.100-0.081=0.020
min3.362-4.086=-0.724
max4.002-4.487=-0.484
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1651.000-1647.000=4.000
σ0.000
min1651.000-1647.000=4.000
max1651.000-1647.000=4.000
mean0.752-0.746=0.006
σ0.016-0.018=-0.002
min0.713-0.708=0.005
max0.835-0.853=-0.018
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1651.000-1647.000=4.000
σ0.000
min1651.000-1647.000=4.000
max1651.000-1647.000=4.000
mean0.709-0.705=0.004
σ0.025-0.015=0.010
min0.511-0.674=-0.163
max0.772-0.781=-0.009

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.202-296.870=0.332
σ0.211-0.229=-0.018
min296.992-296.687=0.305
max297.728-297.493=0.234
mean2031.000-1951.000=80.000
σ0.000
min2031.000-1951.000=80.000
max2031.000-1951.000=80.000
mean0.537-0.590=-0.053
σ0.032-0.038=-0.006
min0.505-0.510=-0.005
max0.575-0.662=-0.087

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.821-286.819=0.001
σ0.038-0.034=0.004
min286.771-286.772=-0.001
max286.859-286.860=-0.000
mean1651.000-1647.000=4.000
σ0.000
min1651.000-1647.000=4.000
max1651.000-1647.000=4.000
mean0.398-0.391=0.007
σ0.006-0.002=0.003
min0.390-0.388=0.002
max0.405-0.393=0.011
iters=5
new-facts=1
prior-facts=6402
mean1297.244-1297.228=0.015
σ0.053-0.073=-0.020
min1297.185-1297.166=0.019
max1297.300-1297.330=-0.030
mean1651.000-1647.000=4.000
σ0.000
min1651.000-1647.000=4.000
max1651.000-1647.000=4.000
mean2.095-2.077=0.017
σ0.080-0.062=0.018
min2.014-1.992=0.023
max2.201-2.143=0.058
iters=5
new-facts=6402
prior-facts=1
mean1541.344-1541.345=-0.001
σ6.817-6.816=0.000
min1538.141-1538.162=-0.020
max1553.535-1553.536=-0.002
mean1651.000-1647.000=4.000
σ0.000
min1651.000-1647.000=4.000
max1651.000-1647.000=4.000
mean2.278-2.277=0.001
σ0.201-0.282=-0.081
min2.140-2.055=0.085
max2.600-2.728=-0.128
iters=5
new-facts=6402
prior-facts=6402
mean1859.104-1859.112=-0.007
σ0.088-0.083=0.005
min1858.960-1858.993=-0.033
max1859.187-1859.190=-0.003
mean1783.400-1793.000=-9.600
σ165.072-152.591=12.481
min1651.000-1647.000=4.000
max2031.000-1951.000=80.000
mean2.898-3.006=-0.108
σ0.100-0.141=-0.041
min2.799-2.869=-0.070
max3.053-3.218=-0.165

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.195-1.187=0.009
σ0.368-0.335=0.033
min0.943-0.913=0.030
max1.815-1.686=0.129

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.822=-0.000
σ581.372-581.372=0.000
min158.135-158.135=0.000
max1320.880-1320.879=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1651.000-1647.000=4.000
σ0.000
min1651.000-1647.000=4.000
max1651.000-1647.000=4.000
mean0.568-0.529=0.039
σ0.607-0.532=0.076
min0.260-0.254=0.006
max1.479-1.327=0.152
policies=20
mean1581.630-1581.628=0.003
σ0.361-0.358=0.003
min1581.392-1581.384=0.008
max1582.168-1582.160=0.007
mean920.000
σ0.000
min920.000
max920.000
mean1651.000-1647.000=4.000
σ0.000
min1651.000-1647.000=4.000
max1651.000-1647.000=4.000
mean2.640-2.645=-0.005
σ0.006-0.017=-0.011
min2.632-2.630=0.003
max2.646-2.660=-0.014
policies=200
mean15824.161-15824.265=-0.105
σ0.163-0.135=0.028
min15824.050-15824.158=-0.108
max15824.402-15824.443=-0.041
mean9200.000
σ0.000
min9200.000
max9200.000
mean1651.000-1647.000=4.000
σ0.000
min1651.000-1647.000=4.000
max1651.000-1647.000=4.000
mean26.594-26.583=0.011
σ0.094-0.038=0.056
min26.471-26.542=-0.071
max26.692-26.630=0.062