Compare commits

Home / Compare 58c73474 .. cc364589

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.054=0.000
σ0.369-0.369=0.001
min53.912-53.914=-0.002
max55.105-55.103=0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.141-0.138=0.003
σ0.004-0.006=-0.002
min0.137-0.132=0.006
max0.149-0.149=0.001
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.007-0.007=0.000
min43.382-43.386=-0.004
max43.408-43.410=-0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.124-0.122=0.002
σ0.004-0.004=0.000
min0.121-0.118=0.003
max0.131-0.129=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.003-1007.006=-0.003
σ1.197-1.183=0.014
min1006.430-1006.433=-0.003
max1012.025-1011.960=0.065
mean1051.750-1054.700=-2.950
σ309.106-319.624=-10.519
min576.000-590.000=-14.000
max1649.000-1622.000=27.000
mean1.533-1.503=0.030
σ0.069-0.069=0.000
min1.472-1.352=0.120
max1.752-1.655=0.097

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.001
σ0.003-0.002=0.000
min0.882
max0.887
mean1649.000-1622.000=27.000
σ0.000
min1649.000-1622.000=27.000
max1649.000-1622.000=27.000
mean0.415-0.408=0.007
σ0.138-0.118=0.020
min0.328-0.335=-0.007
max0.659-0.617=0.042
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1649.000-1622.000=27.000
σ0.000
min1649.000-1622.000=27.000
max1649.000-1622.000=27.000
mean0.884-0.880=0.004
σ0.096-0.085=0.011
min0.813-0.826=-0.014
max1.051-1.031=0.020
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1649.000-1622.000=27.000
σ0.000
min1649.000-1622.000=27.000
max1649.000-1622.000=27.000
mean0.536-0.536=-0.001
σ0.048-0.053=-0.005
min0.499-0.492=0.007
max0.617-0.628=-0.011
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1649.000-1622.000=27.000
σ0.000
min1649.000-1622.000=27.000
max1649.000-1622.000=27.000
mean0.851-0.835=0.017
σ0.038-0.039=-0.001
min0.814-0.787=0.027
max0.913-0.895=0.018

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.839=0.000
σ0.020-0.034=-0.014
min964.817-964.811=0.007
max964.872-964.895=-0.023
mean1649.000-1622.000=27.000
σ0.000
min1649.000-1622.000=27.000
max1649.000-1622.000=27.000
mean0.847-0.828=0.018
σ0.018-0.022=-0.004
min0.817-0.799=0.018
max0.862-0.851=0.011
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.007=-0.001
min885.505
max885.522-885.523=-0.002
mean1649.000-1622.000=27.000
σ0.000
min1649.000-1622.000=27.000
max1649.000-1622.000=27.000
mean0.712-0.697=0.015
σ0.044-0.053=-0.010
min0.650-0.639=0.011
max0.745-0.738=0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.002
mean1649.000-1622.000=27.000
σ0.000
min1649.000-1622.000=27.000
max1649.000-1622.000=27.000
mean4.217-4.280=-0.062
σ0.081-0.072=0.009
min4.082-4.154=-0.073
max4.565-4.593=-0.028
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1649.000-1622.000=27.000
σ0.000
min1649.000-1622.000=27.000
max1649.000-1622.000=27.000
mean4.222-4.267=-0.045
σ0.075-0.066=0.010
min4.095-4.161=-0.066
max4.532-4.519=0.014
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1649.000-1622.000=27.000
σ0.000
min1649.000-1622.000=27.000
max1649.000-1622.000=27.000
mean0.749-0.759=-0.010
σ0.024-0.025=-0.001
min0.718-0.728=-0.010
max0.908-0.928=-0.020
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1649.000-1622.000=27.000
σ0.000
min1649.000-1622.000=27.000
max1649.000-1622.000=27.000
mean0.709-0.717=-0.009
σ0.016-0.014=0.002
min0.677-0.680=-0.003
max0.785-0.784=0.001

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.962-296.829=0.133
σ0.276-0.231=0.045
min296.794-296.586=0.208
max297.728-297.400=0.328
mean1919.000-1948.000=-29.000
σ0.000
min1919.000-1948.000=-29.000
max1919.000-1948.000=-29.000
mean0.579-0.582=-0.003
σ0.050-0.030=0.020
min0.519-0.528=-0.009
max0.686-0.609=0.077

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.823-286.816=0.007
σ0.033-0.043=-0.009
min286.780-286.767=0.013
max286.858-286.868=-0.010
mean1649.000-1622.000=27.000
σ0.000
min1649.000-1622.000=27.000
max1649.000-1622.000=27.000
mean0.399-0.400=-0.001
σ0.010-0.008=0.002
min0.388-0.390=-0.002
max0.411-0.409=0.003
iters=5
new-facts=1
prior-facts=6402
mean1297.213-1297.214=-0.001
σ0.074-0.112=-0.039
min1297.118-1297.092=0.025
max1297.304-1297.341=-0.037
mean1649.000-1622.000=27.000
σ0.000
min1649.000-1622.000=27.000
max1649.000-1622.000=27.000
mean2.047-1.947=0.100
σ0.052-0.129=-0.077
min1.983-1.804=0.179
max2.105-2.082=0.023
iters=5
new-facts=6402
prior-facts=1
mean1541.336-1541.316=0.020
σ6.819-6.834=-0.016
min1538.133-1538.079=0.054
max1553.531-1553.538=-0.007
mean1649.000-1622.000=27.000
σ0.000
min1649.000-1622.000=27.000
max1649.000-1622.000=27.000
mean2.253-2.181=0.072
σ0.190-0.174=0.016
min2.097-1.960=0.137
max2.571-2.401=0.170
iters=5
new-facts=6402
prior-facts=6402
mean1859.119-1859.123=-0.004
σ0.066-0.058=0.008
min1859.035-1859.064=-0.029
max1859.194-1859.195=-0.002
mean1779.000-1781.600=-2.600
σ135.261-163.177=-27.916
min1649.000-1622.000=27.000
max1919.000-1948.000=-29.000
mean3.096-2.949=0.147
σ0.232-0.172=0.060
min2.827-2.830=-0.003
max3.445-3.246=0.198

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.159-1.212=-0.052
σ0.228-0.341=-0.113
min0.935-0.936=-0.001
max1.515-1.765=-0.250

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.822=-0.000
σ581.373-581.372=0.001
min158.131-158.134=-0.003
max1320.880-1320.879=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1649.000-1622.000=27.000
σ0.000
min1649.000-1622.000=27.000
max1649.000-1622.000=27.000
mean0.532-0.544=-0.012
σ0.540-0.555=-0.016
min0.257-0.260=-0.004
max1.341-1.377=-0.036
policies=20
mean1581.614-1581.628=-0.014
σ0.342-0.355=-0.013
min1581.389-1581.389=-0.000
max1582.123-1582.155=-0.032
mean920.000
σ0.000
min920.000
max920.000
mean1649.000-1622.000=27.000
σ0.000
min1649.000-1622.000=27.000
max1649.000-1622.000=27.000
mean2.636-2.633=0.003
σ0.020-0.012=0.008
min2.617-2.617=-0.001
max2.660-2.645=0.015
policies=200
mean15824.167-15824.256=-0.089
σ0.182-0.084=0.098
min15823.958-15824.189=-0.230
max15824.401-15824.374=0.026
mean9200.000
σ0.000
min9200.000
max9200.000
mean1649.000-1622.000=27.000
σ0.000
min1649.000-1622.000=27.000
max1649.000-1622.000=27.000
mean26.512-26.584=-0.072
σ0.061-0.071=-0.010
min26.425-26.537=-0.112
max26.563-26.688=-0.126