Compare commits

Home / Compare dc693041 .. 7528479c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-53.964=0.093
σ0.369-0.370=-0.001
min53.912-53.818=0.094
max55.107-55.016=0.091
mean419.000-418.000=1.000
σ0.000
min419.000-418.000=1.000
max419.000-418.000=1.000
mean0.140-0.137=0.003
σ0.004-0.005=-0.001
min0.135-0.130=0.005
max0.147-0.147=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.395-43.322=0.073
σ0.006-0.007=-0.001
min43.386-43.311=0.075
max43.403-43.339=0.064
mean419.000-418.000=1.000
σ0.000
min419.000-418.000=1.000
max419.000-418.000=1.000
mean0.122-0.121=0.001
σ0.004-0.004=-0.001
min0.119-0.114=0.005
max0.128-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.962-1006.514=0.449
σ0.866-1.191=-0.325
min1006.463-1005.975=0.488
max1010.541-1011.498=-0.956
mean1047.550-1047.850=-0.300
σ305.893-314.926=-9.033
min579.000-551.000=28.000
max1663.000-1528.000=135.000
mean1.528-1.558=-0.030
σ0.088-0.079=0.009
min1.378-1.480=-0.102
max1.799-1.757=0.042

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1663.000-1528.000=135.000
σ0.000
min1663.000-1528.000=135.000
max1663.000-1528.000=135.000
mean0.413-0.442=-0.029
σ0.113-0.116=-0.004
min0.343-0.336=0.007
max0.612-0.630=-0.017
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1663.000-1528.000=135.000
σ0.000
min1663.000-1528.000=135.000
max1663.000-1528.000=135.000
mean0.896-0.877=0.020
σ0.097-0.090=0.006
min0.839-0.816=0.023
max1.066-1.034=0.033
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1663.000-1528.000=135.000
σ0.000
min1663.000-1528.000=135.000
max1663.000-1528.000=135.000
mean0.539-0.589=-0.050
σ0.053-0.069=-0.016
min0.489-0.513=-0.024
max0.623-0.677=-0.054
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1663.000-1528.000=135.000
σ0.000
min1663.000-1528.000=135.000
max1663.000-1528.000=135.000
mean0.855-0.870=-0.015
σ0.040-0.040=0.001
min0.819-0.840=-0.022
max0.920-0.939=-0.019

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.821=0.018
σ0.033-0.024=0.009
min964.809-964.802=0.007
max964.892-964.860=0.032
mean1663.000-1528.000=135.000
σ0.000
min1663.000-1528.000=135.000
max1663.000-1528.000=135.000
mean0.847-0.837=0.010
σ0.018-0.024=-0.007
min0.821-0.807=0.015
max0.870-0.858=0.012
name=cdr_enhanced_4k_loc.art
mean885.512-885.511=0.001
σ0.007-0.006=0.001
min885.505-885.504=0.001
max885.523-885.518=0.005
mean1663.000-1528.000=135.000
σ0.000
min1663.000-1528.000=135.000
max1663.000-1528.000=135.000
mean0.720-0.710=0.010
σ0.014-0.020=-0.006
min0.699-0.686=0.013
max0.735-0.738=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.720
mean1663.000-1528.000=135.000
σ0.000
min1663.000-1528.000=135.000
max1663.000-1528.000=135.000
mean3.508-2.781=0.727
σ0.133-0.065=0.068
min2.910-2.661=0.249
max3.863-3.016=0.847
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1663.000-1528.000=135.000
σ0.000
min1663.000-1528.000=135.000
max1663.000-1528.000=135.000
mean3.498-2.898=0.600
σ0.062-0.266=-0.204
min3.406-2.668=0.739
max3.721-3.647=0.074
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1663.000-1528.000=135.000
σ0.000
min1663.000-1528.000=135.000
max1663.000-1528.000=135.000
mean0.748-0.531=0.217
σ0.017-0.025=-0.008
min0.718-0.492=0.226
max0.824-0.665=0.160
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1663.000-1528.000=135.000
σ0.000
min1663.000-1528.000=135.000
max1663.000-1528.000=135.000
mean0.711-0.510=0.201
σ0.014-0.028=-0.014
min0.682-0.480=0.201
max0.785-0.736=0.048

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.507-296.319=-0.811
σ0.203-0.276=-0.072
min295.389-296.132=-0.743
max296.076-297.073=-0.997
mean1980.000-1907.000=73.000
σ0.000
min1980.000-1907.000=73.000
max1980.000-1907.000=73.000
mean0.537-0.559=-0.022
σ0.035-0.032=0.003
min0.485-0.513=-0.028
max0.594-0.596=-0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.403-285.040=0.363
σ0.038-0.027=0.011
min285.355-285.014=0.340
max285.442-285.070=0.372
mean1663.000-1528.000=135.000
σ0.000
min1663.000-1528.000=135.000
max1663.000-1528.000=135.000
mean0.390-0.398=-0.008
σ0.008-0.008=-0.000
min0.381-0.389=-0.008
max0.399-0.410=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1295.777-1295.420=0.357
σ0.107-0.067=0.040
min1295.656-1295.339=0.316
max1295.897-1295.508=0.389
mean1663.000-1528.000=135.000
σ0.000
min1663.000-1528.000=135.000
max1663.000-1528.000=135.000
mean1.913-2.084=-0.172
σ0.054-0.061=-0.007
min1.825-2.030=-0.205
max1.958-2.170=-0.212
iters=5
new-facts=6402
prior-facts=1
mean1539.907-1539.551=0.356
σ6.880-6.827=0.053
min1536.588-1536.339=0.249
max1552.209-1551.760=0.449
mean1663.000-1528.000=135.000
σ0.000
min1663.000-1528.000=135.000
max1663.000-1528.000=135.000
mean2.295-2.292=0.003
σ0.128-0.174=-0.046
min2.136-2.110=0.026
max2.494-2.505=-0.011
iters=5
new-facts=6402
prior-facts=6402
mean1857.684-1857.312=0.372
σ0.065-0.081=-0.017
min1857.622-1857.190=0.432
max1857.763-1857.399=0.364
mean1784.400-1750.400=34.000
σ131.196-164.190=-32.994
min1663.000-1528.000=135.000
max1980.000-1907.000=73.000
mean2.879-3.126=-0.247
σ0.083-0.280=-0.198
min2.806-2.853=-0.047
max2.986-3.556=-0.570

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.221-1.726=-0.504
σ0.311-0.142=0.170
min0.945-1.564=-0.619
max1.694-1.869=-0.175

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.706-448.191=-2.485
σ580.934-581.331=-0.397
min155.236-157.524=-2.289
max1317.107-1320.188=-3.081
mean96.250
σ8.500
min92.000
max109.000
mean1663.000-1528.000=135.000
σ0.000
min1663.000-1528.000=135.000
max1663.000-1528.000=135.000
mean0.531-0.552=-0.020
σ0.542-0.577=-0.035
min0.259-0.260=-0.001
max1.344-1.417=-0.072
policies=20
mean1552.660-1575.571=-22.911
σ0.330-0.355=-0.025
min1552.434-1575.330=-22.896
max1553.150-1576.099=-22.949
mean920.000
σ0.000
min920.000
max920.000
mean1663.000-1528.000=135.000
σ0.000
min1663.000-1528.000=135.000
max1663.000-1528.000=135.000
mean2.591-2.630=-0.039
σ0.020-0.011=0.009
min2.570-2.616=-0.045
max2.616-2.642=-0.026
policies=200
mean15534.744-15763.710=-228.966
σ0.084-0.032=0.053
min15534.670-15763.677=-229.007
max15534.865-15763.753=-228.888
mean9200.000
σ0.000
min9200.000
max9200.000
mean1663.000-1528.000=135.000
σ0.000
min1663.000-1528.000=135.000
max1663.000-1528.000=135.000
mean26.142-26.583=-0.441
σ0.101-0.014=0.088
min26.068-26.568=-0.500
max26.292-26.595=-0.303