Compare commits

Home / Compare cf607712 .. d5e6753a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=-0.000
σ0.367-0.371=-0.003
min53.919-53.912=0.007
max55.100-55.110=-0.010
mean414.700-414.000=0.700
σ0.483-0.000=0.483
min414.000
max415.000-414.000=1.000
mean0.141-0.141=-0.000
σ0.005-0.004=0.000
min0.136-0.137=-0.001
max0.150-0.149=0.000
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.006-0.005=0.001
min43.387-43.387=-0.001
max43.405-43.405=0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.121-0.123=-0.001
σ0.004-0.004=0.000
min0.115-0.119=-0.004
max0.126-0.130=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.003-1007.002=0.001
σ1.207-1.199=0.008
min1006.459-1006.455=0.004
max1012.068-1012.031=0.036
mean1037.250-1051.900=-14.650
σ298.355-308.767=-10.412
min580.000-577.000=3.000
max1581.000-1649.000=-68.000
mean1.575-1.547=0.028
σ0.118-0.075=0.043
min1.375-1.477=-0.102
max1.878-1.777=0.101

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.000
σ0.003-0.003=0.001
min0.882
max0.888-0.887=0.001
mean1581.000-1649.000=-68.000
σ0.000
min1581.000-1649.000=-68.000
max1581.000-1649.000=-68.000
mean0.415-0.409=0.007
σ0.144-0.134=0.010
min0.327-0.322=0.006
max0.670-0.645=0.026
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1581.000-1649.000=-68.000
σ0.000
min1581.000-1649.000=-68.000
max1581.000-1649.000=-68.000
mean0.891-0.873=0.018
σ0.111-0.086=0.025
min0.793-0.823=-0.030
max1.081-1.025=0.056
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1581.000-1649.000=-68.000
σ0.000
min1581.000-1649.000=-68.000
max1581.000-1649.000=-68.000
mean0.533-0.530=0.003
σ0.045-0.053=-0.007
min0.491-0.482=0.009
max0.609-0.617=-0.008
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=0.000
min2.360
max2.365-2.364=0.001
mean1581.000-1649.000=-68.000
σ0.000
min1581.000-1649.000=-68.000
max1581.000-1649.000=-68.000
mean0.846-0.844=0.002
σ0.041-0.036=0.005
min0.805-0.811=-0.006
max0.913-0.904=0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.839=-0.009
σ0.025-0.034=-0.010
min964.807-964.809=-0.002
max964.864-964.896=-0.032
mean1581.000-1649.000=-68.000
σ0.000
min1581.000-1649.000=-68.000
max1581.000-1649.000=-68.000
mean0.821-0.814=0.008
σ0.059-0.051=0.008
min0.723-0.726=-0.004
max0.868-0.851=0.016
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.005-0.007=-0.003
min885.504-885.505=-0.001
max885.516-885.523=-0.007
mean1581.000-1649.000=-68.000
σ0.000
min1581.000-1649.000=-68.000
max1581.000-1649.000=-68.000
mean0.716-0.729=-0.013
σ0.027-0.020=0.006
min0.677-0.693=-0.016
max0.742-0.741=0.000

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1581.000-1649.000=-68.000
σ0.000
min1581.000-1649.000=-68.000
max1581.000-1649.000=-68.000
mean4.260-4.273=-0.013
σ0.108-0.086=0.022
min4.110-4.177=-0.067
max4.955-4.761=0.195
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1581.000-1649.000=-68.000
σ0.000
min1581.000-1649.000=-68.000
max1581.000-1649.000=-68.000
mean4.226-4.263=-0.037
σ0.071-0.069=0.002
min4.091-4.118=-0.027
max4.473-4.551=-0.078
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1581.000-1649.000=-68.000
σ0.000
min1581.000-1649.000=-68.000
max1581.000-1649.000=-68.000
mean0.731-0.742=-0.011
σ0.042-0.020=0.022
min0.531-0.716=-0.185
max0.937-0.894=0.042
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1581.000-1649.000=-68.000
σ0.000
min1581.000-1649.000=-68.000
max1581.000-1649.000=-68.000
mean0.696-0.705=-0.009
σ0.017-0.018=-0.001
min0.668-0.673=-0.005
max0.773-0.804=-0.031

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.076-297.083=-0.007
σ0.195-0.193=0.003
min296.923-296.963=-0.040
max297.569-297.620=-0.051
mean1944.000-1920.000=24.000
σ0.000
min1944.000-1920.000=24.000
max1944.000-1920.000=24.000
mean0.585-0.575=0.010
σ0.057-0.031=0.026
min0.502-0.506=-0.004
max0.708-0.616=0.092

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.823-286.819=0.004
σ0.036-0.035=0.001
min286.773-286.775=-0.001
max286.857-286.855=0.002
mean1581.000-1649.000=-68.000
σ0.000
min1581.000-1649.000=-68.000
max1581.000-1649.000=-68.000
mean0.395-0.399=-0.004
σ0.007-0.008=-0.002
min0.389-0.386=0.004
max0.402-0.408=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1297.272-1297.230=0.042
σ0.109-0.063=0.046
min1297.113-1297.151=-0.038
max1297.408-1297.290=0.117
mean1581.000-1649.000=-68.000
σ0.000
min1581.000-1649.000=-68.000
max1581.000-1649.000=-68.000
mean2.252-2.051=0.201
σ0.065-0.053=0.012
min2.144-1.991=0.153
max2.312-2.132=0.181
iters=5
new-facts=6402
prior-facts=1
mean1541.365-1541.325=0.041
σ6.797-6.831=-0.034
min1538.205-1538.102=0.103
max1553.523-1553.540=-0.017
mean1581.000-1649.000=-68.000
σ0.000
min1581.000-1649.000=-68.000
max1581.000-1649.000=-68.000
mean2.293-2.245=0.048
σ0.257-0.144=0.113
min2.064-2.134=-0.070
max2.720-2.455=0.264
iters=5
new-facts=6402
prior-facts=6402
mean1859.115-1859.112=0.003
σ0.064-0.085=-0.021
min1859.033-1858.996=0.037
max1859.176-1859.207=-0.031
mean1769.800-1777.200=-7.400
σ173.223-136.480=36.743
min1581.000-1649.000=-68.000
max1944.000-1920.000=24.000
mean3.059-3.022=0.037
σ0.399-0.119=0.279
min2.702-2.869=-0.167
max3.737-3.151=0.586

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.298-1.231=0.067
σ0.388-0.301=0.087
min0.928-0.934=-0.006
max1.810-1.724=0.086

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.821=0.000
σ581.372-581.372=0.001
min158.134-158.134=-0.000
max1320.880-1320.879=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1581.000-1649.000=-68.000
σ0.000
min1581.000-1649.000=-68.000
max1581.000-1649.000=-68.000
mean0.554-0.547=0.007
σ0.583-0.563=0.021
min0.254-0.260=-0.006
max1.428-1.390=0.038
policies=20
mean1581.606-1581.621=-0.014
σ0.369-0.349=0.020
min1581.373-1581.386=-0.014
max1582.157-1582.140=0.017
mean920.000
σ0.000
min920.000
max920.000
mean1581.000-1649.000=-68.000
σ0.000
min1581.000-1649.000=-68.000
max1581.000-1649.000=-68.000
mean2.652-2.644=0.008
σ0.008-0.007=0.001
min2.642-2.634=0.007
max2.659-2.650=0.009
policies=200
mean15824.170-15824.158=0.012
σ0.186-0.190=-0.004
min15823.970-15824.008=-0.037
max15824.419-15824.435=-0.016
mean9200.000
σ0.000
min9200.000
max9200.000
mean1581.000-1649.000=-68.000
σ0.000
min1581.000-1649.000=-68.000
max1581.000-1649.000=-68.000
mean26.710-26.575=0.136
σ0.046-0.075=-0.029
min26.646-26.474=0.172
max26.752-26.653=0.099