Compare commits

Home / Compare 9390a7b6 .. a8cfd6c3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.055=-0.001
σ0.368-0.371=-0.003
min53.910-53.909=0.001
max55.101-55.109=-0.008
mean421.000-418.000=3.000
σ0.000
min421.000-418.000=3.000
max421.000-418.000=3.000
mean0.141-0.143=-0.002
σ0.003-0.004=-0.000
min0.138-0.137=0.002
max0.148-0.149=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=0.000
σ0.006-0.006=-0.000
min43.383-43.385=-0.002
max43.405-43.407=-0.002
mean421.000-418.000=3.000
σ0.000
min421.000-418.000=3.000
max421.000-418.000=3.000
mean0.122-0.125=-0.003
σ0.004-0.004=-0.001
min0.116-0.121=-0.005
max0.128-0.131=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.004-1007.006=-0.002
σ1.191-1.188=0.003
min1006.434-1006.434=0.000
max1011.996-1011.983=0.012
mean1056.350-1053.150=3.200
σ305.537-307.903=-2.366
min582.000-578.000=4.000
max1650.000-1645.000=5.000
mean1.543-1.555=-0.013
σ0.080-0.094=-0.014
min1.440-1.470=-0.030
max1.755-1.828=-0.073

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.000
σ0.002-0.003=-0.000
min0.882
max0.887
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.419-0.473=-0.054
σ0.137-0.144=-0.007
min0.347-0.351=-0.004
max0.663-0.658=0.005
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.890-0.878=0.013
σ0.113-0.089=0.024
min0.820-0.803=0.018
max1.088-1.032=0.056
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.535-0.556=-0.021
σ0.053-0.048=0.005
min0.501-0.521=-0.019
max0.625-0.636=-0.011
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.847-0.866=-0.019
σ0.030-0.064=-0.034
min0.824-0.819=0.005
max0.896-0.967=-0.071

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.835=0.004
σ0.034-0.031=0.003
min964.811-964.802=0.009
max964.895-964.886=0.009
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.833-0.845=-0.012
σ0.022-0.019=0.003
min0.804-0.813=-0.009
max0.854-0.863=-0.009
name=cdr_enhanced_4k_loc.art
mean885.512-885.513=-0.000
σ0.007-0.005=0.002
min885.505-885.504=0.001
max885.523-885.516=0.007
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.713-0.719=-0.006
σ0.013-0.032=-0.018
min0.703-0.674=0.029
max0.731-0.746=-0.015

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.722=-0.001
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean3.893-3.512=0.381
σ0.395-0.091=0.304
min3.365-3.381=-0.016
max4.511-3.800=0.712
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean3.475-3.482=-0.007
σ0.067-0.076=-0.009
min3.351-3.349=0.002
max3.735-3.773=-0.038
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.731-0.630=0.102
σ0.017-0.104=-0.087
min0.704-0.513=0.191
max0.845-0.839=0.006
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.696-0.505=0.191
σ0.014-0.011=0.003
min0.669-0.483=0.186
max0.768-0.545=0.223

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.026-297.224=-0.198
σ0.235-0.217=0.018
min296.791-297.020=-0.229
max297.639-297.773=-0.134
mean2039.000-1892.000=147.000
σ0.000
min2039.000-1892.000=147.000
max2039.000-1892.000=147.000
mean0.549-0.587=-0.039
σ0.034-0.036=-0.002
min0.500-0.505=-0.004
max0.581-0.647=-0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.816-286.828=-0.012
σ0.040-0.035=0.005
min286.760-286.788=-0.028
max286.858-286.871=-0.013
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.397-0.399=-0.003
σ0.010-0.009=0.000
min0.389-0.390=-0.001
max0.412-0.411=0.001
iters=5
new-facts=1
prior-facts=6402
mean1297.230-1297.257=-0.027
σ0.077-0.116=-0.039
min1297.144-1297.095=0.050
max1297.326-1297.397=-0.071
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean2.088-2.193=-0.104
σ0.066-0.078=-0.013
min2.018-2.060=-0.042
max2.174-2.267=-0.093
iters=5
new-facts=6402
prior-facts=1
mean1541.349-1541.430=-0.081
σ6.830-6.799=0.031
min1538.154-1538.274=-0.121
max1553.564-1553.590=-0.026
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean2.293-2.450=-0.157
σ0.240-0.205=0.035
min2.123-2.197=-0.074
max2.686-2.749=-0.063
iters=5
new-facts=6402
prior-facts=6402
mean1859.114-1859.114=-0.001
σ0.076-0.066=0.010
min1858.992-1859.024=-0.033
max1859.188-1859.192=-0.003
mean1787.000-1774.800=12.200
σ168.882-120.265=48.616
min1650.000-1645.000=5.000
max2039.000-1892.000=147.000
mean2.903-3.014=-0.112
σ0.103-0.160=-0.057
min2.795-2.844=-0.049
max3.061-3.275=-0.214

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.198-1.310=-0.112
σ0.360-0.306=0.054
min0.939-1.053=-0.114
max1.797-1.760=0.037

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.820=0.002
σ581.372-581.372=-0.001
min158.135-158.133=0.002
max1320.880-1320.879=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.552-0.584=-0.032
σ0.570-0.630=-0.060
min0.263-0.268=-0.004
max1.407-1.529=-0.122
policies=20
mean1581.635-1581.613=0.023
σ0.365-0.360=0.004
min1581.389-1581.367=0.022
max1582.178-1582.148=0.030
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean2.641-2.645=-0.004
σ0.015-0.010=0.004
min2.624-2.635=-0.011
max2.658-2.659=-0.001
policies=200
mean15824.203-15824.219=-0.015
σ0.059-0.137=-0.078
min15824.140-15824.032=0.108
max15824.273-15824.362=-0.088
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean26.692-26.678=0.014
σ0.028-0.057=-0.029
min26.665-26.613=0.052
max26.731-26.738=-0.008