Compare commits

Home / Compare aaf3d37c .. b12f6da6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.706-54.032=-0.326
σ0.367-0.369=-0.001
min53.565-53.885=-0.320
max54.751-55.080=-0.330
mean416.700-416.000=0.700
σ0.483-0.000=0.483
min416.000
max417.000-416.000=1.000
mean0.140-0.138=0.001
σ0.003-0.005=-0.001
min0.136-0.133=0.003
max0.146-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.059-43.384=-0.326
σ0.006-0.005=0.001
min43.048-43.376=-0.328
max43.067-43.391=-0.324
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.123-0.123=-0.000
σ0.004-0.004=0.000
min0.118-0.119=-0.001
max0.129-0.129=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.105-1006.329=-1.225
σ0.888-0.896=-0.009
min1004.637-1005.858=-1.222
max1008.782-1010.054=-1.272
mean1055.100-1049.550=5.550
σ321.597-317.712=3.885
min553.000-546.000=7.000
max1632.000-1650.000=-18.000
mean1.628-1.572=0.057
σ0.090-0.117=-0.027
min1.556-1.363=0.193
max1.879-1.817=0.062

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean0.418-0.414=0.004
σ0.135-0.129=0.006
min0.335-0.331=0.003
max0.658-0.641=0.017
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean0.878-0.878=-0.001
σ0.086-0.067=0.020
min0.830-0.821=0.009
max1.031-0.990=0.040
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean0.542-0.543=-0.001
σ0.057-0.043=0.014
min0.485-0.502=-0.017
max0.636-0.611=0.025
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean0.840-0.843=-0.003
σ0.039-0.031=0.009
min0.808-0.813=-0.005
max0.904-0.890=0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.554-963.551=0.004
σ0.026-0.027=-0.001
min963.535-963.527=0.007
max963.599-963.594=0.005
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean0.827-0.774=0.053
σ0.039-0.039=-0.000
min0.773-0.704=0.069
max0.860-0.794=0.066
name=cdr_enhanced_4k_loc.art
mean884.853-884.856=-0.003
σ0.008-0.005=0.003
min884.847
max884.866-884.860=0.006
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean0.713-0.693=0.020
σ0.065-0.040=0.025
min0.596-0.654=-0.058
max0.746-0.738=0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.712-7.709=0.003
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean4.266-4.208=0.058
σ0.067-0.078=-0.011
min4.148-4.075=0.073
max4.538-4.595=-0.057
name=record_render_large_syntax_err.art
mean7.655-7.655=-0.000
σ0.002-0.002=-0.000
min7.654
max7.658-7.660=-0.002
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean4.265-4.210=0.055
σ0.069-0.104=-0.035
min4.144-4.087=0.057
max4.636-4.848=-0.212
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean0.745-0.748=-0.002
σ0.016-0.018=-0.001
min0.717-0.716=0.002
max0.863-0.841=0.022
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean0.703-0.714=-0.011
σ0.016-0.026=-0.010
min0.678-0.525=0.153
max0.803-0.795=0.008

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.342-295.463=-1.120
σ0.279-0.180=0.099
min294.065-295.294=-1.230
max295.075-295.938=-0.863
mean1974.000-1907.000=67.000
σ0.000
min1974.000-1907.000=67.000
max1974.000-1907.000=67.000
mean0.570-0.579=-0.009
σ0.067-0.041=0.026
min0.495-0.499=-0.004
max0.717-0.649=0.068

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.493-285.248=-3.755
σ0.036-0.043=-0.007
min281.453-285.187=-3.734
max281.529-285.289=-3.760
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean0.379-0.403=-0.023
σ0.001-0.009=-0.008
min0.378-0.392=-0.014
max0.380-0.411=-0.031
iters=5
new-facts=1
prior-facts=6402
mean1291.479-1295.198=-3.719
σ0.117-0.112=0.005
min1291.352-1295.080=-3.728
max1291.646-1295.338=-3.692
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean1.928-1.914=0.014
σ0.109-0.090=0.019
min1.788-1.816=-0.028
max2.046-2.015=0.031
iters=5
new-facts=6402
prior-facts=1
mean1534.344-1538.078=-3.735
σ4.031-4.047=-0.016
min1532.322-1536.047=-3.725
max1541.543-1545.309=-3.766
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean2.349-2.257=0.092
σ0.263-0.208=0.054
min2.093-2.022=0.071
max2.705-2.448=0.257
iters=5
new-facts=6402
prior-facts=6402
mean1853.374-1857.100=-3.726
σ0.078-0.056=0.021
min1853.284-1857.040=-3.757
max1853.469-1857.163=-3.694
mean1802.800-1775.200=27.600
σ168.869-128.712=40.157
min1632.000-1650.000=-18.000
max1974.000-1907.000=67.000
mean3.253-3.016=0.237
σ0.334-0.122=0.212
min2.892-2.877=0.014
max3.656-3.200=0.456

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.424-1.436=-0.012
σ0.305-0.185=0.120
min1.102-1.118=-0.017
max1.873-1.577=0.296

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.429-443.610=-1.181
σ577.063-577.065=-0.002
min153.895-155.074=-1.180
max1308.024-1309.208=-1.184
mean96.250
σ8.500
min92.000
max109.000
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean0.521-0.545=-0.025
σ0.515-0.564=-0.049
min0.261-0.258=0.002
max1.293-1.391=-0.098
policies=20
mean1539.224-1551.045=-11.821
σ0.321-0.331=-0.010
min1538.999-1550.819=-11.820
max1539.700-1551.537=-11.837
mean920.000
σ0.000
min920.000
max920.000
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean2.573-2.599=-0.026
σ0.016-0.017=-0.001
min2.554-2.575=-0.021
max2.589-2.615=-0.026
policies=200
mean15400.365-15518.538=-118.174
σ0.085-0.092=-0.007
min15400.270-15518.468=-118.198
max15400.467-15518.664=-118.197
mean9200.000
σ0.000
min9200.000
max9200.000
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean25.961-26.243=-0.282
σ0.075-0.077=-0.002
min25.862-26.178=-0.316
max26.035-26.354=-0.319