Compare commits

Home / Compare 299585f7 .. 756f4f72

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-54.015=0.000
σ0.370-0.367=0.003
min53.879-53.866=0.012
max55.068-55.061=0.008
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.139-0.141=-0.002
σ0.004-0.004=-0.000
min0.135-0.137=-0.002
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=-0.000
σ0.007-0.005=0.002
min43.314-43.313=0.001
max43.336-43.329=0.007
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.122-0.120=0.002
σ0.005-0.003=0.002
min0.116-0.115=0.000
max0.130-0.124=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1006.311=-0.002
σ1.175-1.169=0.005
min1005.763-1005.743=0.020
max1011.231-1011.206=0.025
mean1051.150-1045.500=5.650
σ304.913-313.773=-8.860
min595.000
max1645.000-1643.000=2.000
mean1.543-1.518=0.025
σ0.060-0.065=-0.005
min1.475-1.439=0.035
max1.668-1.653=0.015

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.411-0.418=-0.008
σ0.142-0.133=0.009
min0.326-0.332=-0.006
max0.663-0.651=0.012
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.875-0.887=-0.012
σ0.096-0.094=0.001
min0.809-0.818=-0.008
max1.041-1.052=-0.011
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.540-0.569=-0.030
σ0.050-0.069=-0.019
min0.488-0.502=-0.014
max0.621-0.655=-0.034
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.842-0.845=-0.003
σ0.036-0.038=-0.002
min0.816-0.813=0.004
max0.904-0.911=-0.006

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.111-964.115=-0.004
σ0.030-0.035=-0.005
min964.086-964.086=0.001
max964.162-964.171=-0.009
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.824-0.806=0.018
σ0.031-0.050=-0.019
min0.790-0.744=0.046
max0.855-0.857=-0.002
name=cdr_enhanced_4k_loc.art
mean884.711-884.712=-0.001
σ0.004-0.008=-0.004
min884.705-884.703=0.001
max884.716-884.722=-0.006
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.727-0.728=-0.001
σ0.024-0.023=0.000
min0.696-0.687=0.009
max0.756-0.744=0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.714=0.000
σ0.002-0.002=0.000
min7.714
max7.719-7.718=0.001
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean4.240-4.246=-0.006
σ0.076-0.084=-0.008
min4.125-4.080=0.045
max4.556-4.491=0.065
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666-7.667=-0.001
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean4.238-4.260=-0.022
σ0.067-0.068=-0.001
min4.096-4.153=-0.057
max4.477-4.476=0.001
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.736-0.742=-0.006
σ0.019-0.018=0.001
min0.698-0.706=-0.008
max0.851-0.863=-0.012
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.696-0.701=-0.005
σ0.014-0.017=-0.002
min0.665-0.668=-0.003
max0.758-0.767=-0.009

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.176-296.148=0.028
σ0.204-0.245=-0.041
min296.009-295.854=0.154
max296.726-296.789=-0.062
mean1897.000-1905.000=-8.000
σ0.000
min1897.000-1905.000=-8.000
max1897.000-1905.000=-8.000
mean0.584-0.565=0.019
σ0.053-0.035=0.018
min0.511-0.506=0.005
max0.704-0.606=0.097

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.702-284.698=0.004
σ0.026-0.039=-0.013
min284.674-284.648=0.026
max284.731-284.743=-0.011
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.398-0.398=-0.000
σ0.010-0.010=-0.000
min0.387-0.387=0.000
max0.405-0.409=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.077-1295.076=0.002
σ0.100-0.111=-0.011
min1294.959-1294.955=0.003
max1295.190-1295.221=-0.030
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean1.897-1.883=0.014
σ0.074-0.063=0.011
min1.805-1.814=-0.008
max1.967-1.947=0.020
iters=5
new-facts=6402
prior-facts=1
mean1539.270-1539.209=0.061
σ6.819-6.825=-0.006
min1536.013-1535.983=0.030
max1551.465-1551.416=0.049
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean2.452-2.141=0.311
σ0.255-0.107=0.148
min2.047-2.056=-0.008
max2.667-2.324=0.343
iters=5
new-facts=6402
prior-facts=6402
mean1857.001-1856.976=0.025
σ0.079-0.070=0.009
min1856.920-1856.892=0.028
max1857.098-1857.071=0.027
mean1768.200-1772.800=-4.600
σ123.074-129.442=-6.368
min1645.000-1643.000=2.000
max1897.000-1905.000=-8.000
mean3.110-3.026=0.085
σ0.266-0.192=0.074
min2.856-2.867=-0.011
max3.513-3.347=0.165

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.291-1.226=0.065
σ0.331-0.292=0.039
min0.930-0.936=-0.006
max1.778-1.556=0.222

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.786=-0.001
σ581.212-581.213=-0.000
min157.177-157.178=-0.001
max1319.603-1319.605=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.556-0.543=0.013
σ0.590-0.562=0.028
min0.259-0.259=0.000
max1.441-1.386=0.055
policies=20
mean1572.097-1572.101=-0.004
σ0.366-0.354=0.012
min1571.852-1571.860=-0.008
max1572.642-1572.627=0.015
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean2.636-2.626=0.010
σ0.020-0.022=-0.002
min2.608-2.604=0.004
max2.653-2.655=-0.003
policies=200
mean15728.976-15728.974=0.002
σ0.109-0.105=0.004
min15728.817-15728.878=-0.061
max15729.056-15729.081=-0.025
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean26.525-26.504=0.021
σ0.065-0.032=0.034
min26.453-26.470=-0.017
max26.608-26.541=0.067