Compare commits

Home / Compare ffc2092c .. e1d4490f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.013=0.001
σ0.369-0.370=-0.001
min53.873-53.870=0.003
max55.062-55.066=-0.003
mean415.700-418.000=-2.300
σ0.483-0.000=0.483
min415.000-418.000=-3.000
max416.000-418.000=-2.000
mean0.140-0.135=0.005
σ0.004-0.005=-0.001
min0.136-0.129=0.007
max0.148-0.142=0.006
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.001
σ0.007-0.008=-0.001
min43.314-43.313=0.001
max43.338-43.333=0.004
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.127-0.122=0.005
σ0.010-0.004=0.006
min0.115-0.118=-0.003
max0.141-0.128=0.013

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.308-1006.309=-0.001
σ1.188-1.169=0.018
min1005.771-1005.738=0.034
max1011.287-1011.203=0.083
mean1046.550-1060.450=-13.900
σ313.011-303.755=9.256
min597.000-601.000=-4.000
max1644.000-1459.000=185.000
mean1.570-1.549=0.021
σ0.081-0.070=0.010
min1.471-1.461=0.010
max1.813-1.719=0.094

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1644.000-1459.000=185.000
σ0.000
min1644.000-1459.000=185.000
max1644.000-1459.000=185.000
mean0.413-0.414=-0.001
σ0.131-0.147=-0.016
min0.329-0.335=-0.006
max0.645-0.676=-0.031
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1644.000-1459.000=185.000
σ0.000
min1644.000-1459.000=185.000
max1644.000-1459.000=185.000
mean0.886-0.904=-0.017
σ0.098-0.102=-0.004
min0.816-0.841=-0.025
max1.057-1.083=-0.026
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1644.000-1459.000=185.000
σ0.000
min1644.000-1459.000=185.000
max1644.000-1459.000=185.000
mean0.551-0.550=0.001
σ0.044-0.047=-0.004
min0.512-0.512=0.001
max0.621-0.631=-0.009
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1644.000-1459.000=185.000
σ0.000
min1644.000-1459.000=185.000
max1644.000-1459.000=185.000
mean0.848-0.849=-0.001
σ0.037-0.043=-0.005
min0.807-0.809=-0.002
max0.905-0.920=-0.015

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.097=0.017
σ0.034-0.032=0.002
min964.086-964.077=0.009
max964.172-964.154=0.018
mean1644.000-1459.000=185.000
σ0.000
min1644.000-1459.000=185.000
max1644.000-1459.000=185.000
mean0.830-0.819=0.011
σ0.019-0.024=-0.005
min0.806-0.787=0.019
max0.851-0.846=0.005
name=cdr_enhanced_4k_loc.art
mean884.712-884.710=0.002
σ0.007-0.006=0.001
min884.705-884.703=0.001
max884.722-884.716=0.007
mean1644.000-1459.000=185.000
σ0.000
min1644.000-1459.000=185.000
max1644.000-1459.000=185.000
mean0.709-0.656=0.054
σ0.034-0.048=-0.014
min0.656-0.587=0.069
max0.739-0.720=0.019

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.719-7.719=0.000
mean1644.000-1459.000=185.000
σ0.000
min1644.000-1459.000=185.000
max1644.000-1459.000=185.000
mean4.235-4.269=-0.034
σ0.067-0.091=-0.025
min4.099-4.137=-0.038
max4.459-4.554=-0.095
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666-7.667=-0.001
mean1644.000-1459.000=185.000
σ0.000
min1644.000-1459.000=185.000
max1644.000-1459.000=185.000
mean4.181-4.272=-0.092
σ0.069-0.071=-0.002
min4.058-4.153=-0.095
max4.412-4.489=-0.077
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1644.000-1459.000=185.000
σ0.000
min1644.000-1459.000=185.000
max1644.000-1459.000=185.000
mean0.731-0.733=-0.003
σ0.016-0.027=-0.011
min0.710-0.702=0.008
max0.845-0.908=-0.063
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1644.000-1459.000=185.000
σ0.000
min1644.000-1459.000=185.000
max1644.000-1459.000=185.000
mean0.696-0.692=0.004
σ0.015-0.016=-0.001
min0.666-0.659=0.007
max0.775-0.771=0.004

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.251-296.052=0.199
σ0.250-0.218=0.032
min296.053-295.840=0.212
max296.907-296.573=0.333
mean1901.000-1920.000=-19.000
σ0.000
min1901.000-1920.000=-19.000
max1901.000-1920.000=-19.000
mean0.570-0.586=-0.016
σ0.034-0.042=-0.008
min0.505-0.522=-0.017
max0.638-0.681=-0.043

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.692-284.690=0.001
σ0.033-0.033=-0.001
min284.654-284.652=0.002
max284.732-284.725=0.007
mean1644.000-1459.000=185.000
σ0.000
min1644.000-1459.000=185.000
max1644.000-1459.000=185.000
mean0.397-0.390=0.007
σ0.010-0.007=0.004
min0.386-0.384=0.002
max0.406-0.402=0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.079-1295.043=0.036
σ0.104-0.093=0.011
min1294.960-1294.951=0.009
max1295.198-1295.189=0.009
mean1644.000-1459.000=185.000
σ0.000
min1644.000-1459.000=185.000
max1644.000-1459.000=185.000
mean1.892-1.941=-0.050
σ0.080-0.161=-0.081
min1.797-1.806=-0.009
max1.967-2.208=-0.241
iters=5
new-facts=6402
prior-facts=1
mean1539.224-1539.288=-0.064
σ6.847-6.774=0.073
min1535.943-1536.148=-0.205
max1551.467-1551.404=0.063
mean1644.000-1459.000=185.000
σ0.000
min1644.000-1459.000=185.000
max1644.000-1459.000=185.000
mean2.366-2.405=-0.039
σ0.232-0.299=-0.067
min2.024-2.074=-0.050
max2.613-2.746=-0.133
iters=5
new-facts=6402
prior-facts=6402
mean1856.986-1856.989=-0.003
σ0.053-0.050=0.003
min1856.938-1856.948=-0.009
max1857.064-1857.068=-0.003
mean1771.200-1759.400=11.800
σ124.339-176.453=-52.114
min1644.000-1508.000=136.000
max1901.000-1920.000=-19.000
mean3.049-3.072=-0.024
σ0.309-0.380=-0.071
min2.847-2.826=0.021
max3.590-3.747=-0.157

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.214-1.775=-0.561
σ0.337-0.112=0.225
min0.935-1.590=-0.655
max1.791-1.871=-0.080

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.785=0.001
σ581.212-581.212=-0.000
min157.179-157.177=0.002
max1319.604-1319.604=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1459.000=185.000
σ0.000
min1644.000-1459.000=185.000
max1644.000-1459.000=185.000
mean0.539-0.555=-0.016
σ0.550-0.588=-0.038
min0.262-0.257=0.004
max1.364-1.437=-0.073
policies=20
mean1572.111-1572.094=0.018
σ0.361-0.356=0.005
min1571.868-1571.853=0.015
max1572.648-1572.623=0.025
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1459.000=185.000
σ0.000
min1644.000-1459.000=185.000
max1644.000-1459.000=185.000
mean2.638-2.627=0.012
σ0.020-0.008=0.012
min2.618-2.615=0.003
max2.657-2.635=0.022
policies=200
mean15729.029-15729.077=-0.049
σ0.065-0.069=-0.004
min15728.949-15729.014=-0.065
max15729.096-15729.175=-0.079
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1459.000=185.000
σ0.000
min1644.000-1459.000=185.000
max1644.000-1459.000=185.000
mean26.578-26.541=0.038
σ0.025-0.122=-0.097
min26.561-26.433=0.128
max26.615-26.711=-0.096