Compare commits

Home / Compare b761ad5e .. 4d9642cf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.014=0.001
σ0.371-0.369=0.002
min53.872-53.871=0.001
max55.069-55.063=0.006
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.140-0.138=0.001
σ0.005-0.002=0.003
min0.133-0.136=-0.003
max0.147-0.143=0.003
cache=y
dps=1
iters=10
policies=100
mean43.323-43.323=-0.000
σ0.007-0.005=0.001
min43.312-43.315=-0.003
max43.334-43.333=0.001
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.121-0.121=0.001
σ0.004-0.004=-0.001
min0.114-0.115=-0.000
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.310-1006.302=0.008
σ1.167-1.197=-0.030
min1005.765-1005.767=-0.002
max1011.184-1011.315=-0.131
mean1047.950-1048.800=-0.850
σ312.582-310.486=2.096
min600.000-553.000=47.000
max1645.000-1513.000=132.000
mean1.578-1.540=0.037
σ0.082-0.085=-0.003
min1.489-1.463=0.026
max1.775-1.835=-0.059

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866-0.866=-0.000
σ0.003-0.003=-0.001
min0.864
max0.869-0.871=-0.001
mean1645.000-1513.000=132.000
σ0.000
min1645.000-1513.000=132.000
max1645.000-1513.000=132.000
mean0.419-0.440=-0.020
σ0.145-0.145=0.000
min0.319-0.338=-0.019
max0.667-0.690=-0.022
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1645.000-1513.000=132.000
σ0.000
min1645.000-1513.000=132.000
max1645.000-1513.000=132.000
mean0.903-0.932=-0.029
σ0.153-0.119=0.034
min0.818-0.813=0.005
max1.176-1.130=0.046
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1645.000-1513.000=132.000
σ0.000
min1645.000-1513.000=132.000
max1645.000-1513.000=132.000
mean0.538-0.592=-0.054
σ0.050-0.039=0.010
min0.504-0.541=-0.037
max0.624-0.628=-0.004
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1645.000-1513.000=132.000
σ0.000
min1645.000-1513.000=132.000
max1645.000-1513.000=132.000
mean0.834-0.896=-0.063
σ0.037-0.047=-0.010
min0.808-0.860=-0.051
max0.896-0.975=-0.079

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.105=0.010
σ0.025-0.039=-0.014
min964.094-964.077=0.017
max964.155-964.173=-0.018
mean1645.000-1513.000=132.000
σ0.000
min1645.000-1513.000=132.000
max1645.000-1513.000=132.000
mean0.846-0.841=0.004
σ0.022-0.021=0.001
min0.808-0.806=0.002
max0.866-0.854=0.011
name=cdr_enhanced_4k_loc.art
mean884.711-884.710=0.001
σ0.007-0.005=0.002
min884.705-884.703=0.001
max884.722-884.717=0.005
mean1645.000-1513.000=132.000
σ0.000
min1645.000-1513.000=132.000
max1645.000-1513.000=132.000
mean0.717-0.698=0.018
σ0.033-0.072=-0.038
min0.661-0.576=0.085
max0.739-0.760=-0.021

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.721=-0.004
mean1645.000-1513.000=132.000
σ0.000
min1645.000-1513.000=132.000
max1645.000-1513.000=132.000
mean4.210-3.533=0.677
σ0.078-0.079=-0.002
min4.084-3.410=0.674
max4.617-3.955=0.663
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1645.000-1513.000=132.000
σ0.000
min1645.000-1513.000=132.000
max1645.000-1513.000=132.000
mean4.230-3.540=0.691
σ0.101-0.082=0.019
min3.710-3.364=0.346
max4.540-3.819=0.722
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1645.000-1513.000=132.000
σ0.000
min1645.000-1513.000=132.000
max1645.000-1513.000=132.000
mean0.739-0.539=0.200
σ0.019-0.035=-0.016
min0.656-0.498=0.158
max0.856-0.776=0.080
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1645.000-1513.000=132.000
σ0.000
min1645.000-1513.000=132.000
max1645.000-1513.000=132.000
mean0.700-0.514=0.186
σ0.013-0.028=-0.014
min0.671-0.471=0.200
max0.759-0.587=0.172

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.024-296.264=-0.240
σ0.230-0.193=0.037
min295.846-296.128=-0.282
max296.653-296.780=-0.127
mean1909.000-1902.000=7.000
σ0.000
min1909.000-1902.000=7.000
max1909.000-1902.000=7.000
mean0.560-0.574=-0.014
σ0.061-0.052=0.009
min0.502-0.507=-0.006
max0.691-0.693=-0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.692-284.699=-0.006
σ0.038-0.040=-0.002
min284.645-284.644=0.001
max284.735-284.743=-0.007
mean1645.000-1513.000=132.000
σ0.000
min1645.000-1513.000=132.000
max1645.000-1513.000=132.000
mean0.397-0.399=-0.002
σ0.010-0.008=0.002
min0.386-0.389=-0.003
max0.409-0.407=0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.040-1295.075=-0.036
σ0.094-0.103=-0.009
min1294.959-1294.958=0.000
max1295.192-1295.208=-0.015
mean1645.000-1513.000=132.000
σ0.000
min1645.000-1513.000=132.000
max1645.000-1513.000=132.000
mean1.939-1.920=0.018
σ0.199-0.100=0.098
min1.802-1.796=0.006
max2.274-2.036=0.238
iters=5
new-facts=6402
prior-facts=1
mean1539.246-1539.191=0.055
σ6.816-6.863=-0.047
min1536.086-1535.903=0.183
max1551.438-1551.462=-0.024
mean1645.000-1513.000=132.000
σ0.000
min1645.000-1513.000=132.000
max1645.000-1513.000=132.000
mean2.322-2.283=0.039
σ0.278-0.273=0.005
min2.107-2.032=0.075
max2.755-2.612=0.143
iters=5
new-facts=6402
prior-facts=6402
mean1856.990-1856.986=0.005
σ0.051-0.054=-0.003
min1856.939-1856.935=0.005
max1857.058-1857.063=-0.004
mean1777.400-1747.200=30.200
σ129.201-167.853=-38.653
min1645.000-1513.000=132.000
max1909.000-1902.000=7.000
mean3.087-3.052=0.035
σ0.293-0.240=0.053
min2.865-2.847=0.018
max3.598-3.462=0.135

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.165-1.607=-0.442
σ0.242-0.279=-0.037
min0.934-1.270=-0.336
max1.540-1.861=-0.322

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.784-447.785=-0.002
σ581.212-581.212=0.000
min157.175-157.175=-0.000
max1319.602-1319.604=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1513.000=132.000
σ0.000
min1645.000-1513.000=132.000
max1645.000-1513.000=132.000
mean0.540-0.523=0.016
σ0.549-0.525=0.024
min0.265-0.259=0.006
max1.364-1.311=0.053
policies=20
mean1572.054-1572.110=-0.056
σ0.295-0.365=-0.070
min1571.847-1571.868=-0.021
max1572.491-1572.652=-0.161
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1513.000=132.000
σ0.000
min1645.000-1513.000=132.000
max1645.000-1513.000=132.000
mean2.647-2.636=0.011
σ0.025-0.026=-0.001
min2.630-2.611=0.019
max2.683-2.673=0.010
policies=200
mean15728.940-15729.080=-0.139
σ0.181-0.080=0.100
min15728.688-15729.007=-0.318
max15729.085-15729.193=-0.108
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1513.000=132.000
σ0.000
min1645.000-1513.000=132.000
max1645.000-1513.000=132.000
mean26.618-26.528=0.090
σ0.105-0.072=0.034
min26.556-26.442=0.114
max26.775-26.605=0.169