Compare commits

Home / Compare 29c9f0ab .. 9707b450

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.057=-0.000
σ0.367-0.370=-0.002
min53.913-53.910=0.003
max55.101-55.109=-0.007
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.138-0.139=-0.001
σ0.006-0.005=0.002
min0.130-0.134=-0.004
max0.148-0.147=0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.396=-0.002
σ0.006-0.006=-0.000
min43.385-43.386=-0.001
max43.402-43.405=-0.003
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.122-0.121=0.001
σ0.004-0.005=-0.001
min0.119-0.114=0.005
max0.128-0.130=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.967-1006.964=0.003
σ0.857-0.858=-0.001
min1006.463-1006.463=0.000
max1010.498-1010.509=-0.011
mean1048.850-1044.550=4.300
σ310.190-304.850=5.341
min553.000-565.000=-12.000
max1642.000-1660.000=-18.000
mean1.534-1.520=0.014
σ0.074-0.066=0.008
min1.465-1.365=0.100
max1.764-1.649=0.114

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1642.000-1660.000=-18.000
σ0.000
min1642.000-1660.000=-18.000
max1642.000-1660.000=-18.000
mean0.417-0.405=0.012
σ0.141-0.141=0.000
min0.330-0.333=-0.003
max0.665-0.656=0.008
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1642.000-1660.000=-18.000
σ0.000
min1642.000-1660.000=-18.000
max1642.000-1660.000=-18.000
mean0.884-0.885=-0.001
σ0.104-0.094=0.010
min0.806-0.831=-0.025
max1.064-1.050=0.014
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1642.000-1660.000=-18.000
σ0.000
min1642.000-1660.000=-18.000
max1642.000-1660.000=-18.000
mean0.545-0.532=0.013
σ0.060-0.050=0.010
min0.498-0.503=-0.005
max0.645-0.621=0.025
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1642.000-1660.000=-18.000
σ0.000
min1642.000-1660.000=-18.000
max1642.000-1660.000=-18.000
mean0.847-0.851=-0.003
σ0.048-0.045=0.003
min0.815-0.814=0.001
max0.929-0.926=0.003

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.837=0.003
σ0.034-0.030=0.003
min964.812-964.809=0.003
max964.897-964.887=0.010
mean1642.000-1660.000=-18.000
σ0.000
min1642.000-1660.000=-18.000
max1642.000-1660.000=-18.000
mean0.850-0.835=0.015
σ0.024-0.026=-0.002
min0.809-0.805=0.004
max0.872-0.858=0.014
name=cdr_enhanced_4k_loc.art
mean885.511-885.512=-0.001
σ0.006-0.006=0.000
min885.504-885.505=-0.001
max885.521-885.520=0.001
mean1642.000-1660.000=-18.000
σ0.000
min1642.000-1660.000=-18.000
max1642.000-1660.000=-18.000
mean0.701-0.739=-0.038
σ0.037-0.015=0.022
min0.663-0.721=-0.058
max0.741-0.761=-0.020

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719
mean1642.000-1660.000=-18.000
σ0.000
min1642.000-1660.000=-18.000
max1642.000-1660.000=-18.000
mean4.179-4.265=-0.086
σ0.093-0.100=-0.007
min4.026-4.090=-0.064
max4.519-4.645=-0.127
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1642.000-1660.000=-18.000
σ0.000
min1642.000-1660.000=-18.000
max1642.000-1660.000=-18.000
mean4.192-4.242=-0.050
σ0.068-0.082=-0.014
min4.053-4.083=-0.030
max4.420-4.525=-0.105
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1642.000-1660.000=-18.000
σ0.000
min1642.000-1660.000=-18.000
max1642.000-1660.000=-18.000
mean0.745-0.737=0.008
σ0.019-0.019=0.000
min0.717-0.702=0.015
max0.871-0.862=0.009
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1642.000-1660.000=-18.000
σ0.000
min1642.000-1660.000=-18.000
max1642.000-1660.000=-18.000
mean0.705-0.698=0.007
σ0.018-0.014=0.003
min0.674-0.668=0.006
max0.821-0.777=0.044

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.328-295.690=-0.361
σ0.163-0.155=0.008
min295.073-295.576=-0.503
max295.667-296.090=-0.423
mean2030.000-2017.000=13.000
σ0.000
min2030.000-2017.000=13.000
max2030.000-2017.000=13.000
mean0.531-0.578=-0.047
σ0.027-0.027=0.000
min0.502-0.523=-0.021
max0.572-0.601=-0.029

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.402-285.395=0.006
σ0.036-0.033=0.003
min285.350-285.353=-0.003
max285.442-285.431=0.011
mean1642.000-1660.000=-18.000
σ0.000
min1642.000-1660.000=-18.000
max1642.000-1660.000=-18.000
mean0.399-0.388=0.011
σ0.014-0.008=0.006
min0.379-0.380=-0.001
max0.415-0.398=0.017
iters=5
new-facts=1
prior-facts=6402
mean1295.784-1295.783=0.001
σ0.119-0.122=-0.002
min1295.648-1295.657=-0.009
max1295.933-1295.942=-0.009
mean1642.000-1660.000=-18.000
σ0.000
min1642.000-1660.000=-18.000
max1642.000-1660.000=-18.000
mean1.873-1.913=-0.040
σ0.061-0.104=-0.043
min1.817-1.793=0.024
max1.941-2.033=-0.092
iters=5
new-facts=6402
prior-facts=1
mean1539.908-1539.986=-0.078
σ6.888-6.820=0.069
min1536.641-1536.720=-0.079
max1552.226-1552.180=0.046
mean1642.000-1660.000=-18.000
σ0.000
min1642.000-1660.000=-18.000
max1642.000-1660.000=-18.000
mean2.214-2.453=-0.239
σ0.160-0.302=-0.142
min2.031-2.057=-0.026
max2.397-2.897=-0.500
iters=5
new-facts=6402
prior-facts=6402
mean1857.680-1857.679=0.001
σ0.063-0.068=-0.004
min1857.617-1857.592=0.025
max1857.766-1857.759=0.007
mean1777.600-1788.600=-11.000
σ170.400-154.481=15.920
min1642.000-1660.000=-18.000
max2030.000-2017.000=13.000
mean2.871-3.042=-0.171
σ0.036-0.331=-0.295
min2.824-2.700=0.124
max2.916-3.536=-0.620

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.234-1.235=-0.000
σ0.355-0.384=-0.029
min0.937-0.936=0.001
max1.831-1.888=-0.057

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.707-445.706=0.001
σ580.934-580.935=-0.001
min155.239-155.236=0.003
max1317.108-1317.108=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1660.000=-18.000
σ0.000
min1642.000-1660.000=-18.000
max1642.000-1660.000=-18.000
mean0.537-0.537=-0.000
σ0.562-0.554=0.008
min0.249-0.259=-0.010
max1.380-1.368=0.012
policies=20
mean1552.653-1552.657=-0.003
σ0.317-0.319=-0.002
min1552.433-1552.437=-0.003
max1553.124-1553.131=-0.007
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1660.000=-18.000
σ0.000
min1642.000-1660.000=-18.000
max1642.000-1660.000=-18.000
mean2.578-2.575=0.003
σ0.013-0.009=0.005
min2.566-2.565=0.001
max2.596-2.586=0.010
policies=200
mean15534.741-15534.653=0.087
σ0.062-0.165=-0.103
min15534.689-15534.513=0.175
max15534.810-15534.865=-0.055
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1660.000=-18.000
σ0.000
min1642.000-1660.000=-18.000
max1642.000-1660.000=-18.000
mean25.982-26.011=-0.029
σ0.155-0.235=-0.080
min25.797-25.824=-0.027
max26.177-26.355=-0.178