Compare commits

Home / Compare 17d543b0 .. 4840e8c8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.705-53.705=0.000
σ0.367-0.365=0.002
min53.569-53.565=0.005
max54.750-54.744=0.006
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.139-0.137=0.002
σ0.004-0.005=-0.001
min0.135-0.130=0.005
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.059-43.059=-0.000
σ0.005-0.007=-0.002
min43.053-43.049=0.003
max43.068-43.069=-0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.121-0.121=0.000
σ0.004-0.004=0.001
min0.115-0.118=-0.003
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.109-1005.104=0.005
σ0.875-0.894=-0.019
min1004.606-1004.640=-0.034
max1008.730-1008.809=-0.080
mean1043.550-1050.200=-6.650
σ297.384-315.471=-18.087
min571.000-593.000=-22.000
max1467.000-1653.000=-186.000
mean1.609-1.617=-0.008
σ0.058-0.106=-0.048
min1.549-1.450=0.099
max1.754-1.895=-0.141

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.882=0.001
σ0.002-0.002=0.000
min0.881
max0.886
mean1467.000-1653.000=-186.000
σ0.000
min1467.000-1653.000=-186.000
max1467.000-1653.000=-186.000
mean0.447-0.448=-0.001
σ0.134-0.127=0.007
min0.374-0.368=0.006
max0.685-0.671=0.014
name=error_case.art
mean2.333-2.334=-0.001
σ0.003-0.003=0.000
min2.332
max2.337
mean1467.000-1653.000=-186.000
σ0.000
min1467.000-1653.000=-186.000
max1467.000-1653.000=-186.000
mean0.925-0.909=0.017
σ0.076-0.095=-0.019
min0.863-0.834=0.029
max1.045-1.072=-0.027
name=heavy_item.art
mean1.521-1.521=0.001
σ0.002-0.001=0.001
min1.520
max1.524-1.523=0.001
mean1467.000-1653.000=-186.000
σ0.000
min1467.000-1653.000=-186.000
max1467.000-1653.000=-186.000
mean0.564-0.546=0.018
σ0.055-0.057=-0.002
min0.508-0.492=0.015
max0.645-0.637=0.008
name=nested_use.art
mean2.355-2.356=-0.001
σ0.002-0.002=-0.000
min2.355
max2.358
mean1467.000-1653.000=-186.000
σ0.000
min1467.000-1653.000=-186.000
max1467.000-1653.000=-186.000
mean0.864-0.877=-0.013
σ0.042-0.066=-0.025
min0.824-0.808=0.016
max0.932-0.963=-0.031

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.543-963.552=-0.009
σ0.025-0.025=0.000
min963.523-963.524=-0.001
max963.583-963.584=-0.001
mean1467.000-1653.000=-186.000
σ0.000
min1467.000-1653.000=-186.000
max1467.000-1653.000=-186.000
mean0.838-0.835=0.003
σ0.028-0.030=-0.002
min0.804-0.797=0.008
max0.862-0.865=-0.003
name=cdr_enhanced_4k_loc.art
mean884.854-884.857=-0.003
σ0.006-0.007=-0.001
min884.847
max884.860-884.866=-0.006
mean1467.000-1653.000=-186.000
σ0.000
min1467.000-1653.000=-186.000
max1467.000-1653.000=-186.000
mean0.729-0.737=-0.008
σ0.021-0.021=-0.000
min0.692-0.705=-0.013
max0.741-0.758=-0.017

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=0.000
min7.705
max7.710-7.711=-0.000
mean1467.000-1653.000=-186.000
σ0.000
min1467.000-1653.000=-186.000
max1467.000-1653.000=-186.000
mean4.263-4.321=-0.058
σ0.075-0.080=-0.006
min4.142-4.202=-0.060
max4.537-4.698=-0.161
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1467.000-1653.000=-186.000
σ0.000
min1467.000-1653.000=-186.000
max1467.000-1653.000=-186.000
mean4.268-3.929=0.340
σ0.087-0.374=-0.287
min4.123-3.452=0.671
max4.611-4.547=0.064
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1467.000-1653.000=-186.000
σ0.000
min1467.000-1653.000=-186.000
max1467.000-1653.000=-186.000
mean0.767-0.768=-0.001
σ0.020-0.035=-0.015
min0.729-0.569=0.160
max0.885-0.891=-0.006
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1467.000-1653.000=-186.000
σ0.000
min1467.000-1653.000=-186.000
max1467.000-1653.000=-186.000
mean0.727-0.567=0.160
σ0.017-0.094=-0.077
min0.695-0.487=0.208
max0.799-0.815=-0.016

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.244-294.194=0.050
σ0.250-0.216=0.035
min294.081-293.912=0.169
max294.938-294.629=0.309
mean1899.000-2026.000=-127.000
σ0.000
min1899.000-2026.000=-127.000
max1899.000-2026.000=-127.000
mean0.580-0.545=0.035
σ0.027-0.035=-0.008
min0.518-0.504=0.014
max0.607-0.592=0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.493-281.495=-0.002
σ0.039-0.041=-0.003
min281.452-281.445=0.006
max281.538-281.537=0.001
mean1467.000-1653.000=-186.000
σ0.000
min1467.000-1653.000=-186.000
max1467.000-1653.000=-186.000
mean0.388-0.394=-0.006
σ0.006-0.008=-0.002
min0.381-0.384=-0.003
max0.395-0.400=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1291.485-1291.483=0.002
σ0.124-0.104=0.020
min1291.350-1291.366=-0.016
max1291.646-1291.624=0.022
mean1467.000-1653.000=-186.000
σ0.000
min1467.000-1653.000=-186.000
max1467.000-1653.000=-186.000
mean1.999-1.882=0.117
σ0.275-0.095=0.180
min1.803-1.796=0.007
max2.470-2.028=0.442
iters=5
new-facts=6402
prior-facts=1
mean1534.338-1534.349=-0.011
σ4.000-3.999=0.001
min1532.313-1532.358=-0.046
max1541.483-1541.497=-0.013
mean1467.000-1653.000=-186.000
σ0.000
min1467.000-1653.000=-186.000
max1467.000-1653.000=-186.000
mean2.336-2.177=0.159
σ0.193-0.165=0.028
min2.020-2.009=0.011
max2.484-2.420=0.065
iters=5
new-facts=6402
prior-facts=6402
mean1853.360-1853.357=0.003
σ0.056-0.048=0.009
min1853.306-1853.300=0.006
max1853.441-1853.414=0.026
mean1752.000-1784.400=-32.400
σ171.645-163.995=7.650
min1497.000-1653.000=-156.000
max1899.000-2026.000=-127.000
mean2.970-2.906=0.064
σ0.097-0.075=0.022
min2.880-2.838=0.041
max3.096-2.992=0.104

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.739-1.379=0.360
σ0.190-0.267=-0.078
min1.528-1.102=0.426
max1.929-1.816=0.114

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.427-442.427=0.000
σ577.064-577.065=-0.000
min153.893-153.893=0.000
max1308.023-1308.023=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1467.000-1653.000=-186.000
σ0.000
min1467.000-1653.000=-186.000
max1467.000-1653.000=-186.000
mean0.545-0.543=0.002
σ0.571-0.569=0.002
min0.258-0.257=0.001
max1.401-1.397=0.005
policies=20
mean1539.202-1539.203=-0.001
σ0.316-0.332=-0.017
min1538.985-1538.974=0.011
max1539.670-1539.697=-0.026
mean920.000
σ0.000
min920.000
max920.000
mean1467.000-1653.000=-186.000
σ0.000
min1467.000-1653.000=-186.000
max1467.000-1653.000=-186.000
mean2.574-2.592=-0.018
σ0.003-0.015=-0.011
min2.570-2.574=-0.004
max2.576-2.608=-0.031
policies=200
mean15400.372-15400.276=0.096
σ0.186-0.065=0.121
min15400.231-15400.217=0.014
max15400.645-15400.356=0.289
mean9200.000
σ0.000
min9200.000
max9200.000
mean1467.000-1653.000=-186.000
σ0.000
min1467.000-1653.000=-186.000
max1467.000-1653.000=-186.000
mean26.031-26.094=-0.062
σ0.061-0.025=0.036
min25.955-26.063=-0.107
max26.089-26.123=-0.033