Compare commits

Home / Compare 8815d289 .. 6dda49c3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.032-54.031=0.000
σ0.370-0.369=0.002
min53.883-53.891=-0.008
max55.085-55.080=0.005
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.139-0.140=-0.001
σ0.004-0.003=0.000
min0.136-0.137=-0.001
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.384-43.384=0.000
σ0.006-0.006=-0.000
min43.374-43.375=-0.002
max43.392-43.397=-0.005
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.121-0.122=-0.000
σ0.005-0.003=0.002
min0.114-0.119=-0.005
max0.130-0.127=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.330-1006.331=-0.001
σ0.893-0.882=0.011
min1005.861-1005.836=0.025
max1010.039-1009.981=0.058
mean1052.100-1050.100=2.000
σ317.345-306.907=10.437
min545.000-584.000=-39.000
max1628.000-1648.000=-20.000
mean1.561-1.545=0.016
σ0.081-0.076=0.006
min1.482-1.381=0.101
max1.819-1.651=0.168

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1628.000-1648.000=-20.000
σ0.000
min1628.000-1648.000=-20.000
max1628.000-1648.000=-20.000
mean0.414-0.422=-0.008
σ0.117-0.135=-0.018
min0.348-0.343=0.005
max0.622-0.661=-0.039
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1628.000-1648.000=-20.000
σ0.000
min1628.000-1648.000=-20.000
max1628.000-1648.000=-20.000
mean0.874-0.874=-0.000
σ0.094-0.092=0.002
min0.819-0.822=-0.003
max1.039-1.036=0.003
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1628.000-1648.000=-20.000
σ0.000
min1628.000-1648.000=-20.000
max1628.000-1648.000=-20.000
mean0.540-0.572=-0.032
σ0.062-0.061=0.001
min0.498-0.509=-0.011
max0.648-0.649=-0.000
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1628.000-1648.000=-20.000
σ0.000
min1628.000-1648.000=-20.000
max1628.000-1648.000=-20.000
mean0.854-1.006=-0.152
σ0.036-0.328=-0.292
min0.830-0.820=0.010
max0.913-1.589=-0.676

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.550-963.552=-0.002
σ0.031-0.024=0.007
min963.523
max963.602-963.582=0.021
mean1628.000-1648.000=-20.000
σ0.000
min1628.000-1648.000=-20.000
max1628.000-1648.000=-20.000
mean0.775-0.821=-0.046
σ0.080-0.044=0.036
min0.659-0.745=-0.086
max0.852-0.852=-0.001
name=cdr_enhanced_4k_loc.art
mean884.855-884.856=-0.000
σ0.008-0.005=0.003
min884.847
max884.865-884.861=0.004
mean1628.000-1648.000=-20.000
σ0.000
min1628.000-1648.000=-20.000
max1628.000-1648.000=-20.000
mean0.705-0.713=-0.008
σ0.034-0.039=-0.005
min0.676-0.653=0.023
max0.745-0.741=0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.709-7.713=-0.004
mean1628.000-1648.000=-20.000
σ0.000
min1628.000-1648.000=-20.000
max1628.000-1648.000=-20.000
mean4.252-3.536=0.716
σ0.091-0.092=-0.001
min4.101-3.380=0.721
max4.573-3.782=0.792
name=record_render_large_syntax_err.art
mean7.655-7.655=0.000
σ0.002-0.002=0.000
min7.654
max7.658
mean1628.000-1648.000=-20.000
σ0.000
min1628.000-1648.000=-20.000
max1628.000-1648.000=-20.000
mean4.264-4.155=0.110
σ0.082-0.272=-0.190
min4.134-3.405=0.730
max4.571-4.541=0.030
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1628.000-1648.000=-20.000
σ0.000
min1628.000-1648.000=-20.000
max1628.000-1648.000=-20.000
mean0.749-0.747=0.002
σ0.022-0.018=0.004
min0.719-0.711=0.009
max0.905-0.863=0.042
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1628.000-1648.000=-20.000
σ0.000
min1628.000-1648.000=-20.000
max1628.000-1648.000=-20.000
mean0.713-0.716=-0.003
σ0.019-0.018=0.001
min0.671-0.685=-0.014
max0.806-0.826=-0.020

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.341-295.599=-0.258
σ0.216-0.241=-0.025
min295.219-295.462=-0.244
max295.939-296.277=-0.338
mean1888.000-1903.000=-15.000
σ0.000
min1888.000-1903.000=-15.000
max1888.000-1903.000=-15.000
mean0.590-0.581=0.009
σ0.050-0.043=0.006
min0.511-0.533=-0.022
max0.695-0.686=0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.253-285.252=0.001
σ0.036-0.038=-0.002
min285.201-285.205=-0.003
max285.287-285.291=-0.005
mean1628.000-1648.000=-20.000
σ0.000
min1628.000-1648.000=-20.000
max1628.000-1648.000=-20.000
mean0.402-0.391=0.011
σ0.012-0.011=0.001
min0.389-0.380=0.009
max0.414-0.406=0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.193-1295.200=-0.007
σ0.106-0.114=-0.008
min1295.073-1295.077=-0.004
max1295.324-1295.342=-0.018
mean1628.000-1648.000=-20.000
σ0.000
min1628.000-1648.000=-20.000
max1628.000-1648.000=-20.000
mean1.940-1.930=0.010
σ0.182-0.105=0.077
min1.792-1.798=-0.006
max2.240-2.023=0.217
iters=5
new-facts=6402
prior-facts=1
mean1538.151-1538.075=0.076
σ4.009-4.010=-0.000
min1536.140-1536.032=0.108
max1545.316-1545.238=0.078
mean1628.000-1648.000=-20.000
σ0.000
min1628.000-1648.000=-20.000
max1628.000-1648.000=-20.000
mean2.413-2.262=0.151
σ0.235-0.204=0.030
min2.027-2.006=0.020
max2.609-2.508=0.101
iters=5
new-facts=6402
prior-facts=6402
mean1857.103-1857.110=-0.007
σ0.052-0.054=-0.002
min1857.057-1857.053=0.004
max1857.180-1857.183=-0.003
mean1770.800-1772.400=-1.600
σ122.730-127.688=-4.958
min1628.000-1648.000=-20.000
max1888.000-1903.000=-15.000
mean3.035-3.053=-0.019
σ0.252-0.305=-0.053
min2.824-2.838=-0.014
max3.460-3.578=-0.117

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.478-1.369=0.109
σ0.356-0.276=0.080
min1.101-1.102=-0.001
max1.853-1.823=0.030

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.611-443.609=0.002
σ577.065-577.065=0.000
min155.077-155.075=0.002
max1309.208-1309.206=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1628.000-1648.000=-20.000
σ0.000
min1628.000-1648.000=-20.000
max1628.000-1648.000=-20.000
mean0.544-0.548=-0.004
σ0.563-0.569=-0.006
min0.262-0.262=0.000
max1.389-1.402=-0.013
policies=20
mean1551.047-1551.023=0.024
σ0.330-0.316=0.014
min1550.823-1550.806=0.018
max1551.538-1551.493=0.045
mean920.000
σ0.000
min920.000
max920.000
mean1628.000-1648.000=-20.000
σ0.000
min1628.000-1648.000=-20.000
max1628.000-1648.000=-20.000
mean2.594-2.582=0.012
σ0.012-0.015=-0.004
min2.579-2.571=0.008
max2.608-2.605=0.003
policies=200
mean15518.568-15518.566=0.003
σ0.092-0.087=0.006
min15518.499-15518.471=0.028
max15518.700-15518.676=0.024
mean9200.000
σ0.000
min9200.000
max9200.000
mean1628.000-1648.000=-20.000
σ0.000
min1628.000-1648.000=-20.000
max1628.000-1648.000=-20.000
mean26.145-26.382=-0.237
σ0.036-0.167=-0.131
min26.108-26.255=-0.147
max26.192-26.623=-0.432