Compare commits

Home / Compare d0e71bdf .. 3137fbaf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.037-54.031=0.006
σ0.368-0.369=-0.001
min53.891-53.891=0.000
max55.083-55.080=0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.155-0.140=0.014
σ0.012-0.003=0.008
min0.138-0.137=0.001
max0.169-0.146=0.023
cache=y
dps=1
iters=10
policies=100
mean43.384-43.384=0.000
σ0.006-0.006=-0.000
min43.376-43.375=0.001
max43.395-43.397=-0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.123-0.122=0.001
σ0.005-0.003=0.002
min0.116-0.119=-0.003
max0.132-0.127=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.331-1006.331=-0.001
σ0.915-0.882=0.033
min1005.858-1005.836=0.022
max1010.137-1009.981=0.156
mean1048.600-1050.100=-1.500
σ310.201-306.907=3.294
min552.000-584.000=-32.000
max1642.000-1648.000=-6.000
mean1.569-1.545=0.024
σ0.117-0.076=0.041
min1.481-1.381=0.100
max1.866-1.651=0.215

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.882-0.883=-0.001
σ0.002-0.002=-0.000
min0.881
max0.886
mean1642.000-1648.000=-6.000
σ0.000
min1642.000-1648.000=-6.000
max1642.000-1648.000=-6.000
mean0.421-0.422=-0.001
σ0.126-0.135=-0.009
min0.340-0.343=-0.002
max0.644-0.661=-0.017
name=error_case.art
mean2.334-2.333=0.001
σ0.003-0.003=-0.000
min2.332
max2.337
mean1642.000-1648.000=-6.000
σ0.000
min1642.000-1648.000=-6.000
max1642.000-1648.000=-6.000
mean0.880-0.874=0.005
σ0.080-0.092=-0.012
min0.829-0.822=0.007
max1.019-1.036=-0.017
name=heavy_item.art
mean1.521-1.521=-0.001
σ0.001-0.002=-0.001
min1.520
max1.523-1.524=-0.001
mean1642.000-1648.000=-6.000
σ0.000
min1642.000-1648.000=-6.000
max1642.000-1648.000=-6.000
mean0.537-0.572=-0.035
σ0.053-0.061=-0.007
min0.483-0.509=-0.027
max0.625-0.649=-0.024
name=nested_use.art
mean2.356-2.355=0.001
σ0.002-0.002=0.000
min2.355
max2.358
mean1642.000-1648.000=-6.000
σ0.000
min1642.000-1648.000=-6.000
max1642.000-1648.000=-6.000
mean0.844-1.006=-0.162
σ0.038-0.328=-0.290
min0.800-0.820=-0.020
max0.901-1.589=-0.688

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.551-963.552=-0.001
σ0.025-0.024=0.001
min963.523
max963.584-963.582=0.002
mean1642.000-1648.000=-6.000
σ0.000
min1642.000-1648.000=-6.000
max1642.000-1648.000=-6.000
mean0.845-0.821=0.024
σ0.015-0.044=-0.029
min0.819-0.745=0.074
max0.856-0.852=0.003
name=cdr_enhanced_4k_loc.art
mean884.856-884.856=0.001
σ0.007-0.005=0.002
min884.847
max884.865-884.861=0.004
mean1642.000-1648.000=-6.000
σ0.000
min1642.000-1648.000=-6.000
max1642.000-1648.000=-6.000
mean0.739-0.713=0.026
σ0.008-0.039=-0.031
min0.730-0.653=0.076
max0.751-0.741=0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.709-7.713=-0.004
mean1642.000-1648.000=-6.000
σ0.000
min1642.000-1648.000=-6.000
max1642.000-1648.000=-6.000
mean4.254-3.536=0.718
σ0.081-0.092=-0.011
min4.116-3.380=0.736
max4.540-3.782=0.758
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1642.000-1648.000=-6.000
σ0.000
min1642.000-1648.000=-6.000
max1642.000-1648.000=-6.000
mean4.229-4.155=0.075
σ0.069-0.272=-0.203
min4.078-3.405=0.673
max4.446-4.541=-0.095
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1642.000-1648.000=-6.000
σ0.000
min1642.000-1648.000=-6.000
max1642.000-1648.000=-6.000
mean0.746-0.747=-0.001
σ0.018-0.018=0.000
min0.715-0.711=0.004
max0.860-0.863=-0.003
name=record_render_syntax_err.art
mean2.163-2.163=0.000
σ0.002-0.002=-0.000
min2.163
max2.166
mean1642.000-1648.000=-6.000
σ0.000
min1642.000-1648.000=-6.000
max1642.000-1648.000=-6.000
mean0.690-0.716=-0.026
σ0.069-0.018=0.052
min0.502-0.685=-0.182
max0.895-0.826=0.069

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.603-295.599=0.004
σ0.242-0.241=0.002
min295.430-295.462=-0.032
max296.271-296.277=-0.006
mean1959.000-1903.000=56.000
σ0.000
min1959.000-1903.000=56.000
max1959.000-1903.000=56.000
mean0.585-0.581=0.004
σ0.016-0.043=-0.027
min0.549-0.533=0.016
max0.599-0.686=-0.087

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.250-285.252=-0.002
σ0.042-0.038=0.004
min285.198-285.205=-0.007
max285.297-285.291=0.006
mean1642.000-1648.000=-6.000
σ0.000
min1642.000-1648.000=-6.000
max1642.000-1648.000=-6.000
mean0.400-0.391=0.009
σ0.011-0.011=0.000
min0.388-0.380=0.008
max0.411-0.406=0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.192-1295.200=-0.008
σ0.108-0.114=-0.006
min1295.067-1295.077=-0.009
max1295.327-1295.342=-0.015
mean1642.000-1648.000=-6.000
σ0.000
min1642.000-1648.000=-6.000
max1642.000-1648.000=-6.000
mean1.934-1.930=0.004
σ0.058-0.105=-0.048
min1.855-1.798=0.058
max2.001-2.023=-0.021
iters=5
new-facts=6402
prior-facts=1
mean1538.085-1538.075=0.011
σ4.041-4.010=0.031
min1536.035-1536.032=0.003
max1545.303-1545.238=0.065
mean1642.000-1648.000=-6.000
σ0.000
min1642.000-1648.000=-6.000
max1642.000-1648.000=-6.000
mean2.308-2.262=0.046
σ0.130-0.204=-0.075
min2.106-2.006=0.100
max2.438-2.508=-0.070
iters=5
new-facts=6402
prior-facts=6402
mean1857.125-1857.110=0.015
σ0.083-0.054=0.029
min1857.023-1857.053=-0.029
max1857.223-1857.183=0.040
mean1796.400-1772.400=24.000
σ158.765-127.688=31.077
min1642.000-1648.000=-6.000
max1959.000-1903.000=56.000
mean3.220-3.053=0.166
σ0.338-0.305=0.033
min2.895-2.838=0.057
max3.688-3.578=0.110

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.365-1.369=-0.004
σ0.248-0.276=-0.029
min1.107-1.102=0.005
max1.764-1.823=-0.059

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.609-443.609=0.000
σ577.066-577.065=0.001
min155.073-155.075=-0.002
max1309.207-1309.206=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1648.000=-6.000
σ0.000
min1642.000-1648.000=-6.000
max1642.000-1648.000=-6.000
mean0.536-0.548=-0.012
σ0.554-0.569=-0.015
min0.258-0.262=-0.003
max1.368-1.402=-0.034
policies=20
mean1551.037-1551.023=0.014
σ0.333-0.316=0.017
min1550.808-1550.806=0.003
max1551.531-1551.493=0.039
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1648.000=-6.000
σ0.000
min1642.000-1648.000=-6.000
max1642.000-1648.000=-6.000
mean2.591-2.582=0.009
σ0.017-0.015=0.002
min2.571-2.571=-0.000
max2.611-2.605=0.007
policies=200
mean15518.398-15518.566=-0.168
σ0.062-0.087=-0.024
min15518.341-15518.471=-0.130
max15518.463-15518.676=-0.213
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1648.000=-6.000
σ0.000
min1642.000-1648.000=-6.000
max1642.000-1648.000=-6.000
mean26.116-26.382=-0.266
σ0.056-0.167=-0.111
min26.050-26.255=-0.205
max26.175-26.623=-0.448