Compare commits

Home / Compare b69af79f .. 09940065

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.703-54.033=-0.329
σ0.368-0.368=0.000
min53.556-53.886=-0.331
max54.751-55.080=-0.329
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.138-0.138=-0.001
σ0.005-0.004=0.000
min0.129-0.132=-0.003
max0.144-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.058-43.384=-0.327
σ0.006-0.007=-0.000
min43.049-43.374=-0.324
max43.066-43.394=-0.329
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.122-0.123=-0.002
σ0.003-0.004=-0.001
min0.118-0.119=-0.001
max0.127-0.130=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.108-1006.334=-1.226
σ0.875-0.880=-0.005
min1004.620-1005.836=-1.216
max1008.735-1009.982=-1.247
mean1052.950-1046.700=6.250
σ321.163-310.422=10.741
min552.000-563.000=-11.000
max1632.000-1637.000=-5.000
mean1.621-1.547=0.074
σ0.088-0.098=-0.009
min1.478-1.379=0.099
max1.860-1.840=0.020

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.003=-0.001
min0.881
max0.886-0.887=-0.002
mean1632.000-1637.000=-5.000
σ0.000
min1632.000-1637.000=-5.000
max1632.000-1637.000=-5.000
mean0.498-0.480=0.017
σ0.187-0.159=0.029
min0.353-0.344=0.009
max0.712-0.676=0.036
name=error_case.art
mean2.333-2.334=-0.001
σ0.003-0.003=0.000
min2.332
max2.337
mean1632.000-1637.000=-5.000
σ0.000
min1632.000-1637.000=-5.000
max1632.000-1637.000=-5.000
mean0.912-0.909=0.004
σ0.110-0.134=-0.023
min0.839-0.829=0.010
max1.108-1.145=-0.038
name=heavy_item.art
mean1.521-1.521=0.001
σ0.002-0.001=0.001
min1.520
max1.524-1.523=0.001
mean1632.000-1637.000=-5.000
σ0.000
min1632.000-1637.000=-5.000
max1632.000-1637.000=-5.000
mean0.553-0.570=-0.016
σ0.052-0.061=-0.009
min0.514-0.514=-0.000
max0.644-0.636=0.008
name=nested_use.art
mean2.355-2.356=-0.001
σ0.002-0.002=-0.000
min2.355
max2.358
mean1632.000-1637.000=-5.000
σ0.000
min1632.000-1637.000=-5.000
max1632.000-1637.000=-5.000
mean0.891-0.845=0.046
σ0.054-0.047=0.008
min0.831-0.809=0.022
max0.973-0.926=0.047

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.553-963.550=0.002
σ0.035-0.022=0.013
min963.533-963.524=0.009
max963.615-963.577=0.038
mean1632.000-1637.000=-5.000
σ0.000
min1632.000-1637.000=-5.000
max1632.000-1637.000=-5.000
mean0.826-0.838=-0.012
σ0.051-0.034=0.018
min0.761-0.778=-0.017
max0.865-0.858=0.007
name=cdr_enhanced_4k_loc.art
mean884.853-884.857=-0.004
σ0.008-0.007=0.001
min884.847
max884.867-884.865=0.002
mean1632.000-1637.000=-5.000
σ0.000
min1632.000-1637.000=-5.000
max1632.000-1637.000=-5.000
mean0.736-0.739=-0.003
σ0.034-0.006=0.029
min0.675-0.729=-0.054
max0.758-0.744=0.014

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.711-7.710=0.000
mean1632.000-1637.000=-5.000
σ0.000
min1632.000-1637.000=-5.000
max1632.000-1637.000=-5.000
mean4.285-4.282=0.003
σ0.072-0.092=-0.020
min4.146-4.129=0.016
max4.603-4.645=-0.042
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1632.000-1637.000=-5.000
σ0.000
min1632.000-1637.000=-5.000
max1632.000-1637.000=-5.000
mean4.248-4.226=0.023
σ0.087-0.054=0.033
min4.101-4.105=-0.004
max4.639-4.433=0.206
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1632.000-1637.000=-5.000
σ0.000
min1632.000-1637.000=-5.000
max1632.000-1637.000=-5.000
mean0.766-0.737=0.028
σ0.022-0.026=-0.004
min0.737-0.688=0.049
max0.928-0.857=0.071
name=record_render_syntax_err.art
mean2.163-2.163=-0.000
σ0.002-0.002=0.000
min2.163
max2.166
mean1632.000-1637.000=-5.000
σ0.000
min1632.000-1637.000=-5.000
max1632.000-1637.000=-5.000
mean0.723-0.677=0.046
σ0.017-0.015=0.002
min0.681-0.645=0.036
max0.796-0.746=0.049

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.181-295.641=-1.460
σ0.187-0.204=-0.016
min293.987-295.507=-1.520
max294.669-296.193=-1.524
mean1939.000-2075.000=-136.000
σ0.000
min1939.000-2075.000=-136.000
max1939.000-2075.000=-136.000
mean0.563-0.540=0.024
σ0.052-0.037=0.015
min0.487-0.503=-0.015
max0.661-0.586=0.075

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.497-285.254=-3.758
σ0.040-0.038=0.002
min281.448-285.204=-3.756
max281.539-285.294=-3.755
mean1632.000-1637.000=-5.000
σ0.000
min1632.000-1637.000=-5.000
max1632.000-1637.000=-5.000
mean0.394-0.403=-0.009
σ0.006-0.004=0.002
min0.386-0.400=-0.014
max0.400-0.410=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1291.476-1295.192=-3.716
σ0.103-0.104=-0.001
min1291.360-1295.071=-3.711
max1291.612-1295.314=-3.702
mean1632.000-1637.000=-5.000
σ0.000
min1632.000-1637.000=-5.000
max1632.000-1637.000=-5.000
mean1.982-1.938=0.044
σ0.160-0.112=0.048
min1.839-1.818=0.021
max2.249-2.046=0.203
iters=5
new-facts=6402
prior-facts=1
mean1534.321-1538.086=-3.765
σ4.013-4.036=-0.022
min1532.297-1536.042=-3.745
max1541.491-1545.297=-3.805
mean1632.000-1637.000=-5.000
σ0.000
min1632.000-1637.000=-5.000
max1632.000-1637.000=-5.000
mean2.222-2.328=-0.106
σ0.190-0.268=-0.078
min2.036-2.064=-0.029
max2.462-2.701=-0.238
iters=5
new-facts=6402
prior-facts=6402
mean1853.354-1857.107=-3.753
σ0.049-0.059=-0.010
min1853.307-1857.046=-3.739
max1853.423-1857.178=-3.755
mean1792.800-1804.000=-11.200
σ147.298-190.273=-42.975
min1632.000-1637.000=-5.000
max1939.000-2075.000=-136.000
mean3.137-2.913=0.224
σ0.281-0.127=0.153
min2.905-2.788=0.117
max3.622-3.112=0.509

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.487-1.368=0.120
σ0.289-0.312=-0.023
min1.122-1.109=0.013
max1.889-1.912=-0.022

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.430-443.610=-1.181
σ577.064-577.064=-0.000
min153.896-155.077=-1.180
max1308.026-1309.207=-1.181
mean96.250
σ8.500
min92.000
max109.000
mean1632.000-1637.000=-5.000
σ0.000
min1632.000-1637.000=-5.000
max1632.000-1637.000=-5.000
mean0.552-0.556=-0.004
σ0.590-0.593=-0.003
min0.255-0.258=-0.003
max1.436-1.446=-0.009
policies=20
mean1539.224-1551.038=-11.814
σ0.316-0.335=-0.020
min1539.004-1550.812=-11.808
max1539.693-1551.537=-11.844
mean920.000
σ0.000
min920.000
max920.000
mean1632.000-1637.000=-5.000
σ0.000
min1632.000-1637.000=-5.000
max1632.000-1637.000=-5.000
mean2.571-2.601=-0.031
σ0.010-0.013=-0.003
min2.560-2.587=-0.028
max2.581-2.619=-0.038
policies=200
mean15400.412-15518.354=-117.942
σ0.053-0.164=-0.110
min15400.358-15518.182=-117.824
max15400.484-15518.565=-118.081
mean9200.000
σ0.000
min9200.000
max9200.000
mean1632.000-1637.000=-5.000
σ0.000
min1632.000-1637.000=-5.000
max1632.000-1637.000=-5.000
mean26.049-26.198=-0.148
σ0.047-0.160=-0.113
min25.991-26.075=-0.084
max26.102-26.430=-0.328