Compare commits

Home / Compare 20deceb5 .. eb7cc9bc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.031-54.030=0.001
σ0.368-0.368=-0.000
min53.887-53.889=-0.002
max55.077-55.077=0.000
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.139-0.136=0.003
σ0.003-0.005=-0.001
min0.137-0.130=0.006
max0.145-0.141=0.004
cache=y
dps=1
iters=10
policies=100
mean43.385-43.384=0.001
σ0.006-0.007=-0.001
min43.375-43.376=-0.001
max43.394-43.395=-0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.123-0.122=0.002
σ0.004-0.004=-0.000
min0.120-0.116=0.004
max0.130-0.127=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.327-1006.332=-0.005
σ0.920-0.882=0.038
min1005.863-1005.836=0.028
max1010.152-1009.993=0.159
mean1048.100-1042.450=5.650
σ307.293-306.151=1.142
min552.000-573.000=-21.000
max1639.000-1657.000=-18.000
mean1.570-1.559=0.012
σ0.122-0.080=0.042
min1.462-1.481=-0.019
max1.948-1.813=0.135

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.882-0.883=-0.001
σ0.002-0.002=-0.000
min0.881
max0.886
mean1639.000-1657.000=-18.000
σ0.000
min1639.000-1657.000=-18.000
max1639.000-1657.000=-18.000
mean0.419-0.423=-0.003
σ0.127-0.133=-0.006
min0.347-0.343=0.005
max0.645-0.658=-0.013
name=error_case.art
mean2.334-2.333=0.001
σ0.003-0.003=-0.000
min2.332
max2.337
mean1639.000-1657.000=-18.000
σ0.000
min1639.000-1657.000=-18.000
max1639.000-1657.000=-18.000
mean0.890-0.892=-0.002
σ0.088-0.075=0.013
min0.828-0.840=-0.012
max1.041-1.022=0.020
name=heavy_item.art
mean1.521-1.521=-0.001
σ0.001-0.002=-0.001
min1.520
max1.523-1.524=-0.001
mean1639.000-1657.000=-18.000
σ0.000
min1639.000-1657.000=-18.000
max1639.000-1657.000=-18.000
mean0.537-0.547=-0.010
σ0.050-0.051=-0.001
min0.494-0.514=-0.019
max0.616-0.636=-0.019
name=nested_use.art
mean2.356-2.355=0.001
σ0.002-0.002=0.000
min2.355
max2.358
mean1639.000-1657.000=-18.000
σ0.000
min1639.000-1657.000=-18.000
max1639.000-1657.000=-18.000
mean0.845-0.842=0.003
σ0.030-0.034=-0.004
min0.814-0.806=0.008
max0.895-0.894=0.001

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.551-963.552=-0.001
σ0.025-0.025=0.000
min963.523
max963.585-963.583=0.002
mean1639.000-1657.000=-18.000
σ0.000
min1639.000-1657.000=-18.000
max1639.000-1657.000=-18.000
mean0.821-0.821=0.001
σ0.035-0.035=0.000
min0.782-0.775=0.007
max0.875-0.856=0.019
name=cdr_enhanced_4k_loc.art
mean884.856-884.856=0.000
σ0.004-0.005=-0.002
min884.851-884.847=0.004
max884.860-884.861=-0.001
mean1639.000-1657.000=-18.000
σ0.000
min1639.000-1657.000=-18.000
max1639.000-1657.000=-18.000
mean0.712-0.705=0.007
σ0.038-0.048=-0.010
min0.659-0.623=0.036
max0.752-0.746=0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=0.000
min7.705
max7.711-7.710=0.000
mean1639.000-1657.000=-18.000
σ0.000
min1639.000-1657.000=-18.000
max1639.000-1657.000=-18.000
mean4.280-4.223=0.057
σ0.096-0.121=-0.025
min4.131-4.042=0.089
max4.578-5.105=-0.527
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1639.000-1657.000=-18.000
σ0.000
min1639.000-1657.000=-18.000
max1639.000-1657.000=-18.000
mean4.243-4.206=0.036
σ0.079-0.082=-0.003
min4.102-4.086=0.016
max4.600-4.467=0.133
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1639.000-1657.000=-18.000
σ0.000
min1639.000-1657.000=-18.000
max1639.000-1657.000=-18.000
mean0.750-0.576=0.174
σ0.017-0.091=-0.074
min0.714-0.507=0.207
max0.848-0.868=-0.020
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1639.000-1657.000=-18.000
σ0.000
min1639.000-1657.000=-18.000
max1639.000-1657.000=-18.000
mean0.625-0.506=0.120
σ0.102-0.012=0.090
min0.489-0.485=0.003
max0.764-0.557=0.208

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.549-295.584=-0.035
σ0.231-0.247=-0.016
min295.394-295.362=0.032
max296.196-296.219=-0.023
mean1914.000-1909.000=5.000
σ0.000
min1914.000-1909.000=5.000
max1914.000-1909.000=5.000
mean0.574-0.572=0.001
σ0.033-0.048=-0.015
min0.521-0.504=0.017
max0.640-0.671=-0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.250-285.249=0.001
σ0.035-0.040=-0.005
min285.205-285.193=0.012
max285.286-285.291=-0.005
mean1639.000-1657.000=-18.000
σ0.000
min1639.000-1657.000=-18.000
max1639.000-1657.000=-18.000
mean0.389-0.396=-0.007
σ0.008-0.010=-0.002
min0.383-0.385=-0.002
max0.398-0.407=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1295.198-1295.197=0.002
σ0.107-0.105=0.002
min1295.081-1295.082=-0.001
max1295.330-1295.320=0.010
mean1639.000-1657.000=-18.000
σ0.000
min1639.000-1657.000=-18.000
max1639.000-1657.000=-18.000
mean1.906-1.912=-0.007
σ0.081-0.101=-0.020
min1.815-1.785=0.030
max2.000-2.025=-0.025
iters=5
new-facts=6402
prior-facts=1
mean1538.145-1538.084=0.061
σ3.953-4.022=-0.069
min1536.196-1536.051=0.145
max1545.209-1545.270=-0.061
mean1639.000-1657.000=-18.000
σ0.000
min1639.000-1657.000=-18.000
max1639.000-1657.000=-18.000
mean2.413-2.278=0.135
σ0.292-0.218=0.073
min2.145-2.049=0.097
max2.845-2.549=0.296
iters=5
new-facts=6402
prior-facts=6402
mean1857.109-1857.106=0.003
σ0.052-0.053=-0.000
min1857.047-1857.061=-0.014
max1857.175-1857.180=-0.005
mean1770.800-1781.600=-10.800
σ138.089-126.039=12.051
min1639.000-1657.000=-18.000
max1914.000-1909.000=5.000
mean2.939-3.062=-0.124
σ0.081-0.297=-0.216
min2.859-2.861=-0.002
max3.058-3.588=-0.531

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.388-1.381=0.007
σ0.269-0.262=0.007
min1.261-1.229=0.032
max1.869-1.847=0.022

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.610-443.609=0.001
σ577.065-577.065=0.000
min155.076-155.076=0.001
max1309.208-1309.206=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1639.000-1657.000=-18.000
σ0.000
min1639.000-1657.000=-18.000
max1639.000-1657.000=-18.000
mean0.537-0.546=-0.009
σ0.558-0.574=-0.017
min0.255-0.258=-0.003
max1.374-1.408=-0.034
policies=20
mean1551.037-1551.020=0.017
σ0.332-0.323=0.009
min1550.810-1550.797=0.013
max1551.531-1551.500=0.031
mean920.000
σ0.000
min920.000
max920.000
mean1639.000-1657.000=-18.000
σ0.000
min1639.000-1657.000=-18.000
max1639.000-1657.000=-18.000
mean2.598-2.586=0.012
σ0.011-0.015=-0.004
min2.583-2.572=0.011
max2.608-2.602=0.005
policies=200
mean15518.471-15518.501=-0.031
σ0.077-0.136=-0.059
min15518.373-15518.332=0.041
max15518.561-15518.628=-0.068
mean9200.000
σ0.000
min9200.000
max9200.000
mean1639.000-1657.000=-18.000
σ0.000
min1639.000-1657.000=-18.000
max1639.000-1657.000=-18.000
mean26.254-26.218=0.037
σ0.141-0.224=-0.082
min26.147-26.016=0.131
max26.454-26.538=-0.084