Compare commits

Home / Compare d4127476 .. 53ed13de

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.033-54.031=0.003
σ0.368-0.370=-0.001
min53.885-53.890=-0.004
max55.080-55.082=-0.002
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.141-0.139=0.002
σ0.004-0.005=-0.001
min0.137-0.132=0.006
max0.147-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.385-43.384=0.001
σ0.008-0.007=0.001
min43.371-43.374=-0.003
max43.398-43.397=0.002
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.123-0.124=-0.001
σ0.004-0.004=-0.000
min0.120-0.120=-0.000
max0.129-0.131=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.333-1006.328=0.005
σ0.877-0.891=-0.014
min1005.836-1005.858=-0.022
max1009.969-1010.034=-0.064
mean1051.100-1057.600=-6.500
σ306.879-317.923=-11.045
min575.000-550.000=25.000
max1646.000-1636.000=10.000
mean1.533-1.549=-0.016
σ0.058-0.088=-0.030
min1.473-1.408=0.065
max1.669-1.814=-0.146

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.882=0.002
σ0.002-0.002=-0.000
min0.883-0.881=0.001
max0.886-0.886=0.001
mean1646.000-1636.000=10.000
σ0.000
min1646.000-1636.000=10.000
max1646.000-1636.000=10.000
mean0.435-0.415=0.020
σ0.166-0.134=0.032
min0.326-0.336=-0.010
max0.730-0.654=0.076
name=error_case.art
mean2.334-2.334=-0.000
σ0.002-0.003=-0.000
min2.332
max2.337
mean1646.000-1636.000=10.000
σ0.000
min1646.000-1636.000=10.000
max1646.000-1636.000=10.000
mean0.920-0.887=0.033
σ0.167-0.085=0.082
min0.819-0.833=-0.014
max1.216-1.037=0.179
name=heavy_item.art
mean1.522-1.521=0.001
σ0.001-0.001=0.000
min1.520
max1.524-1.523=0.001
mean1646.000-1636.000=10.000
σ0.000
min1646.000-1636.000=10.000
max1646.000-1636.000=10.000
mean0.539-0.542=-0.003
σ0.049-0.051=-0.002
min0.495-0.495=0.001
max0.622-0.627=-0.005
name=nested_use.art
mean2.356-2.356=-0.001
σ0.002-0.002=-0.000
min2.355
max2.358
mean1646.000-1636.000=10.000
σ0.000
min1646.000-1636.000=10.000
max1646.000-1636.000=10.000
mean0.846-0.845=0.001
σ0.029-0.046=-0.017
min0.827-0.812=0.014
max0.897-0.926=-0.029

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.555-963.554=0.001
σ0.026-0.030=-0.004
min963.532-963.523=0.009
max963.599-963.599=-0.000
mean1646.000-1636.000=10.000
σ0.000
min1646.000-1636.000=10.000
max1646.000-1636.000=10.000
mean0.806-0.826=-0.020
σ0.048-0.038=0.010
min0.740-0.768=-0.028
max0.851-0.870=-0.019
name=cdr_enhanced_4k_loc.art
mean884.855-884.857=-0.002
σ0.007-0.004=0.002
min884.848-884.851=-0.002
max884.865-884.862=0.003
mean1646.000-1636.000=10.000
σ0.000
min1646.000-1636.000=10.000
max1646.000-1636.000=10.000
mean0.710-0.716=-0.005
σ0.052-0.027=0.024
min0.622-0.677=-0.055
max0.744-0.743=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.710-7.711=-0.000
mean1646.000-1636.000=10.000
σ0.000
min1646.000-1636.000=10.000
max1646.000-1636.000=10.000
mean4.268-4.229=0.038
σ0.093-0.088=0.005
min4.123-4.059=0.064
max4.514-4.529=-0.016
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1646.000-1636.000=10.000
σ0.000
min1646.000-1636.000=10.000
max1646.000-1636.000=10.000
mean4.219-3.839=0.380
σ0.131-0.450=-0.319
min3.472-2.601=0.872
max4.541-5.005=-0.465
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1646.000-1636.000=10.000
σ0.000
min1646.000-1636.000=10.000
max1646.000-1636.000=10.000
mean0.741-0.544=0.197
σ0.023-0.029=-0.006
min0.692-0.512=0.180
max0.871-0.728=0.143
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1646.000-1636.000=10.000
σ0.000
min1646.000-1636.000=10.000
max1646.000-1636.000=10.000
mean0.683-0.510=0.174
σ0.014-0.013=0.001
min0.659-0.489=0.170
max0.766-0.569=0.198

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.409-295.555=-0.146
σ0.209-0.192=0.017
min295.218-295.409=-0.191
max295.967-296.055=-0.088
mean1911.000-1912.000=-1.000
σ0.000
min1911.000-1912.000=-1.000
max1911.000-1912.000=-1.000
mean0.571-0.599=-0.028
σ0.044-0.031=0.013
min0.507-0.554=-0.046
max0.644-0.664=-0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.250-285.247=0.004
σ0.040-0.037=0.002
min285.199-285.194=0.005
max285.290-285.292=-0.002
mean1646.000-1636.000=10.000
σ0.000
min1646.000-1636.000=10.000
max1646.000-1636.000=10.000
mean0.393-0.390=0.003
σ0.012-0.011=0.001
min0.380-0.381=-0.002
max0.409-0.404=0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.197-1295.171=0.026
σ0.113-0.110=0.003
min1295.067-1295.070=-0.003
max1295.332-1295.349=-0.017
mean1646.000-1636.000=10.000
σ0.000
min1646.000-1636.000=10.000
max1646.000-1636.000=10.000
mean1.904-2.000=-0.096
σ0.080-0.207=-0.126
min1.809-1.804=0.005
max1.992-2.305=-0.313
iters=5
new-facts=6402
prior-facts=1
mean1538.065-1538.136=-0.071
σ4.027-3.968=0.059
min1536.046-1536.243=-0.198
max1545.260-1545.232=0.029
mean1646.000-1636.000=10.000
σ0.000
min1646.000-1636.000=10.000
max1646.000-1636.000=10.000
mean2.268-2.318=-0.050
σ0.203-0.276=-0.073
min2.017-2.077=-0.060
max2.473-2.768=-0.296
iters=5
new-facts=6402
prior-facts=6402
mean1857.107-1857.106=0.001
σ0.051-0.050=0.001
min1857.056-1857.056=0.001
max1857.175-1857.175=-0.000
mean1782.600-1779.400=3.200
σ131.146-132.728=-1.582
min1646.000-1636.000=10.000
max1911.000-1912.000=-1.000
mean3.057-3.072=-0.015
σ0.227-0.275=-0.048
min2.875-2.867=0.008
max3.450-3.552=-0.102

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.294-1.337=-0.043
σ0.261-0.244=0.018
min1.107-1.109=-0.002
max1.738-1.752=-0.015

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.607-443.611=-0.004
σ577.065-577.064=0.001
min155.074-155.077=-0.003
max1309.205-1309.208=-0.003
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1636.000=10.000
σ0.000
min1646.000-1636.000=10.000
max1646.000-1636.000=10.000
mean0.562-0.544=0.018
σ0.590-0.572=0.018
min0.263-0.257=0.006
max1.447-1.403=0.045
policies=20
mean1551.015-1551.029=-0.014
σ0.321-0.312=0.009
min1550.791-1550.821=-0.030
max1551.491-1551.493=-0.003
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1636.000=10.000
σ0.000
min1646.000-1636.000=10.000
max1646.000-1636.000=10.000
mean2.579-2.577=0.001
σ0.009-0.018=-0.008
min2.571-2.555=0.016
max2.592-2.597=-0.005
policies=200
mean15518.506-15518.467=0.040
σ0.162-0.183=-0.021
min15518.342-15518.309=0.033
max15518.708-15518.713=-0.004
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1636.000=10.000
σ0.000
min1646.000-1636.000=10.000
max1646.000-1636.000=10.000
mean26.075-26.182=-0.106
σ0.049-0.148=-0.099
min26.015-26.052=-0.037
max26.121-26.386=-0.265