Compare commits

Home / Compare dc735cb2 .. b5388cac

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-53.964=-0.000
σ0.370-0.371=-0.001
min53.819-53.821=-0.002
max55.016-55.019=-0.003
mean418.000-419.000=-1.000
σ0.000
min418.000-419.000=-1.000
max418.000-419.000=-1.000
mean0.139-0.138=0.001
σ0.004-0.007=-0.003
min0.135-0.130=0.005
max0.145-0.148=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.001
σ0.008-0.006=0.001
min43.311-43.313=-0.002
max43.337-43.338=-0.001
mean418.000-420.000=-2.000
σ0.000
min418.000-420.000=-2.000
max418.000-420.000=-2.000
mean0.123-0.123=0.000
σ0.004-0.005=-0.000
min0.119-0.118=0.000
max0.130-0.131=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.521-1006.511=0.010
σ1.150-1.182=-0.032
min1005.948-1005.955=-0.007
max1011.327-1011.457=-0.131
mean1063.600-1048.900=14.700
σ319.707-314.997=4.710
min551.000
max1521.000-1529.000=-8.000
mean1.522-1.531=-0.009
σ0.051-0.079=-0.028
min1.460-1.452=0.007
max1.607-1.731=-0.125

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1521.000-1529.000=-8.000
σ0.000
min1521.000-1529.000=-8.000
max1521.000-1529.000=-8.000
mean0.422-0.414=0.008
σ0.139-0.138=0.001
min0.330-0.325=0.006
max0.667-0.657=0.010
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.003=-0.000
min2.337
max2.342-2.344=-0.001
mean1521.000-1529.000=-8.000
σ0.000
min1521.000-1529.000=-8.000
max1521.000-1529.000=-8.000
mean0.888-0.895=-0.007
σ0.101-0.086=0.015
min0.819-0.836=-0.017
max1.066-1.046=0.020
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1521.000-1529.000=-8.000
σ0.000
min1521.000-1529.000=-8.000
max1521.000-1529.000=-8.000
mean0.534-0.537=-0.003
σ0.053-0.056=-0.003
min0.494-0.492=0.003
max0.624-0.632=-0.009
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1521.000-1529.000=-8.000
σ0.000
min1521.000-1529.000=-8.000
max1521.000-1529.000=-8.000
mean0.842-0.858=-0.016
σ0.044-0.041=0.003
min0.805-0.823=-0.019
max0.917-0.930=-0.013

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.821=0.009
σ0.028-0.024=0.004
min964.806-964.802=0.004
max964.878-964.860=0.017
mean1521.000-1529.000=-8.000
σ0.000
min1521.000-1529.000=-8.000
max1521.000-1529.000=-8.000
mean0.842-0.809=0.033
σ0.026-0.086=-0.059
min0.812-0.658=0.154
max0.874-0.862=0.012
name=cdr_enhanced_4k_loc.art
mean885.509-885.510=-0.001
σ0.004-0.005=-0.001
min885.504
max885.514-885.516=-0.002
mean1521.000-1529.000=-8.000
σ0.000
min1521.000-1529.000=-8.000
max1521.000-1529.000=-8.000
mean0.694-0.703=-0.010
σ0.065-0.039=0.026
min0.589-0.668=-0.079
max0.738-0.748=-0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1521.000-1529.000=-8.000
σ0.000
min1521.000-1529.000=-8.000
max1521.000-1529.000=-8.000
mean4.232-4.214=0.018
σ0.085-0.081=0.004
min4.091-4.096=-0.005
max4.554-4.495=0.059
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1521.000-1529.000=-8.000
σ0.000
min1521.000-1529.000=-8.000
max1521.000-1529.000=-8.000
mean4.188-4.202=-0.014
σ0.072-0.070=0.002
min4.082-4.083=-0.001
max4.463-4.473=-0.009
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1521.000-1529.000=-8.000
σ0.000
min1521.000-1529.000=-8.000
max1521.000-1529.000=-8.000
mean0.747-0.749=-0.002
σ0.018-0.018=-0.000
min0.716-0.719=-0.004
max0.861-0.851=0.010
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1521.000-1529.000=-8.000
σ0.000
min1521.000-1529.000=-8.000
max1521.000-1529.000=-8.000
mean0.709-0.707=0.002
σ0.015-0.016=-0.000
min0.677-0.678=-0.000
max0.759-0.775=-0.016

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.345-296.325=0.020
σ0.280-0.181=0.099
min296.123-296.175=-0.053
max297.095-296.801=0.294
mean2029.000-1889.000=140.000
σ0.000
min2029.000-1889.000=140.000
max2029.000-1889.000=140.000
mean0.568-0.585=-0.017
σ0.030-0.033=-0.003
min0.510-0.535=-0.025
max0.587-0.653=-0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.028-285.032=-0.004
σ0.035-0.037=-0.002
min284.980-284.982=-0.002
max285.063-285.072=-0.009
mean1521.000-1529.000=-8.000
σ0.000
min1521.000-1529.000=-8.000
max1521.000-1529.000=-8.000
mean0.393-0.395=-0.001
σ0.007-0.006=0.001
min0.387-0.388=-0.001
max0.403-0.401=0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.408-1295.417=-0.009
σ0.104-0.114=-0.010
min1295.300-1295.299=0.001
max1295.531-1295.581=-0.050
mean1521.000-1529.000=-8.000
σ0.000
min1521.000-1529.000=-8.000
max1521.000-1529.000=-8.000
mean1.899-1.888=0.011
σ0.151-0.083=0.068
min1.760-1.814=-0.054
max2.087-1.979=0.108
iters=5
new-facts=6402
prior-facts=1
mean1539.528-1539.520=0.008
σ6.841-6.856=-0.015
min1536.230-1536.226=0.004
max1551.762-1551.780=-0.018
mean1521.000-1529.000=-8.000
σ0.000
min1521.000-1529.000=-8.000
max1521.000-1529.000=-8.000
mean2.326-2.233=0.093
σ0.272-0.212=0.060
min2.043-2.037=0.005
max2.703-2.510=0.193
iters=5
new-facts=6402
prior-facts=6402
mean1857.311-1857.322=-0.011
σ0.064-0.071=-0.007
min1857.258-1857.239=0.018
max1857.397-1857.418=-0.021
mean1736.800-1752.000=-15.200
σ211.812-155.634=56.178
min1521.000-1529.000=-8.000
max2029.000-1889.000=140.000
mean2.866-2.941=-0.074
σ0.050-0.171=-0.121
min2.829-2.664=0.165
max2.953-3.099=-0.147

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.513-1.705=-0.191
σ0.270-0.182=0.088
min1.193-1.476=-0.283
max1.808-1.869=-0.061

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.191-448.191=-0.000
σ581.331-581.331=0.001
min157.524-157.525=-0.001
max1320.188-1320.187=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1521.000-1529.000=-8.000
σ0.000
min1521.000-1529.000=-8.000
max1521.000-1529.000=-8.000
mean0.536-0.542=-0.006
σ0.546-0.565=-0.019
min0.261-0.259=0.002
max1.355-1.389=-0.034
policies=20
mean1575.585-1575.568=0.017
σ0.382-0.348=0.034
min1575.331-1575.332=-0.001
max1576.154-1576.085=0.069
mean920.000
σ0.000
min920.000
max920.000
mean1521.000-1529.000=-8.000
σ0.000
min1521.000-1529.000=-8.000
max1521.000-1529.000=-8.000
mean2.680-2.622=0.058
σ0.058-0.016=0.042
min2.622-2.608=0.015
max2.756-2.645=0.111
policies=200
mean15763.744-15763.760=-0.017
σ0.109-0.108=0.001
min15763.674-15763.699=-0.025
max15763.906-15763.921=-0.016
mean9200.000
σ0.000
min9200.000
max9200.000
mean1521.000-1529.000=-8.000
σ0.000
min1521.000-1529.000=-8.000
max1521.000-1529.000=-8.000
mean26.539-26.489=0.050
σ0.016-0.031=-0.015
min26.525-26.461=0.064
max26.563-26.532=0.030