Compare commits

Home / Compare f224de8c .. 43ebb42c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-53.965=-0.002
σ0.370-0.370=-0.000
min53.819-53.822=-0.003
max55.016-55.018=-0.003
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.139-0.140=-0.001
σ0.004-0.004=-0.000
min0.135-0.136=-0.000
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.001
σ0.008-0.007=0.001
min43.311-43.314=-0.003
max43.337-43.337=-0.000
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.123-0.121=0.002
σ0.004-0.004=0.000
min0.119-0.115=0.003
max0.130-0.127=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.521-1006.515=0.006
σ1.150-1.211=-0.061
min1005.948-1005.949=-0.001
max1011.327-1011.601=-0.275
mean1063.600-1048.900=14.700
σ319.707-310.089=9.619
min551.000-555.000=-4.000
max1521.000-1516.000=5.000
mean1.522-1.518=0.004
σ0.051-0.111=-0.059
min1.460-1.350=0.109
max1.607-1.933=-0.326

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1521.000-1516.000=5.000
σ0.000
min1521.000-1516.000=5.000
max1521.000-1516.000=5.000
mean0.422-0.427=-0.006
σ0.139-0.137=0.002
min0.330-0.348=-0.018
max0.667-0.672=-0.005
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1521.000-1516.000=5.000
σ0.000
min1521.000-1516.000=5.000
max1521.000-1516.000=5.000
mean0.888-0.889=-0.001
σ0.101-0.086=0.015
min0.819-0.830=-0.011
max1.066-1.040=0.026
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1521.000-1516.000=5.000
σ0.000
min1521.000-1516.000=5.000
max1521.000-1516.000=5.000
mean0.534-0.545=-0.011
σ0.053-0.047=0.007
min0.494-0.510=-0.016
max0.624-0.622=0.001
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1521.000-1516.000=5.000
σ0.000
min1521.000-1516.000=5.000
max1521.000-1516.000=5.000
mean0.842-0.855=-0.014
σ0.044-0.047=-0.003
min0.805-0.810=-0.005
max0.917-0.933=-0.016

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.830=-0.001
σ0.028-0.037=-0.009
min964.806-964.807=-0.001
max964.878-964.896=-0.018
mean1521.000-1516.000=5.000
σ0.000
min1521.000-1516.000=5.000
max1521.000-1516.000=5.000
mean0.842-0.837=0.005
σ0.026-0.020=0.007
min0.812-0.809=0.003
max0.874-0.854=0.020
name=cdr_enhanced_4k_loc.art
mean885.509-885.511=-0.001
σ0.004-0.006=-0.002
min885.504
max885.514-885.519=-0.005
mean1521.000-1516.000=5.000
σ0.000
min1521.000-1516.000=5.000
max1521.000-1516.000=5.000
mean0.694-0.724=-0.031
σ0.065-0.015=0.050
min0.589-0.699=-0.110
max0.738-0.737=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.720=-0.000
mean1521.000-1516.000=5.000
σ0.000
min1521.000-1516.000=5.000
max1521.000-1516.000=5.000
mean4.232-3.623=0.610
σ0.085-0.300=-0.215
min4.091-3.382=0.709
max4.554-4.587=-0.034
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1521.000-1516.000=5.000
σ0.000
min1521.000-1516.000=5.000
max1521.000-1516.000=5.000
mean4.188-4.205=-0.016
σ0.072-0.081=-0.009
min4.082-4.065=0.017
max4.463-4.457=0.006
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1521.000-1516.000=5.000
σ0.000
min1521.000-1516.000=5.000
max1521.000-1516.000=5.000
mean0.747-0.741=0.007
σ0.018-0.018=-0.000
min0.716-0.708=0.008
max0.861-0.854=0.006
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1521.000-1516.000=5.000
σ0.000
min1521.000-1516.000=5.000
max1521.000-1516.000=5.000
mean0.709-0.698=0.011
σ0.015-0.016=-0.000
min0.677-0.661=0.016
max0.759-0.774=-0.015

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.345-296.378=-0.033
σ0.280-0.232=0.048
min296.123-296.153=-0.031
max297.095-296.946=0.150
mean2029.000-1909.000=120.000
σ0.000
min2029.000-1909.000=120.000
max2029.000-1909.000=120.000
mean0.568-0.585=-0.017
σ0.030-0.043=-0.013
min0.510-0.491=0.020
max0.587-0.654=-0.067

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.028-285.032=-0.005
σ0.035-0.037=-0.002
min284.980-284.986=-0.006
max285.063-285.074=-0.011
mean1521.000-1516.000=5.000
σ0.000
min1521.000-1516.000=5.000
max1521.000-1516.000=5.000
mean0.393-0.397=-0.004
σ0.007-0.005=0.001
min0.387-0.389=-0.002
max0.403-0.402=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.408-1295.413=-0.005
σ0.104-0.117=-0.013
min1295.300-1295.296=0.004
max1295.531-1295.584=-0.053
mean1521.000-1516.000=5.000
σ0.000
min1521.000-1516.000=5.000
max1521.000-1516.000=5.000
mean1.899-1.900=-0.001
σ0.151-0.084=0.067
min1.760-1.817=-0.058
max2.087-1.995=0.092
iters=5
new-facts=6402
prior-facts=1
mean1539.528-1539.528=0.000
σ6.841-6.867=-0.026
min1536.230-1536.213=0.017
max1551.762-1551.807=-0.045
mean1521.000-1516.000=5.000
σ0.000
min1521.000-1516.000=5.000
max1521.000-1516.000=5.000
mean2.326-2.261=0.065
σ0.272-0.225=0.047
min2.043-2.080=-0.038
max2.703-2.584=0.119
iters=5
new-facts=6402
prior-facts=6402
mean1857.311-1857.324=-0.013
σ0.064-0.062=0.002
min1857.258-1857.250=0.008
max1857.397-1857.405=-0.008
mean1736.800-1749.400=-12.600
σ211.812-168.968=42.843
min1521.000-1516.000=5.000
max2029.000-1909.000=120.000
mean2.866-3.106=-0.239
σ0.050-0.346=-0.296
min2.829-2.840=-0.011
max2.953-3.705=-0.752

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.513-1.540=-0.026
σ0.270-0.273=-0.004
min1.193-1.244=-0.051
max1.808-1.788=0.020

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.191-448.192=-0.000
σ581.331-581.332=-0.000
min157.524-157.524=-0.000
max1320.188-1320.189=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1521.000-1516.000=5.000
σ0.000
min1521.000-1516.000=5.000
max1521.000-1516.000=5.000
mean0.536-0.533=0.003
σ0.546-0.541=0.005
min0.261-0.262=-0.001
max1.355-1.345=0.010
policies=20
mean1575.585-1575.575=0.010
σ0.382-0.357=0.025
min1575.331-1575.336=-0.005
max1576.154-1576.106=0.048
mean920.000
σ0.000
min920.000
max920.000
mean1521.000-1516.000=5.000
σ0.000
min1521.000-1516.000=5.000
max1521.000-1516.000=5.000
mean2.680-2.629=0.051
σ0.058-0.017=0.041
min2.622-2.611=0.011
max2.756-2.651=0.104
policies=200
mean15763.744-15763.674=0.070
σ0.109-0.151=-0.042
min15763.674-15763.544=0.129
max15763.906-15763.847=0.058
mean9200.000
σ0.000
min9200.000
max9200.000
mean1521.000-1516.000=5.000
σ0.000
min1521.000-1516.000=5.000
max1521.000-1516.000=5.000
mean26.539-26.501=0.038
σ0.016-0.040=-0.023
min26.525-26.461=0.064
max26.563-26.556=0.007