Compare commits

Home / Compare c41557af .. 8cc84a62

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.058-54.055=0.003
σ0.368-0.370=-0.002
min53.921-53.911=0.010
max55.104-55.106=-0.002
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.142-0.141=0.001
σ0.003-0.006=-0.002
min0.140-0.135=0.005
max0.149-0.150=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=0.001
σ0.007-0.006=0.001
min43.383-43.387=-0.004
max43.406-43.404=0.002
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.124-0.121=0.003
σ0.004-0.005=-0.001
min0.118-0.115=0.002
max0.130-0.130=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.926-1007.004=-0.078
σ0.876-1.202=-0.326
min1006.429-1006.435=-0.006
max1010.557-1012.048=-1.491
mean1054.450-1055.700=-1.250
σ315.111-308.526=6.586
min575.000-581.000=-6.000
max1619.000-1654.000=-35.000
mean1.527-1.553=-0.025
σ0.055-0.083=-0.028
min1.467-1.481=-0.014
max1.635-1.791=-0.157

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1619.000-1654.000=-35.000
σ0.000
min1619.000-1654.000=-35.000
max1619.000-1654.000=-35.000
mean0.445-0.411=0.034
σ0.209-0.137=0.073
min0.325-0.318=0.007
max0.818-0.652=0.166
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1619.000-1654.000=-35.000
σ0.000
min1619.000-1654.000=-35.000
max1619.000-1654.000=-35.000
mean0.905-0.873=0.033
σ0.158-0.082=0.076
min0.802-0.820=-0.017
max1.184-1.017=0.167
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1619.000-1654.000=-35.000
σ0.000
min1619.000-1654.000=-35.000
max1619.000-1654.000=-35.000
mean0.528-0.527=0.001
σ0.053-0.047=0.006
min0.488-0.491=-0.003
max0.618-0.601=0.017
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1619.000-1654.000=-35.000
σ0.000
min1619.000-1654.000=-35.000
max1619.000-1654.000=-35.000
mean0.845-0.832=0.013
σ0.041-0.044=-0.003
min0.818-0.803=0.015
max0.917-0.910=0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.839=0.002
σ0.035-0.028=0.007
min964.811-964.819=-0.007
max964.897-964.885=0.012
mean1619.000-1654.000=-35.000
σ0.000
min1619.000-1654.000=-35.000
max1619.000-1654.000=-35.000
mean0.803-0.818=-0.016
σ0.032-0.033=-0.001
min0.762-0.780=-0.018
max0.847-0.858=-0.010
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.008=-0.001
min885.506-885.504=0.001
max885.522-885.523=-0.001
mean1619.000-1654.000=-35.000
σ0.000
min1619.000-1654.000=-35.000
max1619.000-1654.000=-35.000
mean0.665-0.701=-0.036
σ0.076-0.029=0.047
min0.542-0.653=-0.111
max0.744-0.733=0.011

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.722=-0.003
mean1619.000-1654.000=-35.000
σ0.000
min1619.000-1654.000=-35.000
max1619.000-1654.000=-35.000
mean4.234-4.221=0.013
σ0.076-0.101=-0.026
min4.104-4.081=0.023
max4.502-4.604=-0.102
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1619.000-1654.000=-35.000
σ0.000
min1619.000-1654.000=-35.000
max1619.000-1654.000=-35.000
mean4.212-3.686=0.526
σ0.067-0.270=-0.204
min4.079-3.362=0.716
max4.506-4.434=0.073
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1619.000-1654.000=-35.000
σ0.000
min1619.000-1654.000=-35.000
max1619.000-1654.000=-35.000
mean0.729-0.736=-0.006
σ0.055-0.033=0.022
min0.520-0.550=-0.030
max0.858-0.918=-0.059
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1619.000-1654.000=-35.000
σ0.000
min1619.000-1654.000=-35.000
max1619.000-1654.000=-35.000
mean0.693-0.554=0.139
σ0.020-0.079=-0.059
min0.563-0.491=0.072
max0.724-0.792=-0.068

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.526-297.159=-1.633
σ0.218-0.192=0.026
min295.347-297.033=-1.687
max296.050-297.660=-1.610
mean1905.000-2033.000=-128.000
σ0.000
min1905.000-2033.000=-128.000
max1905.000-2033.000=-128.000
mean0.594-0.540=0.054
σ0.050-0.034=0.016
min0.515-0.503=0.012
max0.698-0.587=0.112

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.365-286.798=-1.433
σ0.036-0.036=-0.000
min285.320-286.749=-1.429
max285.407-286.833=-1.426
mean1619.000-1654.000=-35.000
σ0.000
min1619.000-1654.000=-35.000
max1619.000-1654.000=-35.000
mean0.392-0.395=-0.003
σ0.008-0.007=0.000
min0.381-0.390=-0.010
max0.401-0.408=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.748-1297.260=-1.512
σ0.120-0.082=0.038
min1295.617-1297.157=-1.540
max1295.897-1297.363=-1.467
mean1619.000-1654.000=-35.000
σ0.000
min1619.000-1654.000=-35.000
max1619.000-1654.000=-35.000
mean1.936-2.104=-0.168
σ0.092-0.089=0.003
min1.841-2.010=-0.169
max2.049-2.228=-0.179
iters=5
new-facts=6402
prior-facts=1
mean1539.853-1541.310=-1.458
σ6.816-6.843=-0.027
min1536.647-1538.055=-1.407
max1552.042-1553.547=-1.505
mean1619.000-1654.000=-35.000
σ0.000
min1619.000-1654.000=-35.000
max1619.000-1654.000=-35.000
mean2.192-2.199=-0.008
σ0.169-0.117=0.051
min2.033-2.097=-0.064
max2.389-2.391=-0.002
iters=5
new-facts=6402
prior-facts=6402
mean1857.646-1859.115=-1.468
σ0.062-0.081=-0.019
min1857.573-1858.987=-1.414
max1857.730-1859.186=-1.457
mean1773.400-1786.000=-12.600
σ135.192-164.804=-29.613
min1619.000-1654.000=-35.000
max1905.000-2033.000=-128.000
mean3.091-2.946=0.144
σ0.276-0.082=0.194
min2.872-2.852=0.019
max3.571-3.067=0.505

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.234-1.181=0.054
σ0.397-0.324=0.073
min0.949-0.966=-0.017
max1.905-1.755=0.150

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.489-448.821=-3.332
σ580.641-581.372=-0.732
min155.166-158.131=-2.966
max1316.450-1320.879=-4.429
mean96.250
σ8.500
min92.000
max109.000
mean1619.000-1654.000=-35.000
σ0.000
min1619.000-1654.000=-35.000
max1619.000-1654.000=-35.000
mean0.512-0.525=-0.013
σ0.504-0.513=-0.010
min0.258-0.266=-0.008
max1.267-1.295=-0.028
policies=20
mean1551.954-1581.632=-29.678
σ0.332-0.361=-0.030
min1551.728-1581.391=-29.663
max1552.447-1582.170=-29.723
mean920.000
σ0.000
min920.000
max920.000
mean1619.000-1654.000=-35.000
σ0.000
min1619.000-1654.000=-35.000
max1619.000-1654.000=-35.000
mean2.589-2.637=-0.048
σ0.009-0.014=-0.005
min2.576-2.622=-0.046
max2.598-2.654=-0.056
policies=200
mean15527.573-15824.232=-296.659
σ0.090-0.117=-0.027
min15527.451-15824.145=-296.693
max15527.651-15824.396=-296.745
mean9200.000
σ0.000
min9200.000
max9200.000
mean1619.000-1654.000=-35.000
σ0.000
min1619.000-1654.000=-35.000
max1619.000-1654.000=-35.000
mean26.172-26.627=-0.455
σ0.180-0.050=0.130
min26.064-26.582=-0.518
max26.441-26.694=-0.253