Compare commits

Home / Compare c51395da .. 3efdbabb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-53.964=0.000
σ0.369-0.367=0.002
min53.822-53.828=-0.006
max55.014-55.007=0.006
mean417.000-417.700=-0.700
σ0.000-0.483=-0.483
min417.000
max417.000-418.000=-1.000
mean0.138-0.140=-0.002
σ0.005-0.004=0.001
min0.129-0.135=-0.006
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.001
σ0.008-0.007=0.001
min43.310-43.316=-0.006
max43.338-43.335=0.003
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.122-0.121=0.001
σ0.004-0.004=-0.001
min0.119-0.116=0.003
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.520-1006.515=0.005
σ1.144-1.169=-0.025
min1005.944-1005.950=-0.006
max1011.295-1011.405=-0.110
mean1057.350-1041.500=15.850
σ315.872-311.560=4.312
min570.000-552.000=18.000
max1622.000-1511.000=111.000
mean1.525-1.545=-0.020
σ0.043-0.074=-0.031
min1.472-1.467=0.005
max1.635-1.728=-0.093

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.003-0.003=-0.000
min0.882
max0.887-0.887=-0.000
mean1622.000-1511.000=111.000
σ0.000
min1622.000-1511.000=111.000
max1622.000-1511.000=111.000
mean0.434-0.435=-0.001
σ0.176-0.171=0.004
min0.332-0.330=0.002
max0.745-0.740=0.005
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1622.000-1511.000=111.000
σ0.000
min1622.000-1511.000=111.000
max1622.000-1511.000=111.000
mean0.928-0.919=0.009
σ0.165-0.135=0.031
min0.835-0.840=-0.005
max1.222-1.157=0.065
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1622.000-1511.000=111.000
σ0.000
min1622.000-1511.000=111.000
max1622.000-1511.000=111.000
mean0.543-0.547=-0.004
σ0.048-0.053=-0.005
min0.508-0.497=0.010
max0.625-0.633=-0.009
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1622.000-1511.000=111.000
σ0.000
min1622.000-1511.000=111.000
max1622.000-1511.000=111.000
mean0.850-0.856=-0.006
σ0.037-0.045=-0.008
min0.824-0.821=0.003
max0.915-0.934=-0.019

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.830=0.010
σ0.035-0.025=0.010
min964.809-964.807=0.002
max964.898-964.870=0.028
mean1622.000-1511.000=111.000
σ0.000
min1622.000-1511.000=111.000
max1622.000-1511.000=111.000
mean0.831-0.811=0.020
σ0.022-0.038=-0.016
min0.807-0.762=0.045
max0.853-0.852=0.001
name=cdr_enhanced_4k_loc.art
mean885.511-885.510=0.001
σ0.006-0.006=0.000
min885.504
max885.518-885.516=0.001
mean1622.000-1511.000=111.000
σ0.000
min1622.000-1511.000=111.000
max1622.000-1511.000=111.000
mean0.716-0.677=0.038
σ0.033-0.051=-0.018
min0.678-0.609=0.070
max0.742-0.746=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.719=0.003
mean1622.000-1511.000=111.000
σ0.000
min1622.000-1511.000=111.000
max1622.000-1511.000=111.000
mean4.228-4.224=0.004
σ0.091-0.076=0.015
min4.074-4.093=-0.019
max4.520-4.570=-0.049
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.671=-0.003
mean1622.000-1511.000=111.000
σ0.000
min1622.000-1511.000=111.000
max1622.000-1511.000=111.000
mean4.211-4.202=0.009
σ0.071-0.065=0.005
min4.053-4.085=-0.032
max4.394-4.453=-0.060
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1622.000-1511.000=111.000
σ0.000
min1622.000-1511.000=111.000
max1622.000-1511.000=111.000
mean0.756-0.762=-0.006
σ0.020-0.020=-0.000
min0.721-0.719=0.002
max0.868-0.865=0.003
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1622.000-1511.000=111.000
σ0.000
min1622.000-1511.000=111.000
max1622.000-1511.000=111.000
mean0.711-0.713=-0.003
σ0.017-0.018=-0.001
min0.682-0.652=0.030
max0.798-0.784=0.014

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.546-296.453=0.093
σ0.249-0.204=0.044
min296.296-296.286=0.010
max297.205-296.984=0.221
mean1911.000-1922.000=-11.000
σ0.000
min1911.000-1922.000=-11.000
max1911.000-1922.000=-11.000
mean0.579-0.581=-0.002
σ0.051-0.049=0.002
min0.505-0.504=0.001
max0.689-0.682=0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.026-285.033=-0.007
σ0.037-0.038=-0.002
min284.977-284.979=-0.002
max285.062-285.075=-0.013
mean1622.000-1511.000=111.000
σ0.000
min1622.000-1511.000=111.000
max1622.000-1511.000=111.000
mean0.393-0.406=-0.013
σ0.007-0.007=0.001
min0.385-0.399=-0.014
max0.403-0.415=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1295.413-1295.459=-0.046
σ0.110-0.051=0.058
min1295.297-1295.404=-0.107
max1295.546-1295.519=0.028
mean1622.000-1511.000=111.000
σ0.000
min1622.000-1511.000=111.000
max1622.000-1511.000=111.000
mean1.904-2.166=-0.263
σ0.096-0.132=-0.036
min1.805-2.007=-0.202
max2.026-2.366=-0.339
iters=5
new-facts=6402
prior-facts=1
mean1539.517-1539.569=-0.052
σ6.846-6.846=0.001
min1536.217-1536.345=-0.127
max1551.759-1551.812=-0.052
mean1622.000-1511.000=111.000
σ0.000
min1622.000-1511.000=111.000
max1622.000-1511.000=111.000
mean2.331-2.332=-0.000
σ0.257-0.187=0.071
min2.036-2.117=-0.081
max2.623-2.549=0.074
iters=5
new-facts=6402
prior-facts=6402
mean1857.313-1857.315=-0.003
σ0.065-0.074=-0.009
min1857.233-1857.208=0.025
max1857.401-1857.396=0.005
mean1778.400-1752.000=26.400
σ136.992-177.990=-40.998
min1622.000-1511.000=111.000
max1911.000-1922.000=-11.000
mean3.041-3.100=-0.059
σ0.180-0.318=-0.138
min2.880-2.844=0.036
max3.341-3.589=-0.248

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.231-1.508=-0.277
σ0.354-0.383=-0.030
min0.931-0.964=-0.033
max1.827-1.850=-0.024

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.196-448.194=0.002
σ581.341-581.341=0.000
min157.524-157.521=0.003
max1320.207-1320.205=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1622.000-1511.000=111.000
σ0.000
min1622.000-1511.000=111.000
max1622.000-1511.000=111.000
mean0.554-0.541=0.013
σ0.586-0.543=0.043
min0.260-0.268=-0.009
max1.433-1.355=0.078
policies=20
mean1575.572-1575.558=0.014
σ0.356-0.361=-0.005
min1575.333-1575.316=0.017
max1576.101-1576.095=0.006
mean920.000
σ0.000
min920.000
max920.000
mean1622.000-1511.000=111.000
σ0.000
min1622.000-1511.000=111.000
max1622.000-1511.000=111.000
mean2.642-2.643=-0.001
σ0.039-0.017=0.022
min2.612-2.626=-0.014
max2.696-2.662=0.034
policies=200
mean15763.622-15763.699=-0.077
σ0.272-0.133=0.139
min15763.236-15763.590=-0.354
max15763.872-15763.883=-0.011
mean9200.000
σ0.000
min9200.000
max9200.000
mean1622.000-1511.000=111.000
σ0.000
min1622.000-1511.000=111.000
max1622.000-1511.000=111.000
mean26.577-26.564=0.013
σ0.091-0.030=0.061
min26.461-26.520=-0.059
max26.678-26.584=0.094