Compare commits

Home / Compare 1d1cc46f .. 97c01f6f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.053-54.054=-0.000
σ0.370-0.371=-0.000
min53.903-53.908=-0.004
max55.107-55.108=-0.001
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.139-0.139=0.001
σ0.005-0.006=-0.001
min0.132-0.130=0.002
max0.148-0.147=0.001
cache=y
dps=1
iters=10
policies=100
mean43.392-43.393=-0.001
σ0.006-0.006=-0.000
min43.383-43.386=-0.003
max43.404-43.401=0.003
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.122-0.123=-0.001
σ0.004-0.004=-0.000
min0.119-0.119=-0.000
max0.130-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1007.006=-0.001
σ1.191-1.189=0.002
min1006.437-1006.434=0.003
max1011.992-1011.987=0.006
mean1055.850-1055.100=0.750
σ309.024-314.791=-5.767
min580.000-585.000=-5.000
max1653.000-1618.000=35.000
mean1.537-1.530=0.007
σ0.075-0.053=0.022
min1.449-1.459=-0.010
max1.739-1.631=0.108

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1653.000-1618.000=35.000
σ0.000
min1653.000-1618.000=35.000
max1653.000-1618.000=35.000
mean0.428-0.447=-0.019
σ0.143-0.147=-0.004
min0.331-0.362=-0.031
max0.680-0.705=-0.025
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1653.000-1618.000=35.000
σ0.000
min1653.000-1618.000=35.000
max1653.000-1618.000=35.000
mean0.897-0.940=-0.043
σ0.082-0.214=-0.132
min0.841-0.827=0.013
max1.041-1.322=-0.281
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1653.000-1618.000=35.000
σ0.000
min1653.000-1618.000=35.000
max1653.000-1618.000=35.000
mean0.543-0.554=-0.011
σ0.051-0.057=-0.006
min0.492-0.487=0.004
max0.626-0.615=0.010
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1653.000-1618.000=35.000
σ0.000
min1653.000-1618.000=35.000
max1653.000-1618.000=35.000
mean0.851-0.868=-0.017
σ0.041-0.039=0.003
min0.828-0.843=-0.016
max0.925-0.936=-0.012

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.840=-0.000
σ0.035-0.035=-0.000
min964.811-964.810=0.000
max964.896-964.898=-0.001
mean1653.000-1618.000=35.000
σ0.000
min1653.000-1618.000=35.000
max1653.000-1618.000=35.000
mean0.839-0.810=0.030
σ0.020-0.060=-0.040
min0.812-0.727=0.084
max0.863-0.861=0.002
name=cdr_enhanced_4k_loc.art
mean885.512-885.513=-0.000
σ0.007-0.008=-0.000
min885.506
max885.523-885.525=-0.002
mean1653.000-1618.000=35.000
σ0.000
min1653.000-1618.000=35.000
max1653.000-1618.000=35.000
mean0.721-0.696=0.024
σ0.038-0.039=-0.001
min0.654-0.648=0.006
max0.743-0.751=-0.008

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.720=0.000
mean1653.000-1618.000=35.000
σ0.000
min1653.000-1618.000=35.000
max1653.000-1618.000=35.000
mean3.519-4.281=-0.762
σ0.077-0.080=-0.002
min3.407-4.132=-0.725
max3.866-4.671=-0.805
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1653.000-1618.000=35.000
σ0.000
min1653.000-1618.000=35.000
max1653.000-1618.000=35.000
mean3.525-4.262=-0.736
σ0.076-0.117=-0.042
min3.396-4.096=-0.700
max3.824-5.012=-1.188
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1653.000-1618.000=35.000
σ0.000
min1653.000-1618.000=35.000
max1653.000-1618.000=35.000
mean0.753-0.750=0.003
σ0.018-0.017=0.000
min0.724-0.711=0.012
max0.868-0.863=0.005
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1653.000-1618.000=35.000
σ0.000
min1653.000-1618.000=35.000
max1653.000-1618.000=35.000
mean0.719-0.703=0.016
σ0.015-0.015=0.000
min0.681-0.674=0.007
max0.808-0.780=0.028

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.851-296.935=-0.084
σ0.221-0.246=-0.025
min296.642-296.719=-0.078
max297.436-297.559=-0.123
mean2017.000-2032.000=-15.000
σ0.000
min2017.000-2032.000=-15.000
max2017.000-2032.000=-15.000
mean0.559-0.577=-0.018
σ0.026-0.020=0.006
min0.512-0.537=-0.026
max0.578-0.595=-0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.825-286.818=0.007
σ0.037-0.039=-0.001
min286.784-286.767=0.017
max286.866-286.858=0.008
mean1653.000-1618.000=35.000
σ0.000
min1653.000-1618.000=35.000
max1653.000-1618.000=35.000
mean0.397-0.396=0.001
σ0.007-0.005=0.001
min0.389-0.388=0.001
max0.404-0.400=0.004
iters=5
new-facts=1
prior-facts=6402
mean1297.186-1297.211=-0.025
σ0.130-0.121=0.009
min1297.094-1297.088=0.006
max1297.404-1297.363=0.041
mean1653.000-1618.000=35.000
σ0.000
min1653.000-1618.000=35.000
max1653.000-1618.000=35.000
mean1.917-1.879=0.038
σ0.185-0.094=0.091
min1.808-1.804=0.003
max2.238-2.017=0.222
iters=5
new-facts=6402
prior-facts=1
mean1541.370-1541.335=0.035
σ6.790-6.843=-0.053
min1538.173-1538.054=0.120
max1553.513-1553.573=-0.059
mean1653.000-1618.000=35.000
σ0.000
min1653.000-1618.000=35.000
max1653.000-1618.000=35.000
mean2.338-2.230=0.108
σ0.185-0.156=0.030
min2.133-2.119=0.014
max2.615-2.489=0.127
iters=5
new-facts=6402
prior-facts=6402
mean1859.114-1859.123=-0.009
σ0.057-0.065=-0.009
min1859.039-1859.032=0.006
max1859.178-1859.199=-0.021
mean1773.000-1763.000=10.000
σ158.273-178.827=-20.553
min1653.000-1618.000=35.000
max2017.000-2032.000=-15.000
mean2.911-2.891=0.020
σ0.128-0.145=-0.018
min2.832-2.777=0.055
max3.138-3.143=-0.005

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.227-1.228=-0.001
σ0.384-0.363=0.021
min0.931-0.932=-0.001
max1.786-1.843=-0.057

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.821=-0.002
σ581.372-581.372=-0.000
min158.132-158.131=0.002
max1320.878-1320.880=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1653.000-1618.000=35.000
σ0.000
min1653.000-1618.000=35.000
max1653.000-1618.000=35.000
mean0.555-0.533=0.023
σ0.579-0.538=0.042
min0.261-0.260=0.001
max1.424-1.339=0.085
policies=20
mean1581.609-1581.621=-0.012
σ0.356-0.340=0.016
min1581.372-1581.390=-0.018
max1582.138-1582.126=0.012
mean920.000
σ0.000
min920.000
max920.000
mean1653.000-1618.000=35.000
σ0.000
min1653.000-1618.000=35.000
max1653.000-1618.000=35.000
mean2.628-2.608=0.020
σ0.010-0.014=-0.004
min2.614-2.591=0.024
max2.637-2.623=0.013
policies=200
mean15824.185-15824.268=-0.084
σ0.149-0.067=0.082
min15824.002-15824.218=-0.215
max15824.364-15824.366=-0.001
mean9200.000
σ0.000
min9200.000
max9200.000
mean1653.000-1618.000=35.000
σ0.000
min1653.000-1618.000=35.000
max1653.000-1618.000=35.000
mean26.556-26.573=-0.017
σ0.039-0.048=-0.009
min26.525-26.517=0.008
max26.607-26.630=-0.022