Compare commits

Home / Compare f701c012 .. c44f25c2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.054=0.000
σ0.369-0.371=-0.002
min53.907-53.908=-0.000
max55.104-55.108=-0.004
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.139-0.139=0.000
σ0.004-0.006=-0.003
min0.132-0.130=0.002
max0.144-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.000
σ0.008-0.006=0.002
min43.381-43.386=-0.005
max43.410-43.401=0.009
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.123-0.123=-0.000
σ0.004-0.004=0.000
min0.119-0.119=-0.000
max0.130-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.006-1007.006=-0.000
σ1.190-1.189=0.001
min1006.432-1006.434=-0.002
max1011.992-1011.987=0.006
mean1051.500-1055.100=-3.600
σ307.736-314.791=-7.055
min577.000-585.000=-8.000
max1643.000-1618.000=25.000
mean1.543-1.530=0.013
σ0.094-0.053=0.042
min1.454-1.459=-0.005
max1.803-1.631=0.172

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean0.431-0.447=-0.016
σ0.156-0.147=0.009
min0.342-0.362=-0.021
max0.708-0.705=0.004
name=error_case.art
mean2.339-2.339=0.000
σ0.002-0.003=-0.000
min2.337
max2.342
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean0.938-0.940=-0.002
σ0.204-0.214=-0.011
min0.826-0.827=-0.001
max1.302-1.322=-0.021
name=heavy_item.art
mean1.524-1.524=0.001
σ0.003-0.002=0.001
min1.522
max1.528-1.526=0.001
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean0.542-0.554=-0.012
σ0.048-0.057=-0.008
min0.503-0.487=0.015
max0.620-0.615=0.004
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean0.856-0.868=-0.012
σ0.040-0.039=0.001
min0.819-0.843=-0.024
max0.924-0.936=-0.012

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.840=-0.001
σ0.019-0.035=-0.016
min964.822-964.810=0.012
max964.870-964.898=-0.028
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean0.850-0.810=0.040
σ0.015-0.060=-0.045
min0.827-0.727=0.100
max0.866-0.861=0.005
name=cdr_enhanced_4k_loc.art
mean885.512-885.513=-0.001
σ0.007-0.008=-0.001
min885.504-885.506=-0.001
max885.521-885.525=-0.004
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean0.700-0.696=0.004
σ0.059-0.039=0.021
min0.622-0.648=-0.026
max0.746-0.751=-0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean4.232-4.281=-0.049
σ0.088-0.080=0.009
min4.087-4.132=-0.046
max4.660-4.671=-0.011
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.668
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean4.222-4.262=-0.040
σ0.071-0.117=-0.046
min4.096-4.096=-0.000
max4.503-5.012=-0.509
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean0.749-0.750=-0.001
σ0.017-0.017=-0.000
min0.717-0.711=0.006
max0.840-0.863=-0.022
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean0.708-0.703=0.005
σ0.014-0.015=-0.001
min0.681-0.674=0.007
max0.774-0.780=-0.006

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.944-296.935=0.009
σ0.191-0.246=-0.055
min296.796-296.719=0.076
max297.457-297.559=-0.102
mean1924.000-2032.000=-108.000
σ0.000
min1924.000-2032.000=-108.000
max1924.000-2032.000=-108.000
mean0.563-0.577=-0.014
σ0.046-0.020=0.026
min0.501-0.537=-0.036
max0.627-0.595=0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.825-286.818=0.007
σ0.041-0.039=0.002
min286.772-286.767=0.005
max286.877-286.858=0.019
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean0.398-0.396=0.003
σ0.015-0.005=0.009
min0.387-0.388=-0.001
max0.423-0.400=0.022
iters=5
new-facts=1
prior-facts=6402
mean1297.256-1297.211=0.045
σ0.061-0.121=-0.060
min1297.184-1297.088=0.096
max1297.310-1297.363=-0.054
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean2.122-1.879=0.244
σ0.121-0.094=0.027
min1.993-1.804=0.188
max2.304-2.017=0.287
iters=5
new-facts=6402
prior-facts=1
mean1541.303-1541.335=-0.032
σ6.870-6.843=0.027
min1538.022-1538.054=-0.032
max1553.588-1553.573=0.016
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean2.227-2.230=-0.004
σ0.210-0.156=0.054
min1.999-2.119=-0.120
max2.566-2.489=0.077
iters=5
new-facts=6402
prior-facts=6402
mean1859.109-1859.123=-0.014
σ0.081-0.065=0.016
min1858.986-1859.032=-0.046
max1859.183-1859.199=-0.016
mean1783.800-1763.000=20.800
σ140.002-178.827=-38.824
min1643.000-1618.000=25.000
max1924.000-2032.000=-108.000
mean3.188-2.891=0.297
σ0.265-0.145=0.120
min2.867-2.777=0.090
max3.539-3.143=0.396

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.143-1.228=-0.085
σ0.221-0.363=-0.142
min0.909-0.932=-0.023
max1.472-1.843=-0.371

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.821=0.001
σ581.372-581.372=-0.001
min158.135-158.131=0.005
max1320.880-1320.880=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean0.571-0.533=0.039
σ0.600-0.538=0.063
min0.255-0.260=-0.005
max1.472-1.339=0.133
policies=20
mean1581.628-1581.621=0.007
σ0.359-0.340=0.019
min1581.384-1581.390=-0.005
max1582.161-1582.126=0.036
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean2.646-2.608=0.038
σ0.042-0.014=0.028
min2.606-2.591=0.016
max2.704-2.623=0.081
policies=200
mean15824.240-15824.268=-0.028
σ0.092-0.067=0.026
min15824.160-15824.218=-0.058
max15824.371-15824.366=0.006
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean26.582-26.573=0.009
σ0.049-0.048=0.000
min26.514-26.517=-0.004
max26.629-26.630=-0.001