Compare commits

Home / Compare ac56cc01 .. 1bd0794e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.966-53.965=0.001
σ0.369-0.369=-0.000
min53.829-53.825=0.003
max55.017-55.016=0.001
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.140-0.140=0.001
σ0.004-0.004=-0.000
min0.137-0.136=0.001
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=-0.000
σ0.007-0.006=0.001
min43.317-43.316=0.001
max43.337-43.333=0.004
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.122-0.122=-0.000
σ0.004-0.003=0.001
min0.115-0.119=-0.004
max0.129-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.515-1006.514=0.001
σ1.169-1.181=-0.012
min1005.948-1005.976=-0.028
max1011.404-1011.464=-0.059
mean1041.100-1048.550=-7.450
σ311.375-303.917=7.457
min551.000-584.000=-33.000
max1510.000-1637.000=-127.000
mean1.537-1.572=-0.035
σ0.076-0.086=-0.011
min1.471-1.501=-0.030
max1.790-1.823=-0.033

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1510.000-1637.000=-127.000
σ0.000
min1510.000-1637.000=-127.000
max1510.000-1637.000=-127.000
mean0.409-0.421=-0.012
σ0.128-0.133=-0.005
min0.331-0.349=-0.018
max0.634-0.657=-0.023
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1510.000-1637.000=-127.000
σ0.000
min1510.000-1637.000=-127.000
max1510.000-1637.000=-127.000
mean0.873-0.894=-0.021
σ0.096-0.089=0.007
min0.805-0.834=-0.029
max1.042-1.051=-0.009
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1510.000-1637.000=-127.000
σ0.000
min1510.000-1637.000=-127.000
max1510.000-1637.000=-127.000
mean0.530-0.537=-0.007
σ0.047-0.046=0.001
min0.484-0.496=-0.011
max0.603-0.610=-0.006
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1510.000-1637.000=-127.000
σ0.000
min1510.000-1637.000=-127.000
max1510.000-1637.000=-127.000
mean0.853-0.837=0.016
σ0.029-0.048=-0.019
min0.816-0.804=0.012
max0.896-0.916=-0.020

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.838=-0.007
σ0.039-0.020=0.019
min964.802-964.818=-0.016
max964.899-964.869=0.030
mean1510.000-1637.000=-127.000
σ0.000
min1510.000-1637.000=-127.000
max1510.000-1637.000=-127.000
mean0.837-0.832=0.005
σ0.017-0.031=-0.014
min0.814-0.797=0.016
max0.860-0.862=-0.002
name=cdr_enhanced_4k_loc.art
mean885.510-885.514=-0.004
σ0.005-0.006=-0.001
min885.504
max885.515-885.521=-0.006
mean1510.000-1637.000=-127.000
σ0.000
min1510.000-1637.000=-127.000
max1510.000-1637.000=-127.000
mean0.703-0.689=0.013
σ0.031-0.030=0.001
min0.671-0.664=0.007
max0.736-0.737=-0.000

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.002
mean1510.000-1637.000=-127.000
σ0.000
min1510.000-1637.000=-127.000
max1510.000-1637.000=-127.000
mean4.222-4.275=-0.053
σ0.077-0.099=-0.022
min4.115-4.096=0.019
max4.516-4.764=-0.247
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.670=-0.002
mean1510.000-1637.000=-127.000
σ0.000
min1510.000-1637.000=-127.000
max1510.000-1637.000=-127.000
mean3.897-4.266=-0.368
σ0.369-0.073=0.297
min3.372-4.116=-0.743
max4.575-4.504=0.070
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1510.000-1637.000=-127.000
σ0.000
min1510.000-1637.000=-127.000
max1510.000-1637.000=-127.000
mean0.732-0.746=-0.013
σ0.017-0.017=0.000
min0.704-0.711=-0.007
max0.857-0.848=0.010
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1510.000-1637.000=-127.000
σ0.000
min1510.000-1637.000=-127.000
max1510.000-1637.000=-127.000
mean0.701-0.611=0.090
σ0.016-0.097=-0.081
min0.649-0.491=0.158
max0.769-0.815=-0.046

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.411-296.554=-0.142
σ0.186-0.201=-0.015
min296.290-296.342=-0.051
max296.908-297.047=-0.139
mean2033.000-1905.000=128.000
σ0.000
min2033.000-1905.000=128.000
max2033.000-1905.000=128.000
mean0.583-0.583=-0.000
σ0.013-0.050=-0.038
min0.559-0.505=0.053
max0.599-0.682=-0.083

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.032-285.029=0.002
σ0.039-0.036=0.003
min284.982-284.980=0.002
max285.077-285.071=0.007
mean1510.000-1637.000=-127.000
σ0.000
min1510.000-1637.000=-127.000
max1510.000-1637.000=-127.000
mean0.395-0.396=-0.000
σ0.006-0.010=-0.004
min0.389-0.387=0.003
max0.405-0.411=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1295.417-1295.416=0.001
σ0.114-0.107=0.007
min1295.288-1295.297=-0.009
max1295.556-1295.544=0.012
mean1510.000-1637.000=-127.000
σ0.000
min1510.000-1637.000=-127.000
max1510.000-1637.000=-127.000
mean1.871-1.912=-0.042
σ0.057-0.087=-0.030
min1.811-1.814=-0.003
max1.956-2.030=-0.074
iters=5
new-facts=6402
prior-facts=1
mean1539.519-1539.584=-0.065
σ6.871-6.829=0.042
min1536.242-1536.305=-0.063
max1551.805-1551.795=0.009
mean1510.000-1637.000=-127.000
σ0.000
min1510.000-1637.000=-127.000
max1510.000-1637.000=-127.000
mean2.296-2.388=-0.092
σ0.245-0.276=-0.031
min2.079-1.960=0.118
max2.656-2.703=-0.048
iters=5
new-facts=6402
prior-facts=6402
mean1857.316-1857.320=-0.004
σ0.057-0.057=0.001
min1857.267-1857.265=0.002
max1857.398-1857.402=-0.004
mean1740.200-1770.600=-30.400
σ215.687-130.494=85.192
min1510.000-1637.000=-127.000
max2033.000-1905.000=128.000
mean2.820-3.067=-0.247
σ0.087-0.299=-0.213
min2.710-2.844=-0.134
max2.952-3.582=-0.630

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.550-1.141=0.409
σ0.344-0.250=0.094
min0.965-0.927=0.038
max1.845-1.518=0.328

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.190-448.191=-0.001
σ581.332-581.332=-0.001
min157.522-157.521=0.001
max1320.187-1320.189=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1510.000-1637.000=-127.000
σ0.000
min1510.000-1637.000=-127.000
max1510.000-1637.000=-127.000
mean0.553-0.531=0.023
σ0.579-0.548=0.031
min0.261-0.246=0.016
max1.422-1.353=0.069
policies=20
mean1575.552-1575.576=-0.023
σ0.354-0.366=-0.012
min1575.317-1575.330=-0.014
max1576.079-1576.121=-0.041
mean920.000
σ0.000
min920.000
max920.000
mean1510.000-1637.000=-127.000
σ0.000
min1510.000-1637.000=-127.000
max1510.000-1637.000=-127.000
mean2.627-2.648=-0.020
σ0.012-0.016=-0.003
min2.614-2.632=-0.017
max2.642-2.668=-0.027
policies=200
mean15763.742-15763.747=-0.005
σ0.123-0.100=0.023
min15763.584-15763.664=-0.079
max15763.884-15763.882=0.003
mean9200.000
σ0.000
min9200.000
max9200.000
mean1510.000-1637.000=-127.000
σ0.000
min1510.000-1637.000=-127.000
max1510.000-1637.000=-127.000
mean26.528-26.634=-0.106
σ0.030-0.121=-0.091
min26.493-26.512=-0.020
max26.567-26.801=-0.234