Compare commits

Home / Compare 7dd7ed8a .. c186a03c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.056=0.001
σ0.369-0.369=0.000
min53.907-53.910=-0.003
max55.106-55.105=0.002
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.139-0.140=-0.001
σ0.004-0.005=-0.001
min0.136-0.136=-0.000
max0.145-0.151=-0.006
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=0.000
σ0.006-0.006=0.000
min43.386-43.385=0.001
max43.403-43.404=-0.001
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.122-0.121=0.001
σ0.005-0.005=-0.001
min0.115-0.114=0.001
max0.131-0.129=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.978-1006.982=-0.004
σ0.878-0.880=-0.002
min1006.481-1006.482=-0.000
max1010.620-1010.621=-0.001
mean1044.250-1059.400=-15.150
σ305.980-318.382=-12.402
min576.000-569.000=7.000
max1660.000-1638.000=22.000
mean1.544-1.552=-0.008
σ0.081-0.072=0.009
min1.429-1.478=-0.049
max1.805-1.766=0.039

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.001
σ0.003-0.002=0.000
min0.882
max0.887
mean1660.000-1638.000=22.000
σ0.000
min1660.000-1638.000=22.000
max1660.000-1638.000=22.000
mean0.415-0.409=0.006
σ0.136-0.120=0.015
min0.336-0.328=0.008
max0.656-0.619=0.037
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.003=0.000
min2.337
max2.342
mean1660.000-1638.000=22.000
σ0.000
min1660.000-1638.000=22.000
max1660.000-1638.000=22.000
mean0.879-0.881=-0.002
σ0.090-0.088=0.002
min0.816-0.830=-0.014
max1.037-1.036=0.001
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002-0.001=0.001
min1.522
max1.526-1.525=0.001
mean1660.000-1638.000=22.000
σ0.000
min1660.000-1638.000=22.000
max1660.000-1638.000=22.000
mean0.535-0.564=-0.029
σ0.053-0.075=-0.021
min0.489-0.481=0.008
max0.621-0.644=-0.024
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1660.000-1638.000=22.000
σ0.000
min1660.000-1638.000=22.000
max1660.000-1638.000=22.000
mean0.851-0.855=-0.004
σ0.049-0.056=-0.007
min0.808-0.806=0.002
max0.931-0.944=-0.013

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.830=0.010
σ0.033-0.025=0.008
min964.811-964.802=0.010
max964.894-964.863=0.031
mean1660.000-1638.000=22.000
σ0.000
min1660.000-1638.000=22.000
max1660.000-1638.000=22.000
mean0.796-0.811=-0.015
σ0.067-0.041=0.026
min0.705-0.772=-0.068
max0.862-0.857=0.005
name=cdr_enhanced_4k_loc.art
mean885.513-885.514=-0.001
σ0.008-0.004=0.004
min885.506-885.508=-0.002
max885.525-885.518=0.007
mean1660.000-1638.000=22.000
σ0.000
min1660.000-1638.000=22.000
max1660.000-1638.000=22.000
mean0.708-0.725=-0.017
σ0.055-0.041=0.014
min0.615-0.653=-0.038
max0.752-0.758=-0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.002
mean1660.000-1638.000=22.000
σ0.000
min1660.000-1638.000=22.000
max1660.000-1638.000=22.000
mean4.209-4.271=-0.063
σ0.108-0.069=0.039
min3.589-4.136=-0.547
max4.674-4.587=0.087
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1660.000-1638.000=22.000
σ0.000
min1660.000-1638.000=22.000
max1660.000-1638.000=22.000
mean4.196-4.256=-0.060
σ0.140-0.081=0.059
min3.551-4.103=-0.552
max4.509-4.521=-0.011
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1660.000-1638.000=22.000
σ0.000
min1660.000-1638.000=22.000
max1660.000-1638.000=22.000
mean0.741-0.748=-0.007
σ0.017-0.017=-0.001
min0.715-0.709=0.005
max0.849-0.871=-0.021
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1660.000-1638.000=22.000
σ0.000
min1660.000-1638.000=22.000
max1660.000-1638.000=22.000
mean0.708-0.600=0.108
σ0.014-0.103=-0.089
min0.674-0.471=0.203
max0.768-0.808=-0.040

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.554-295.659=-0.104
σ0.234-0.189=0.044
min295.379-295.532=-0.154
max296.188-296.185=0.002
mean2048.000-1924.000=124.000
σ0.000
min2048.000-1924.000=124.000
max2048.000-1924.000=124.000
mean0.569-0.565=0.004
σ0.036-0.046=-0.011
min0.514-0.499=0.015
max0.602-0.668=-0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.407-285.405=0.002
σ0.039-0.033=0.005
min285.356-285.367=-0.011
max285.446-285.445=0.002
mean1660.000-1638.000=22.000
σ0.000
min1660.000-1638.000=22.000
max1660.000-1638.000=22.000
mean0.389-0.389=-0.000
σ0.010-0.006=0.004
min0.381-0.382=-0.001
max0.402-0.394=0.008
iters=5
new-facts=1
prior-facts=6402
mean1295.792-1295.781=0.010
σ0.107-0.113=-0.006
min1295.669-1295.674=-0.005
max1295.910-1295.971=-0.061
mean1660.000-1638.000=22.000
σ0.000
min1660.000-1638.000=22.000
max1660.000-1638.000=22.000
mean1.879-2.002=-0.123
σ0.081-0.187=-0.106
min1.796-1.804=-0.008
max1.984-2.207=-0.223
iters=5
new-facts=6402
prior-facts=1
mean1539.932-1540.014=-0.081
σ6.861-6.805=0.057
min1536.636-1536.850=-0.214
max1552.201-1552.184=0.017
mean1660.000-1638.000=22.000
σ0.000
min1660.000-1638.000=22.000
max1660.000-1638.000=22.000
mean2.345-2.387=-0.043
σ0.101-0.182=-0.081
min2.182-2.138=0.044
max2.438-2.593=-0.155
iters=5
new-facts=6402
prior-facts=6402
mean1857.706-1857.702=0.003
σ0.063-0.051=0.012
min1857.648-1857.654=-0.006
max1857.791-1857.772=0.018
mean1800.400-1780.000=20.400
σ167.953-139.755=28.198
min1660.000-1638.000=22.000
max2048.000-1924.000=124.000
mean2.946-3.020=-0.074
σ0.092-0.198=-0.106
min2.841-2.873=-0.032
max3.068-3.362=-0.295

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.269-1.369=-0.100
σ0.323-0.270=0.053
min0.945-1.093=-0.148
max1.790-1.819=-0.029

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.742-445.741=0.001
σ580.934-580.934=-0.000
min155.273-155.272=0.001
max1317.143-1317.142=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1660.000-1638.000=22.000
σ0.000
min1660.000-1638.000=22.000
max1660.000-1638.000=22.000
mean0.551-0.535=0.016
σ0.582-0.555=0.027
min0.255-0.256=-0.001
max1.424-1.368=0.057
policies=20
mean1552.993-1552.991=0.003
σ0.328-0.331=-0.003
min1552.771-1552.762=0.009
max1553.481-1553.482=-0.001
mean920.000
σ0.000
min920.000
max920.000
mean1660.000-1638.000=22.000
σ0.000
min1660.000-1638.000=22.000
max1660.000-1638.000=22.000
mean2.592-2.588=0.004
σ0.018-0.020=-0.002
min2.570-2.567=0.003
max2.609-2.613=-0.003
policies=200
mean15538.005-15537.962=0.043
σ0.059-0.129=-0.070
min15537.935-15537.827=0.107
max15538.071-15538.108=-0.037
mean9200.000
σ0.000
min9200.000
max9200.000
mean1660.000-1638.000=22.000
σ0.000
min1660.000-1638.000=22.000
max1660.000-1638.000=22.000
mean26.172-26.202=-0.030
σ0.138-0.136=0.002
min26.009-26.110=-0.101
max26.336-26.397=-0.061