Compare commits

Home / Compare c032ce02 .. 630cdfc3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.046-54.046=-0.000
σ0.369-0.368=0.001
min53.906-53.901=0.005
max55.096-55.092=0.004
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.137-0.139=-0.002
σ0.004-0.004=0.000
min0.131-0.135=-0.004
max0.143-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.383-43.384=-0.001
σ0.007-0.007=-0.000
min43.372-43.374=-0.002
max43.395-43.393=0.002
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.123-0.122=0.001
σ0.004-0.005=-0.001
min0.120-0.116=0.004
max0.130-0.131=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.977-1006.985=-0.007
σ0.874-0.845=0.029
min1006.510-1006.480=0.030
max1010.593-1010.456=0.137
mean1048.400-1047.650=0.750
σ317.011-315.336=1.675
min576.000-575.000=1.000
max1651.000-1648.000=3.000
mean1.565-1.543=0.022
σ0.122-0.058=0.064
min1.467-1.453=0.014
max2.041-1.653=0.388

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.001
σ0.003-0.003=-0.000
min0.882
max0.887
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean0.415-0.405=0.009
σ0.138-0.149=-0.011
min0.325-0.325=-0.000
max0.658-0.671=-0.013
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.003=-0.000
min2.337
max2.342
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean0.884-0.876=0.008
σ0.086-0.084=0.002
min0.830-0.827=0.003
max1.036-1.025=0.011
name=heavy_item.art
mean1.524-1.524=-0.000
σ0.002-0.002=0.000
min1.522
max1.526
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean0.531-0.534=-0.004
σ0.053-0.051=0.002
min0.491-0.493=-0.003
max0.624-0.618=0.005
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean0.850-0.848=0.002
σ0.032-0.046=-0.015
min0.830-0.802=0.029
max0.906-0.925=-0.019

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.831=0.000
σ0.025-0.025=0.000
min964.802
max964.863-964.863=-0.000
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean0.836-0.810=0.026
σ0.033-0.034=-0.001
min0.777-0.757=0.021
max0.852-0.845=0.008
name=cdr_enhanced_4k_loc.art
mean885.513-885.513=0.000
σ0.008-0.006=0.003
min885.504
max885.523-885.517=0.005
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean0.730-0.729=0.001
σ0.008-0.026=-0.018
min0.717-0.683=0.034
max0.737-0.750=-0.013

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.722=-0.003
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean3.507-4.232=-0.726
σ0.069-0.099=-0.030
min3.380-4.094=-0.715
max3.737-4.731=-0.994
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean3.481-4.197=-0.717
σ0.069-0.071=-0.002
min3.324-4.055=-0.731
max3.727-4.402=-0.675
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean0.534-0.744=-0.210
σ0.013-0.017=-0.003
min0.512-0.708=-0.196
max0.617-0.842=-0.226
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean0.506-0.707=-0.201
σ0.011-0.014=-0.003
min0.483-0.680=-0.197
max0.556-0.784=-0.228

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.567-295.592=-0.025
σ0.211-0.229=-0.018
min295.386-295.420=-0.033
max296.132-296.231=-0.099
mean2025.000-1904.000=121.000
σ0.000
min2025.000-1904.000=121.000
max2025.000-1904.000=121.000
mean0.556-0.588=-0.032
σ0.028-0.054=-0.026
min0.515-0.509=0.006
max0.591-0.691=-0.101

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.405-285.408=-0.003
σ0.038-0.037=0.001
min285.356-285.359=-0.003
max285.445-285.447=-0.002
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean0.387-0.389=-0.002
σ0.009-0.009=0.000
min0.380-0.382=-0.002
max0.402-0.403=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.799-1295.800=-0.001
σ0.106-0.111=-0.004
min1295.678-1295.676=0.002
max1295.925-1295.934=-0.009
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean1.888-1.951=-0.063
σ0.096-0.176=-0.081
min1.797-1.815=-0.018
max2.029-2.248=-0.220
iters=5
new-facts=6402
prior-facts=1
mean1539.928-1539.939=-0.011
σ6.908-6.863=0.046
min1536.599-1536.649=-0.050
max1552.280-1552.210=0.070
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean2.383-2.353=0.030
σ0.353-0.230=0.123
min2.047-2.025=0.022
max2.843-2.619=0.224
iters=5
new-facts=6402
prior-facts=6402
mean1857.707-1857.701=0.005
σ0.051-0.061=-0.011
min1857.647-1857.638=0.009
max1857.770-1857.782=-0.012
mean1777.400-1777.800=-0.400
σ165.163-125.328=39.835
min1651.000-1648.000=3.000
max2025.000-1904.000=121.000
mean2.900-3.009=-0.109
σ0.060-0.190=-0.130
min2.840-2.850=-0.009
max2.972-3.337=-0.365

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.366-1.352=0.013
σ0.242-0.291=-0.049
min1.218-1.104=0.113
max1.796-1.857=-0.061

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.740=0.000
σ580.934-580.934=-0.000
min155.272-155.271=0.000
max1317.141-1317.141=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean0.536-0.550=-0.014
σ0.553-0.582=-0.030
min0.258-0.256=0.001
max1.365-1.424=-0.059
policies=20
mean1552.982-1552.987=-0.005
σ0.333-0.334=-0.001
min1552.755-1552.750=0.004
max1553.477-1553.481=-0.005
mean920.000
σ0.000
min920.000
max920.000
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean2.589-2.589=0.000
σ0.009-0.014=-0.004
min2.577-2.576=0.000
max2.599-2.603=-0.004
policies=200
mean15538.084-15538.052=0.032
σ0.083-0.096=-0.012
min15538.028-15537.963=0.066
max15538.207-15538.171=0.037
mean9200.000
σ0.000
min9200.000
max9200.000
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean26.110-26.172=-0.062
σ0.097-0.097=0.000
min26.037-26.070=-0.033
max26.252-26.289=-0.038