Compare commits

Home / Compare c4f1c620 .. 2468ee98

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.045-54.049=-0.004
σ0.369-0.373=-0.004
min53.900-53.904=-0.004
max55.094-55.109=-0.015
mean415.000
σ0.000
min415.000
max415.000
mean0.137-0.147=-0.011
σ0.005-0.011=-0.005
min0.130-0.137=-0.007
max0.144-0.167=-0.023
cache=y
dps=1
iters=10
policies=100
mean43.384-43.386=-0.002
σ0.007-0.009=-0.003
min43.373-43.377=-0.004
max43.393-43.406=-0.013
mean415.000
σ0.000
min415.000
max415.000
mean0.123-0.128=-0.005
σ0.004-0.009=-0.005
min0.119-0.120=-0.001
max0.130-0.148=-0.017

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.977-1006.982=-0.005
σ0.868-0.871=-0.003
min1006.511-1006.480=0.031
max1010.571-1010.582=-0.011
mean1046.700-1051.700=-5.000
σ315.749-319.782=-4.033
min576.000-575.000=1.000
max1643.000-1620.000=23.000
mean1.553-1.553=-0.000
σ0.133-0.066=0.067
min1.365-1.474=-0.109
max2.056-1.768=0.288

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.001
σ0.002-0.003=-0.000
min0.882
max0.887
mean1643.000-1620.000=23.000
σ0.000
min1643.000-1620.000=23.000
max1643.000-1620.000=23.000
mean0.414-0.410=0.004
σ0.150-0.141=0.009
min0.333-0.325=0.008
max0.681-0.661=0.020
name=error_case.art
mean2.339-2.339=0.001
σ0.003-0.003=-0.000
min2.337
max2.342
mean1643.000-1620.000=23.000
σ0.000
min1643.000-1620.000=23.000
max1643.000-1620.000=23.000
mean0.885-0.884=0.001
σ0.083-0.100=-0.017
min0.822-0.823=-0.001
max1.026-1.060=-0.034
name=heavy_item.art
mean1.523-1.524=-0.001
σ0.001-0.002=-0.001
min1.522
max1.525-1.526=-0.001
mean1643.000-1620.000=23.000
σ0.000
min1643.000-1620.000=23.000
max1643.000-1620.000=23.000
mean0.535-0.540=-0.004
σ0.048-0.056=-0.007
min0.492-0.500=-0.008
max0.612-0.636=-0.024
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1643.000-1620.000=23.000
σ0.000
min1643.000-1620.000=23.000
max1643.000-1620.000=23.000
mean0.849-0.846=0.003
σ0.031-0.041=-0.010
min0.829-0.817=0.011
max0.903-0.916=-0.013

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.836-964.831=0.004
σ0.031-0.023=0.008
min964.811-964.805=0.006
max964.888-964.862=0.027
mean1643.000-1620.000=23.000
σ0.000
min1643.000-1620.000=23.000
max1643.000-1620.000=23.000
mean0.817-0.827=-0.010
σ0.050-0.038=0.011
min0.732-0.770=-0.038
max0.854-0.856=-0.001
name=cdr_enhanced_4k_loc.art
mean885.514-885.513=0.001
σ0.006-0.009=-0.003
min885.505-885.504=0.001
max885.519-885.524=-0.005
mean1643.000-1620.000=23.000
σ0.000
min1643.000-1620.000=23.000
max1643.000-1620.000=23.000
mean0.701-0.702=-0.001
σ0.047-0.030=0.018
min0.626-0.664=-0.039
max0.738-0.739=-0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.721=-0.000
mean1643.000-1620.000=23.000
σ0.000
min1643.000-1620.000=23.000
max1643.000-1620.000=23.000
mean4.260-4.222=0.038
σ0.086-0.091=-0.005
min4.131-4.041=0.090
max4.629-4.569=0.060
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1643.000-1620.000=23.000
σ0.000
min1643.000-1620.000=23.000
max1643.000-1620.000=23.000
mean4.226-4.211=0.015
σ0.080-0.095=-0.015
min4.081-4.059=0.022
max4.540-4.719=-0.180
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1643.000-1620.000=23.000
σ0.000
min1643.000-1620.000=23.000
max1643.000-1620.000=23.000
mean0.732-0.737=-0.005
σ0.034-0.027=0.007
min0.560-0.528=0.033
max0.862-0.835=0.027
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1643.000-1620.000=23.000
σ0.000
min1643.000-1620.000=23.000
max1643.000-1620.000=23.000
mean0.698-0.701=-0.004
σ0.016-0.014=0.001
min0.667-0.672=-0.005
max0.762-0.780=-0.018

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.608-295.737=-0.130
σ0.257-0.223=0.034
min295.369-295.571=-0.201
max296.307-296.356=-0.049
mean1919.000-2046.000=-127.000
σ0.000
min1919.000-2046.000=-127.000
max1919.000-2046.000=-127.000
mean0.568-0.548=0.020
σ0.046-0.029=0.017
min0.493-0.505=-0.012
max0.649-0.579=0.070

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.414-285.409=0.005
σ0.033-0.037=-0.004
min285.371-285.363=0.008
max285.449-285.446=0.003
mean1643.000-1620.000=23.000
σ0.000
min1643.000-1620.000=23.000
max1643.000-1620.000=23.000
mean0.392-0.395=-0.002
σ0.013-0.008=0.005
min0.383-0.388=-0.006
max0.408-0.408=0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.798-1295.800=-0.003
σ0.106-0.114=-0.008
min1295.678-1295.673=0.004
max1295.926-1295.942=-0.016
mean1643.000-1620.000=23.000
σ0.000
min1643.000-1620.000=23.000
max1643.000-1620.000=23.000
mean1.894-1.917=-0.024
σ0.089-0.099=-0.010
min1.809-1.806=0.003
max2.009-2.052=-0.042
iters=5
new-facts=6402
prior-facts=1
mean1539.913-1539.933=-0.019
σ6.909-6.875=0.034
min1536.602-1536.654=-0.052
max1552.268-1552.226=0.042
mean1643.000-1620.000=23.000
σ0.000
min1643.000-1620.000=23.000
max1643.000-1620.000=23.000
mean2.340-2.306=0.034
σ0.310-0.168=0.143
min2.046-2.110=-0.064
max2.679-2.476=0.204
iters=5
new-facts=6402
prior-facts=6402
mean1857.711-1857.712=-0.000
σ0.058-0.056=0.002
min1857.650-1857.656=-0.006
max1857.782-1857.784=-0.002
mean1781.000-1783.400=-2.400
σ138.000-184.268=-46.268
min1643.000-1620.000=23.000
max1919.000-2046.000=-127.000
mean3.054-2.891=0.163
σ0.179-0.082=0.097
min2.849-2.826=0.023
max3.324-3.014=0.309

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.315-1.408=-0.093
σ0.302-0.241=0.061
min1.076-1.259=-0.183
max1.832-1.827=0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.739-445.739=-0.001
σ580.935-580.934=0.001
min155.269-155.271=-0.002
max1317.142-1317.141=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1620.000=23.000
σ0.000
min1643.000-1620.000=23.000
max1643.000-1620.000=23.000
mean0.528-0.536=-0.007
σ0.530-0.546=-0.015
min0.257-0.258=-0.001
max1.324-1.354=-0.030
policies=20
mean1552.974-1552.978=-0.003
σ0.331-0.339=-0.008
min1552.747-1552.742=0.005
max1553.466-1553.481=-0.015
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1620.000=23.000
σ0.000
min1643.000-1620.000=23.000
max1643.000-1620.000=23.000
mean2.587-2.607=-0.020
σ0.020-0.013=0.006
min2.568-2.590=-0.021
max2.612-2.620=-0.009
policies=200
mean15538.016-15538.039=-0.022
σ0.090-0.111=-0.020
min15537.889-15537.933=-0.043
max15538.102-15538.194=-0.092
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1620.000=23.000
σ0.000
min1643.000-1620.000=23.000
max1643.000-1620.000=23.000
mean26.286-26.254=0.032
σ0.117-0.037=0.081
min26.191-26.209=-0.017
max26.451-26.290=0.161