Compare commits

Home / Compare 6368e6d6 .. 85c53b34

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.015=-0.002
σ0.370-0.371=-0.001
min53.869-53.871=-0.002
max55.066-55.069=-0.003
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.138-0.140=-0.002
σ0.006-0.005=0.001
min0.130-0.137=-0.006
max0.147-0.147=0.000
cache=y
dps=1
iters=10
policies=100
mean43.323-43.321=0.003
σ0.006-0.006=-0.000
min43.310-43.311=-0.001
max43.334-43.331=0.003
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.126-0.119=0.007
σ0.007-0.005=0.002
min0.119-0.113=0.006
max0.143-0.129=0.014

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.307-1006.309=-0.003
σ1.186-1.169=0.017
min1005.773-1005.767=0.005
max1011.268-1011.199=0.069
mean1055.000-1052.950=2.050
σ318.715-303.416=15.299
min599.000-596.000=3.000
max1621.000-1451.000=170.000
mean1.559-1.574=-0.015
σ0.099-0.089=0.011
min1.346-1.485=-0.139
max1.797-1.768=0.030

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1621.000-1451.000=170.000
σ0.000
min1621.000-1451.000=170.000
max1621.000-1451.000=170.000
mean0.410-0.406=0.005
σ0.149-0.145=0.004
min0.318-0.313=0.004
max0.673-0.660=0.013
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1621.000-1451.000=170.000
σ0.000
min1621.000-1451.000=170.000
max1621.000-1451.000=170.000
mean0.915-0.889=0.027
σ0.102-0.095=0.008
min0.830-0.815=0.014
max1.061-1.054=0.007
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1621.000-1451.000=170.000
σ0.000
min1621.000-1451.000=170.000
max1621.000-1451.000=170.000
mean0.551-0.540=0.011
σ0.039-0.055=-0.016
min0.519-0.493=0.026
max0.614-0.631=-0.017
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1621.000-1451.000=170.000
σ0.000
min1621.000-1451.000=170.000
max1621.000-1451.000=170.000
mean0.845-0.851=-0.006
σ0.035-0.027=0.008
min0.811-0.821=-0.010
max0.898-0.894=0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.097=0.017
σ0.033-0.024=0.009
min964.086-964.077=0.009
max964.169-964.136=0.033
mean1621.000-1451.000=170.000
σ0.000
min1621.000-1451.000=170.000
max1621.000-1451.000=170.000
mean0.818-0.804=0.014
σ0.053-0.057=-0.004
min0.736-0.722=0.015
max0.858-0.855=0.004
name=cdr_enhanced_4k_loc.art
mean884.712-884.710=0.002
σ0.007-0.006=0.001
min884.705-884.703=0.001
max884.721-884.716=0.005
mean1621.000-1451.000=170.000
σ0.000
min1621.000-1451.000=170.000
max1621.000-1451.000=170.000
mean0.737-0.701=0.036
σ0.005-0.049=-0.044
min0.731-0.635=0.096
max0.744-0.739=0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.719-7.718=0.002
mean1621.000-1451.000=170.000
σ0.000
min1621.000-1451.000=170.000
max1621.000-1451.000=170.000
mean3.513-4.229=-0.716
σ0.080-0.080=-0.001
min3.388-4.094=-0.706
max3.935-4.523=-0.587
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666
mean1621.000-1451.000=170.000
σ0.000
min1621.000-1451.000=170.000
max1621.000-1451.000=170.000
mean3.538-4.247=-0.708
σ0.080-0.101=-0.021
min3.428-4.122=-0.694
max3.824-4.769=-0.945
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1621.000-1451.000=170.000
σ0.000
min1621.000-1451.000=170.000
max1621.000-1451.000=170.000
mean0.491-0.744=-0.253
σ0.085-0.044=0.041
min0.294-0.702=-0.408
max0.619-1.135=-0.516
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1621.000-1451.000=170.000
σ0.000
min1621.000-1451.000=170.000
max1621.000-1451.000=170.000
mean0.284-0.701=-0.417
σ0.007-0.014=-0.007
min0.264-0.670=-0.406
max0.319-0.764=-0.445

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.161-296.339=-0.179
σ0.237-0.196=0.041
min295.919-296.144=-0.225
max296.791-296.808=-0.017
mean1909.000-1906.000=3.000
σ0.000
min1909.000-1906.000=3.000
max1909.000-1906.000=3.000
mean0.566-0.596=-0.031
σ0.040-0.029=0.011
min0.507-0.559=-0.052
max0.607-0.664=-0.057

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.690-284.693=-0.003
σ0.034-0.038=-0.004
min284.644-284.643=0.001
max284.726-284.734=-0.008
mean1621.000-1451.000=170.000
σ0.000
min1621.000-1451.000=170.000
max1621.000-1451.000=170.000
mean0.392-0.396=-0.004
σ0.009-0.009=-0.000
min0.383-0.385=-0.001
max0.405-0.404=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.083-1295.088=-0.005
σ0.115-0.068=0.047
min1294.959-1295.005=-0.046
max1295.227-1295.157=0.070
mean1621.000-1451.000=170.000
σ0.000
min1621.000-1451.000=170.000
max1621.000-1451.000=170.000
mean1.899-2.067=-0.168
σ0.083-0.040=0.043
min1.810-2.018=-0.208
max2.008-2.106=-0.099
iters=5
new-facts=6402
prior-facts=1
mean1539.188-1539.317=-0.129
σ6.849-6.791=0.058
min1535.950-1536.140=-0.190
max1551.435-1551.462=-0.027
mean1621.000-1451.000=170.000
σ0.000
min1621.000-1451.000=170.000
max1621.000-1451.000=170.000
mean2.229-2.531=-0.302
σ0.228-0.219=0.009
min1.984-2.260=-0.276
max2.484-2.872=-0.388
iters=5
new-facts=6402
prior-facts=6402
mean1856.987-1856.984=0.003
σ0.051-0.066=-0.015
min1856.933-1856.900=0.033
max1857.065-1857.064=0.001
mean1773.200-1745.800=27.400
σ136.471-176.528=-40.058
min1621.000-1494.000=127.000
max1909.000-1906.000=3.000
mean3.008-3.112=-0.104
σ0.293-0.353=-0.060
min2.744-2.807=-0.063
max3.501-3.653=-0.152

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.260-1.731=-0.471
σ0.333-0.103=0.229
min0.937-1.558=-0.621
max1.786-1.835=-0.048

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.786=-0.001
σ581.212-581.212=0.000
min157.177-157.179=-0.002
max1319.604-1319.605=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1621.000-1451.000=170.000
σ0.000
min1621.000-1451.000=170.000
max1621.000-1451.000=170.000
mean0.546-0.551=-0.005
σ0.568-0.581=-0.013
min0.259-0.257=0.002
max1.398-1.423=-0.025
policies=20
mean1572.103-1572.094=0.009
σ0.354-0.345=0.009
min1571.861-1571.860=0.000
max1572.630-1572.608=0.022
mean920.000
σ0.000
min920.000
max920.000
mean1621.000-1451.000=170.000
σ0.000
min1621.000-1451.000=170.000
max1621.000-1451.000=170.000
mean2.632-2.612=0.020
σ0.025-0.017=0.008
min2.614-2.592=0.023
max2.667-2.627=0.040
policies=200
mean15728.973-15728.974=-0.001
σ0.081-0.130=-0.048
min15728.877-15728.839=0.037
max15729.070-15729.109=-0.039
mean9200.000
σ0.000
min9200.000
max9200.000
mean1621.000-1451.000=170.000
σ0.000
min1621.000-1451.000=170.000
max1621.000-1451.000=170.000
mean26.486-26.499=-0.012
σ0.031-0.062=-0.031
min26.459-26.449=0.010
max26.520-26.587=-0.067