Compare commits

Home / Compare 48a1edf4 .. 21b76c08

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.014=0.001
σ0.370-0.369=0.001
min53.866-53.869=-0.003
max55.067-55.064=0.003
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.140-0.137=0.003
σ0.004-0.006=-0.001
min0.136-0.129=0.007
max0.148-0.146=0.002
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.001
σ0.007-0.008=-0.000
min43.310-43.308=0.002
max43.334-43.334=0.000
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.121-0.117=0.004
σ0.003-0.003=-0.000
min0.117-0.114=0.003
max0.128-0.125=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.307-1006.309=-0.001
σ1.172-1.155=0.017
min1005.767-1005.747=0.020
max1011.217-1011.135=0.081
mean1045.850-1043.750=2.100
σ313.861-311.503=2.357
min577.000-595.000=-18.000
max1643.000-1633.000=10.000
mean1.557-1.553=0.005
σ0.096-0.090=0.006
min1.485-1.458=0.027
max1.819-1.809=0.010

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1643.000-1633.000=10.000
σ0.000
min1643.000-1633.000=10.000
max1643.000-1633.000=10.000
mean0.404-0.421=-0.016
σ0.130-0.157=-0.028
min0.327-0.331=-0.004
max0.631-0.701=-0.070
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1643.000-1633.000=10.000
σ0.000
min1643.000-1633.000=10.000
max1643.000-1633.000=10.000
mean0.897-0.934=-0.037
σ0.110-0.185=-0.074
min0.815-0.823=-0.008
max1.088-1.262=-0.173
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1643.000-1633.000=10.000
σ0.000
min1643.000-1633.000=10.000
max1643.000-1633.000=10.000
mean0.562-0.578=-0.015
σ0.069-0.061=0.008
min0.490-0.526=-0.036
max0.654-0.657=-0.002
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1643.000-1633.000=10.000
σ0.000
min1643.000-1633.000=10.000
max1643.000-1633.000=10.000
mean0.836-0.847=-0.011
σ0.041-0.046=-0.006
min0.806-0.806=-0.000
max0.902-0.924=-0.021

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.113=0.001
σ0.034-0.029=0.005
min964.086-964.088=-0.001
max964.170-964.158=0.012
mean1643.000-1633.000=10.000
σ0.000
min1643.000-1633.000=10.000
max1643.000-1633.000=10.000
mean0.809-0.838=-0.029
σ0.051-0.028=0.024
min0.730-0.803=-0.074
max0.855-0.864=-0.010
name=cdr_enhanced_4k_loc.art
mean884.711-884.712=-0.001
σ0.007-0.008=-0.000
min884.703
max884.721-884.722=-0.001
mean1643.000-1633.000=10.000
σ0.000
min1643.000-1633.000=10.000
max1643.000-1633.000=10.000
mean0.705-0.709=-0.004
σ0.033-0.055=-0.023
min0.669-0.610=0.059
max0.737-0.738=-0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.719-7.721=-0.002
mean1643.000-1633.000=10.000
σ0.000
min1643.000-1633.000=10.000
max1643.000-1633.000=10.000
mean3.519-4.223=-0.704
σ0.076-0.146=-0.070
min3.360-4.037=-0.677
max3.796-5.368=-1.573
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.666
mean1643.000-1633.000=10.000
σ0.000
min1643.000-1633.000=10.000
max1643.000-1633.000=10.000
mean3.512-4.161=-0.649
σ0.064-0.073=-0.009
min3.227-4.041=-0.814
max3.791-4.472=-0.681
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1643.000-1633.000=10.000
σ0.000
min1643.000-1633.000=10.000
max1643.000-1633.000=10.000
mean0.569-0.614=-0.044
σ0.091-0.108=-0.016
min0.510-0.501=0.009
max0.844-0.838=0.006
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1643.000-1633.000=10.000
σ0.000
min1643.000-1633.000=10.000
max1643.000-1633.000=10.000
mean0.507-0.446=0.061
σ0.020-0.099=-0.079
min0.482-0.274=0.208
max0.628-0.569=0.059

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.013-296.443=-0.430
σ0.210-0.213=-0.003
min295.762-296.287=-0.525
max296.473-297.023=-0.550
mean1912.000-1909.000=3.000
σ0.000
min1912.000-1909.000=3.000
max1912.000-1909.000=3.000
mean0.593-0.578=0.015
σ0.047-0.056=-0.010
min0.538-0.490=0.048
max0.713-0.686=0.027

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.695-284.698=-0.004
σ0.038-0.025=0.013
min284.648-284.668=-0.020
max284.739-284.728=0.011
mean1643.000-1633.000=10.000
σ0.000
min1643.000-1633.000=10.000
max1643.000-1633.000=10.000
mean0.396-0.397=-0.002
σ0.011-0.010=0.001
min0.384-0.386=-0.002
max0.406-0.406=0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.081-1295.079=0.001
σ0.112-0.111=0.001
min1294.955-1294.954=0.001
max1295.216-1295.218=-0.002
mean1643.000-1633.000=10.000
σ0.000
min1643.000-1633.000=10.000
max1643.000-1633.000=10.000
mean1.914-1.890=0.024
σ0.096-0.089=0.007
min1.809-1.807=0.002
max2.008-2.021=-0.013
iters=5
new-facts=6402
prior-facts=1
mean1539.184-1539.184=0.000
σ6.836-6.849=-0.014
min1535.941-1535.886=0.055
max1551.408-1551.432=-0.023
mean1643.000-1633.000=10.000
σ0.000
min1643.000-1633.000=10.000
max1643.000-1633.000=10.000
mean2.223-2.270=-0.047
σ0.190-0.233=-0.043
min2.042-2.033=0.010
max2.494-2.617=-0.123
iters=5
new-facts=6402
prior-facts=6402
mean1856.986-1856.987=-0.001
σ0.057-0.056=0.001
min1856.932-1856.932=-0.001
max1857.069-1857.067=0.002
mean1772.000-1779.000=-7.000
σ135.061-133.617=1.444
min1643.000-1633.000=10.000
max1912.000-1909.000=3.000
mean3.009-3.144=-0.135
σ0.240-0.367=-0.127
min2.686-2.857=-0.171
max3.355-3.775=-0.421

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.228-1.191=0.036
σ0.340-0.268=0.072
min0.926-0.928=-0.002
max1.798-1.582=0.215

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.784=0.002
σ581.213-581.212=0.000
min157.176-157.177=-0.001
max1319.605-1319.603=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1633.000=10.000
σ0.000
min1643.000-1633.000=10.000
max1643.000-1633.000=10.000
mean0.542-0.536=0.006
σ0.555-0.554=0.001
min0.261-0.258=0.003
max1.375-1.367=0.008
policies=20
mean1572.099-1572.089=0.010
σ0.351-0.357=-0.006
min1571.863-1571.850=0.013
max1572.621-1572.620=0.001
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1633.000=10.000
σ0.000
min1643.000-1633.000=10.000
max1643.000-1633.000=10.000
mean2.625-2.628=-0.003
σ0.017-0.023=-0.006
min2.613-2.601=0.012
max2.650-2.658=-0.008
policies=200
mean15728.998-15728.964=0.034
σ0.131-0.106=0.025
min15728.884-15728.812=0.072
max15729.166-15729.053=0.113
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1633.000=10.000
σ0.000
min1643.000-1633.000=10.000
max1643.000-1633.000=10.000
mean26.456-26.568=-0.112
σ0.062-0.102=-0.040
min26.400-26.492=-0.092
max26.545-26.708=-0.163