Compare commits

Home / Compare e7116f59 .. 31a5979a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.015=0.000
σ0.370-0.369=0.001
min53.866-53.867=-0.001
max55.067-55.064=0.003
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.140-0.139=0.001
σ0.004-0.003=0.001
min0.136-0.136=0.000
max0.148-0.145=0.004
cache=y
dps=1
iters=10
policies=100
mean43.323-43.323=0.000
σ0.007-0.007=0.000
min43.310-43.313=-0.004
max43.334-43.335=-0.001
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.121-0.124=-0.003
σ0.003-0.004=-0.001
min0.117-0.120=-0.003
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.307-1006.305=0.003
σ1.172-1.198=-0.027
min1005.767-1005.771=-0.004
max1011.217-1011.336=-0.119
mean1045.850-1047.550=-1.700
σ313.861-305.266=8.595
min577.000-587.000=-10.000
max1643.000-1638.000=5.000
mean1.557-1.558=-0.001
σ0.096-0.070=0.025
min1.485-1.492=-0.008
max1.819-1.746=0.073

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.404-0.396=0.008
σ0.130-0.103=0.027
min0.327-0.337=-0.010
max0.631-0.578=0.054
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.897-0.893=0.004
σ0.110-0.086=0.024
min0.815-0.837=-0.022
max1.088-1.045=0.043
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.562-0.545=0.017
σ0.069-0.047=0.022
min0.490-0.504=-0.013
max0.654-0.621=0.034
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.836-0.849=-0.013
σ0.041-0.036=0.004
min0.806-0.825=-0.019
max0.902-0.912=-0.010

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.114=0.000
σ0.034-0.032=0.002
min964.086-964.087=-0.001
max964.170-964.167=0.004
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.809-0.838=-0.029
σ0.051-0.027=0.024
min0.730-0.791=-0.061
max0.855-0.858=-0.003
name=cdr_enhanced_4k_loc.art
mean884.711-884.711=-0.000
σ0.007-0.007=0.001
min884.703-884.705=-0.001
max884.721-884.721=0.001
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.705-0.706=-0.001
σ0.033-0.042=-0.009
min0.669-0.663=0.006
max0.737-0.759=-0.022

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.719-7.722=-0.003
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean3.519-4.246=-0.727
σ0.076-0.090=-0.013
min3.360-4.117=-0.758
max3.796-4.611=-0.816
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.666
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean3.512-4.244=-0.732
σ0.064-0.077=-0.013
min3.227-4.132=-0.905
max3.791-4.525=-0.734
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.569-0.743=-0.173
σ0.091-0.027=0.064
min0.510-0.533=-0.023
max0.844-0.824=0.020
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.507-0.698=-0.191
σ0.020-0.014=0.006
min0.482-0.670=-0.188
max0.628-0.784=-0.156

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.013-296.273=-0.259
σ0.210-0.220=-0.010
min295.762-296.125=-0.363
max296.473-296.875=-0.403
mean1912.000-1907.000=5.000
σ0.000
min1912.000-1907.000=5.000
max1912.000-1907.000=5.000
mean0.593-0.597=-0.004
σ0.047-0.024=0.023
min0.538-0.563=-0.025
max0.713-0.654=0.059

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.695-284.697=-0.002
σ0.038-0.035=0.003
min284.648-284.656=-0.008
max284.739-284.738=0.001
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.396-0.396=-0.001
σ0.011-0.011=0.000
min0.384-0.384=-0.000
max0.406-0.405=0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.081-1295.080=0.001
σ0.112-0.109=0.004
min1294.955-1294.961=-0.006
max1295.216-1295.214=0.002
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean1.914-1.909=0.005
σ0.096-0.083=0.014
min1.809-1.816=-0.007
max2.008-2.002=0.006
iters=5
new-facts=6402
prior-facts=1
mean1539.184-1539.190=-0.006
σ6.836-6.865=-0.029
min1535.941-1535.936=0.005
max1551.408-1551.466=-0.057
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean2.223-2.274=-0.051
σ0.190-0.247=-0.057
min2.042-2.027=0.015
max2.494-2.542=-0.047
iters=5
new-facts=6402
prior-facts=6402
mean1856.986-1856.991=-0.005
σ0.057-0.056=0.000
min1856.932-1856.925=0.006
max1857.069-1857.067=0.003
mean1772.000-1775.200=-3.200
σ135.061-131.336=3.725
min1643.000-1638.000=5.000
max1912.000-1907.000=5.000
mean3.009-3.093=-0.084
σ0.240-0.423=-0.183
min2.686-2.763=-0.077
max3.355-3.826=-0.471

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.228-1.241=-0.014
σ0.340-0.326=0.015
min0.926-0.931=-0.005
max1.798-1.717=0.080

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.786=-0.001
σ581.213-581.212=0.000
min157.176-157.178=-0.002
max1319.605-1319.605=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.542-0.540=0.002
σ0.555-0.556=-0.001
min0.261-0.259=0.002
max1.375-1.374=0.001
policies=20
mean1572.099-1572.088=0.011
σ0.351-0.342=0.009
min1571.863-1571.867=-0.004
max1572.621-1572.598=0.024
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean2.625-2.627=-0.002
σ0.017-0.022=-0.004
min2.613-2.611=0.002
max2.650-2.658=-0.008
policies=200
mean15728.998-15728.995=0.004
σ0.131-0.189=-0.057
min15728.884-15728.834=0.050
max15729.166-15729.260=-0.094
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean26.456-26.452=0.005
σ0.062-0.011=0.052
min26.400-26.440=-0.040
max26.545-26.465=0.080