Compare commits

Home / Compare 4c524fc4 .. d1357267

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.013=0.001
σ0.369-0.367=0.001
min53.867-53.874=-0.007
max55.062-55.057=0.005
mean414.700-413.000=1.700
σ0.483-0.000=0.483
min414.000-413.000=1.000
max415.000-413.000=2.000
mean0.140-0.137=0.002
σ0.004-0.003=0.000
min0.136-0.134=0.002
max0.146-0.144=0.002
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.000
σ0.006-0.007=-0.001
min43.313-43.315=-0.002
max43.332-43.334=-0.002
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.117-0.120=-0.003
σ0.003-0.004=-0.001
min0.114-0.115=-0.001
max0.121-0.128=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.305-1006.305=0.000
σ1.170-1.194=-0.023
min1005.769-1005.770=-0.001
max1011.208-1011.304=-0.097
mean1054.200-1035.800=18.400
σ303.029-310.381=-7.352
min595.000-545.000=50.000
max1451.000-1503.000=-52.000
mean1.556-1.556=0.000
σ0.080-0.084=-0.004
min1.484-1.461=0.023
max1.747-1.772=-0.025

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1451.000-1503.000=-52.000
σ0.000
min1451.000-1503.000=-52.000
max1451.000-1503.000=-52.000
mean0.413-0.411=0.002
σ0.125-0.117=0.008
min0.340-0.342=-0.003
max0.635-0.617=0.018
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1451.000-1503.000=-52.000
σ0.000
min1451.000-1503.000=-52.000
max1451.000-1503.000=-52.000
mean0.907-0.884=0.023
σ0.113-0.091=0.022
min0.839-0.821=0.018
max1.105-1.041=0.064
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1451.000-1503.000=-52.000
σ0.000
min1451.000-1503.000=-52.000
max1451.000-1503.000=-52.000
mean0.541-0.539=0.002
σ0.062-0.056=0.006
min0.484-0.493=-0.009
max0.647-0.635=0.012
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1451.000-1503.000=-52.000
σ0.000
min1451.000-1503.000=-52.000
max1451.000-1503.000=-52.000
mean0.837-0.848=-0.011
σ0.030-0.036=-0.006
min0.814-0.816=-0.002
max0.889-0.908=-0.019

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.097-964.102=-0.005
σ0.025-0.034=-0.009
min964.077
max964.138-964.163=-0.025
mean1451.000-1503.000=-52.000
σ0.000
min1451.000-1503.000=-52.000
max1451.000-1503.000=-52.000
mean0.829-0.823=0.006
σ0.023-0.026=-0.003
min0.798-0.789=0.009
max0.853-0.851=0.002
name=cdr_enhanced_4k_loc.art
mean884.710-884.710=0.000
σ0.006-0.006=-0.000
min884.703
max884.716-884.717=-0.000
mean1451.000-1503.000=-52.000
σ0.000
min1451.000-1503.000=-52.000
max1451.000-1503.000=-52.000
mean0.724-0.700=0.023
σ0.037-0.048=-0.011
min0.659-0.633=0.026
max0.750-0.745=0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.719-7.720=-0.001
mean1451.000-1503.000=-52.000
σ0.000
min1451.000-1503.000=-52.000
max1451.000-1503.000=-52.000
mean4.247-3.679=0.568
σ0.094-0.323=-0.230
min4.088-3.361=0.727
max4.587-4.531=0.056
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1451.000-1503.000=-52.000
σ0.000
min1451.000-1503.000=-52.000
max1451.000-1503.000=-52.000
mean4.228-4.241=-0.013
σ0.073-0.094=-0.021
min4.072-4.091=-0.019
max4.464-4.521=-0.057
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1451.000-1503.000=-52.000
σ0.000
min1451.000-1503.000=-52.000
max1451.000-1503.000=-52.000
mean0.729-0.726=0.003
σ0.019-0.015=0.004
min0.697-0.697=-0.000
max0.859-0.823=0.036
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1451.000-1503.000=-52.000
σ0.000
min1451.000-1503.000=-52.000
max1451.000-1503.000=-52.000
mean0.694-0.694=0.000
σ0.025-0.014=0.011
min0.497-0.667=-0.170
max0.779-0.777=0.003

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.304-296.267=0.037
σ0.230-0.157=0.072
min296.136-296.116=0.020
max296.936-296.657=0.278
mean1908.000-1955.000=-47.000
σ0.000
min1908.000-1955.000=-47.000
max1908.000-1955.000=-47.000
mean0.576-0.574=0.001
σ0.048-0.037=0.011
min0.514-0.525=-0.012
max0.677-0.646=0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.697-284.694=0.002
σ0.035-0.045=-0.010
min284.652-284.630=0.022
max284.739-284.741=-0.002
mean1451.000-1503.000=-52.000
σ0.000
min1451.000-1503.000=-52.000
max1451.000-1503.000=-52.000
mean0.397-0.387=0.010
σ0.010-0.018=-0.009
min0.386-0.358=0.028
max0.405-0.403=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.089-1295.107=-0.018
σ0.064-0.098=-0.033
min1295.011-1294.997=0.014
max1295.170-1295.244=-0.074
mean1451.000-1503.000=-52.000
σ0.000
min1451.000-1503.000=-52.000
max1451.000-1503.000=-52.000
mean2.067-2.113=-0.046
σ0.053-0.088=-0.035
min2.005-2.009=-0.004
max2.140-2.199=-0.059
iters=5
new-facts=6402
prior-facts=1
mean1539.174-1539.257=-0.083
σ6.859-6.794=0.065
min1535.937-1536.111=-0.174
max1551.439-1551.409=0.031
mean1451.000-1503.000=-52.000
σ0.000
min1451.000-1503.000=-52.000
max1451.000-1503.000=-52.000
mean2.206-2.448=-0.242
σ0.170-0.172=-0.003
min1.969-2.264=-0.294
max2.377-2.661=-0.285
iters=5
new-facts=6402
prior-facts=6402
mean1856.980-1856.986=-0.006
σ0.080-0.065=0.015
min1856.865-1856.912=-0.047
max1857.067-1857.062=0.005
mean1746.800-1758.000=-11.200
σ175.252-203.463=-28.211
min1498.000-1503.000=-5.000
max1908.000-1955.000=-47.000
mean3.126-2.967=0.160
σ0.253-0.169=0.084
min2.856-2.777=0.079
max3.497-3.205=0.292

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.757-1.653=0.104
σ0.091-0.239=-0.148
min1.609-1.267=0.342
max1.851-1.876=-0.025

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.783=0.002
σ581.213-581.212=0.001
min157.176-157.176=-0.000
max1319.605-1319.602=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1451.000-1503.000=-52.000
σ0.000
min1451.000-1503.000=-52.000
max1451.000-1503.000=-52.000
mean0.550-0.557=-0.008
σ0.579-0.591=-0.012
min0.259-0.260=-0.001
max1.418-1.444=-0.025
policies=20
mean1572.099-1572.081=0.018
σ0.355-0.355=-0.000
min1571.857-1571.834=0.023
max1572.626-1572.607=0.019
mean920.000
σ0.000
min920.000
max920.000
mean1451.000-1503.000=-52.000
σ0.000
min1451.000-1503.000=-52.000
max1451.000-1503.000=-52.000
mean2.623-2.625=-0.002
σ0.015-0.026=-0.011
min2.607-2.608=-0.001
max2.640-2.663=-0.023
policies=200
mean15729.041-15729.019=0.022
σ0.020-0.164=-0.144
min15729.015-15728.867=0.148
max15729.063-15729.233=-0.170
mean9200.000
σ0.000
min9200.000
max9200.000
mean1451.000-1503.000=-52.000
σ0.000
min1451.000-1503.000=-52.000
max1451.000-1503.000=-52.000
mean26.519-26.563=-0.043
σ0.049-0.075=-0.026
min26.461-26.475=-0.014
max26.564-26.634=-0.070