Compare commits

Home / Compare 9936543e .. b57fbbb4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.013-54.014=-0.001
σ0.367-0.368=-0.000
min53.874-53.866=0.008
max55.057-55.060=-0.002
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.137-0.138=-0.001
σ0.003-0.004=-0.001
min0.134-0.135=-0.000
max0.144-0.144=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.322-43.321=0.001
σ0.007-0.006=0.001
min43.315-43.313=0.001
max43.334-43.334=0.000
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.120-0.122=-0.002
σ0.004-0.004=-0.000
min0.115-0.118=-0.003
max0.128-0.130=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.305-1006.309=-0.004
σ1.194-1.182=0.011
min1005.770-1005.765=0.005
max1011.304-1011.267=0.037
mean1035.800-1051.150=-15.350
σ310.381-303.691=6.690
min545.000-586.000=-41.000
max1503.000-1640.000=-137.000
mean1.556-1.561=-0.005
σ0.084-0.103=-0.019
min1.461-1.471=-0.010
max1.772-1.820=-0.048

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1503.000-1640.000=-137.000
σ0.000
min1503.000-1640.000=-137.000
max1503.000-1640.000=-137.000
mean0.411-0.423=-0.012
σ0.117-0.140=-0.023
min0.342-0.330=0.012
max0.617-0.670=-0.054
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1503.000-1640.000=-137.000
σ0.000
min1503.000-1640.000=-137.000
max1503.000-1640.000=-137.000
mean0.884-0.916=-0.032
σ0.091-0.102=-0.012
min0.821-0.832=-0.012
max1.041-1.090=-0.049
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1503.000-1640.000=-137.000
σ0.000
min1503.000-1640.000=-137.000
max1503.000-1640.000=-137.000
mean0.539-0.551=-0.012
σ0.056-0.056=0.000
min0.493-0.493=-0.000
max0.635-0.625=0.009
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1503.000-1640.000=-137.000
σ0.000
min1503.000-1640.000=-137.000
max1503.000-1640.000=-137.000
mean0.848-0.870=-0.022
σ0.036-0.062=-0.026
min0.816-0.827=-0.011
max0.908-0.979=-0.071

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.102-964.113=-0.011
σ0.034-0.031=0.004
min964.077-964.088=-0.011
max964.163-964.164=-0.002
mean1503.000-1640.000=-137.000
σ0.000
min1503.000-1640.000=-137.000
max1503.000-1640.000=-137.000
mean0.823-0.811=0.012
σ0.026-0.030=-0.004
min0.789-0.783=0.006
max0.851-0.858=-0.007
name=cdr_enhanced_4k_loc.art
mean884.710-884.711=-0.001
σ0.006-0.007=-0.001
min884.703-884.705=-0.001
max884.717-884.721=-0.004
mean1503.000-1640.000=-137.000
σ0.000
min1503.000-1640.000=-137.000
max1503.000-1640.000=-137.000
mean0.700-0.710=-0.010
σ0.048-0.040=0.009
min0.633-0.642=-0.009
max0.745-0.739=0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.720-7.718=0.003
mean1503.000-1640.000=-137.000
σ0.000
min1503.000-1640.000=-137.000
max1503.000-1640.000=-137.000
mean3.679-4.214=-0.535
σ0.323-0.081=0.242
min3.361-4.094=-0.734
max4.531-4.663=-0.132
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666-7.669=-0.003
mean1503.000-1640.000=-137.000
σ0.000
min1503.000-1640.000=-137.000
max1503.000-1640.000=-137.000
mean4.241-4.196=0.045
σ0.094-0.060=0.034
min4.091-4.094=-0.004
max4.521-4.476=0.045
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1503.000-1640.000=-137.000
σ0.000
min1503.000-1640.000=-137.000
max1503.000-1640.000=-137.000
mean0.726-0.753=-0.026
σ0.015-0.044=-0.029
min0.697-0.714=-0.017
max0.823-1.062=-0.239
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1503.000-1640.000=-137.000
σ0.000
min1503.000-1640.000=-137.000
max1503.000-1640.000=-137.000
mean0.694-0.705=-0.012
σ0.014-0.022=-0.007
min0.667-0.671=-0.004
max0.777-0.781=-0.004

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.267-296.277=-0.010
σ0.157-0.279=-0.122
min296.116-295.980=0.136
max296.657-296.999=-0.341
mean1955.000-1902.000=53.000
σ0.000
min1955.000-1902.000=53.000
max1955.000-1902.000=53.000
mean0.574-0.568=0.006
σ0.037-0.043=-0.007
min0.525-0.512=0.014
max0.646-0.652=-0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.694-284.704=-0.010
σ0.045-0.027=0.019
min284.630-284.677=-0.048
max284.741-284.735=0.005
mean1503.000-1640.000=-137.000
σ0.000
min1503.000-1640.000=-137.000
max1503.000-1640.000=-137.000
mean0.387-0.392=-0.005
σ0.018-0.007=0.011
min0.358-0.384=-0.026
max0.403-0.403=0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.107-1295.077=0.030
σ0.098-0.105=-0.007
min1294.997-1294.960=0.037
max1295.244-1295.206=0.038
mean1503.000-1640.000=-137.000
σ0.000
min1503.000-1640.000=-137.000
max1503.000-1640.000=-137.000
mean2.113-1.917=0.196
σ0.088-0.104=-0.016
min2.009-1.808=0.201
max2.199-2.037=0.162
iters=5
new-facts=6402
prior-facts=1
mean1539.257-1539.184=0.073
σ6.794-6.828=-0.034
min1536.111-1535.950=0.161
max1551.409-1551.395=0.014
mean1503.000-1640.000=-137.000
σ0.000
min1503.000-1640.000=-137.000
max1503.000-1640.000=-137.000
mean2.448-2.213=0.236
σ0.172-0.180=-0.007
min2.264-2.058=0.205
max2.661-2.489=0.173
iters=5
new-facts=6402
prior-facts=6402
mean1856.986-1856.989=-0.003
σ0.065-0.059=0.006
min1856.912-1856.932=-0.020
max1857.062-1857.076=-0.014
mean1758.000-1773.200=-15.200
σ203.463-128.550=74.912
min1503.000-1640.000=-137.000
max1955.000-1902.000=53.000
mean2.967-3.045=-0.079
σ0.169-0.272=-0.103
min2.777-2.827=-0.050
max3.205-3.502=-0.298

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.653-1.197=0.456
σ0.239-0.289=-0.050
min1.267-0.927=0.340
max1.876-1.672=0.204

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.783-447.784=-0.000
σ581.212-581.212=-0.000
min157.176-157.176=0.000
max1319.602-1319.602=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1503.000-1640.000=-137.000
σ0.000
min1503.000-1640.000=-137.000
max1503.000-1640.000=-137.000
mean0.557-0.535=0.022
σ0.591-0.553=0.038
min0.260-0.257=0.003
max1.444-1.364=0.079
policies=20
mean1572.081-1572.089=-0.008
σ0.355-0.363=-0.008
min1571.834-1571.841=-0.007
max1572.607-1572.628=-0.021
mean920.000
σ0.000
min920.000
max920.000
mean1503.000-1640.000=-137.000
σ0.000
min1503.000-1640.000=-137.000
max1503.000-1640.000=-137.000
mean2.625-2.628=-0.003
σ0.026-0.024=0.002
min2.608-2.599=0.009
max2.663-2.658=0.006
policies=200
mean15729.019-15729.009=0.010
σ0.164-0.167=-0.004
min15728.867-15728.823=0.044
max15729.233-15729.208=0.025
mean9200.000
σ0.000
min9200.000
max9200.000
mean1503.000-1640.000=-137.000
σ0.000
min1503.000-1640.000=-137.000
max1503.000-1640.000=-137.000
mean26.563-26.496=0.067
σ0.075-0.130=-0.055
min26.475-26.402=0.072
max26.634-26.688=-0.055