Compare commits

Home / Compare 32cec780 .. c863d6ed

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-54.014=0.002
σ0.369-0.368=0.001
min53.874-53.866=0.007
max55.065-55.060=0.005
mean415.000
σ0.000
min415.000
max415.000
mean0.141-0.138=0.003
σ0.004-0.004=0.000
min0.137-0.135=0.002
max0.148-0.144=0.004
cache=y
dps=1
iters=10
policies=100
mean43.322-43.321=0.001
σ0.008-0.006=0.002
min43.312-43.313=-0.002
max43.338-43.334=0.003
mean415.000
σ0.000
min415.000
max415.000
mean0.122-0.122=-0.000
σ0.004-0.004=-0.000
min0.118-0.118=0.000
max0.130-0.130=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.310-1006.309=0.001
σ1.175-1.182=-0.007
min1005.757-1005.765=-0.009
max1011.236-1011.267=-0.031
mean1046.750-1051.150=-4.400
σ313.149-303.691=9.458
min596.000-586.000=10.000
max1643.000-1640.000=3.000
mean1.542-1.561=-0.018
σ0.079-0.103=-0.024
min1.463-1.471=-0.008
max1.778-1.820=-0.042

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1643.000-1640.000=3.000
σ0.000
min1643.000-1640.000=3.000
max1643.000-1640.000=3.000
mean0.402-0.423=-0.020
σ0.129-0.140=-0.011
min0.321-0.330=-0.009
max0.632-0.670=-0.039
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1643.000-1640.000=3.000
σ0.000
min1643.000-1640.000=3.000
max1643.000-1640.000=3.000
mean0.881-0.916=-0.035
σ0.089-0.102=-0.014
min0.820-0.832=-0.013
max1.035-1.090=-0.055
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1643.000-1640.000=3.000
σ0.000
min1643.000-1640.000=3.000
max1643.000-1640.000=3.000
mean0.540-0.551=-0.011
σ0.046-0.056=-0.010
min0.502-0.493=0.008
max0.618-0.625=-0.007
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1643.000-1640.000=3.000
σ0.000
min1643.000-1640.000=3.000
max1643.000-1640.000=3.000
mean0.828-0.870=-0.042
σ0.042-0.062=-0.020
min0.787-0.827=-0.041
max0.894-0.979=-0.085

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113-964.113=-0.000
σ0.032-0.031=0.001
min964.086-964.088=-0.002
max964.165-964.164=0.001
mean1643.000-1640.000=3.000
σ0.000
min1643.000-1640.000=3.000
max1643.000-1640.000=3.000
mean0.843-0.811=0.032
σ0.019-0.030=-0.011
min0.812-0.783=0.029
max0.857-0.858=-0.001
name=cdr_enhanced_4k_loc.art
mean884.711-884.711=0.000
σ0.004-0.007=-0.003
min884.705-884.705=-0.000
max884.715-884.721=-0.006
mean1643.000-1640.000=3.000
σ0.000
min1643.000-1640.000=3.000
max1643.000-1640.000=3.000
mean0.706-0.710=-0.005
σ0.041-0.040=0.002
min0.659-0.642=0.017
max0.738-0.739=-0.000

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.721-7.718=0.004
mean1643.000-1640.000=3.000
σ0.000
min1643.000-1640.000=3.000
max1643.000-1640.000=3.000
mean4.243-4.214=0.029
σ0.094-0.081=0.013
min4.092-4.094=-0.002
max4.576-4.663=-0.087
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666-7.669=-0.003
mean1643.000-1640.000=3.000
σ0.000
min1643.000-1640.000=3.000
max1643.000-1640.000=3.000
mean4.224-4.196=0.029
σ0.079-0.060=0.019
min4.096-4.094=0.002
max4.511-4.476=0.035
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1643.000-1640.000=3.000
σ0.000
min1643.000-1640.000=3.000
max1643.000-1640.000=3.000
mean0.730-0.753=-0.022
σ0.018-0.044=-0.026
min0.698-0.714=-0.016
max0.851-1.062=-0.211
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1643.000-1640.000=3.000
σ0.000
min1643.000-1640.000=3.000
max1643.000-1640.000=3.000
mean0.694-0.705=-0.011
σ0.017-0.022=-0.005
min0.665-0.671=-0.006
max0.789-0.781=0.008

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.237-296.277=-0.040
σ0.198-0.279=-0.081
min296.000-295.980=0.021
max296.745-296.999=-0.254
mean1973.000-1902.000=71.000
σ0.000
min1973.000-1902.000=71.000
max1973.000-1902.000=71.000
mean0.588-0.568=0.020
σ0.051-0.043=0.007
min0.511-0.512=-0.001
max0.697-0.652=0.045

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.700-284.704=-0.004
σ0.029-0.027=0.003
min284.666-284.677=-0.012
max284.736-284.735=0.001
mean1643.000-1640.000=3.000
σ0.000
min1643.000-1640.000=3.000
max1643.000-1640.000=3.000
mean0.397-0.392=0.006
σ0.008-0.007=0.001
min0.387-0.384=0.003
max0.403-0.403=0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.057-1295.077=-0.020
σ0.080-0.105=-0.024
min1294.951-1294.960=-0.009
max1295.152-1295.206=-0.054
mean1643.000-1640.000=3.000
σ0.000
min1643.000-1640.000=3.000
max1643.000-1640.000=3.000
mean1.965-1.917=0.047
σ0.216-0.104=0.112
min1.805-1.808=-0.002
max2.322-2.037=0.285
iters=5
new-facts=6402
prior-facts=1
mean1539.186-1539.184=0.002
σ6.846-6.828=0.018
min1535.949-1535.950=-0.001
max1551.429-1551.395=0.034
mean1643.000-1640.000=3.000
σ0.000
min1643.000-1640.000=3.000
max1643.000-1640.000=3.000
mean2.308-2.213=0.095
σ0.265-0.180=0.085
min2.011-2.058=-0.048
max2.651-2.489=0.162
iters=5
new-facts=6402
prior-facts=6402
mean1856.998-1856.989=0.009
σ0.065-0.059=0.006
min1856.922-1856.932=-0.010
max1857.061-1857.076=-0.015
mean1799.400-1773.200=26.200
σ166.117-128.550=37.566
min1643.000-1640.000=3.000
max1973.000-1902.000=71.000
mean2.978-3.045=-0.067
σ0.182-0.272=-0.089
min2.831-2.827=0.004
max3.204-3.502=-0.298

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.256-1.197=0.059
σ0.324-0.289=0.034
min1.050-0.927=0.123
max1.808-1.672=0.136

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.783-447.784=-0.000
σ581.212-581.212=-0.000
min157.176-157.176=-0.000
max1319.602-1319.602=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1640.000=3.000
σ0.000
min1643.000-1640.000=3.000
max1643.000-1640.000=3.000
mean0.540-0.535=0.005
σ0.559-0.553=0.006
min0.258-0.257=0.001
max1.379-1.364=0.014
policies=20
mean1572.078-1572.089=-0.011
σ0.359-0.363=-0.004
min1571.834-1571.841=-0.007
max1572.611-1572.628=-0.017
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1640.000=3.000
σ0.000
min1643.000-1640.000=3.000
max1643.000-1640.000=3.000
mean2.622-2.628=-0.007
σ0.014-0.024=-0.010
min2.605-2.599=0.005
max2.635-2.658=-0.023
policies=200
mean15729.025-15729.009=0.016
σ0.163-0.167=-0.005
min15728.892-15728.823=0.069
max15729.253-15729.208=0.044
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1640.000=3.000
σ0.000
min1643.000-1640.000=3.000
max1643.000-1640.000=3.000
mean26.540-26.496=0.044
σ0.047-0.130=-0.083
min26.482-26.402=0.079
max26.588-26.688=-0.101