Compare commits

Home / Compare 01ea7729 .. 48a663cf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.046-54.044=0.002
σ0.367-0.370=-0.003
min53.903-53.893=0.010
max55.090-55.096=-0.006
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.139-0.136=0.003
σ0.003-0.006=-0.003
min0.136-0.130=0.006
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.384-43.385=-0.001
σ0.006-0.006=-0.001
min43.376-43.374=0.001
max43.393-43.396=-0.002
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.122-0.123=-0.001
σ0.004-0.003=0.001
min0.117-0.120=-0.003
max0.129-0.129=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.976-1006.979=-0.002
σ0.892-0.878=0.014
min1006.507-1006.482=0.024
max1010.680-1010.612=0.068
mean1052.900-1051.300=1.600
σ320.013-310.712=9.301
min577.000-555.000=22.000
max1619.000-1650.000=-31.000
mean1.570-1.558=0.012
σ0.074-0.065=0.009
min1.497-1.458=0.038
max1.837-1.719=0.118

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.001
σ0.003-0.003=-0.000
min0.882
max0.887-0.888=-0.001
mean1619.000-1650.000=-31.000
σ0.000
min1619.000-1650.000=-31.000
max1619.000-1650.000=-31.000
mean0.451-0.421=0.030
σ0.190-0.143=0.047
min0.337-0.335=0.002
max0.789-0.676=0.113
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1619.000-1650.000=-31.000
σ0.000
min1619.000-1650.000=-31.000
max1619.000-1650.000=-31.000
mean0.901-0.887=0.014
σ0.146-0.094=0.052
min0.813-0.806=0.008
max1.162-1.046=0.116
name=heavy_item.art
mean1.524-1.524=-0.000
σ0.002-0.002=0.000
min1.522
max1.526-1.526=-0.000
mean1619.000-1650.000=-31.000
σ0.000
min1619.000-1650.000=-31.000
max1619.000-1650.000=-31.000
mean0.527-0.536=-0.010
σ0.055-0.043=0.012
min0.482-0.498=-0.017
max0.621-0.605=0.016
name=nested_use.art
mean2.361-2.361=-0.000
σ0.002-0.002=0.000
min2.360
max2.364
mean1619.000-1650.000=-31.000
σ0.000
min1619.000-1650.000=-31.000
max1619.000-1650.000=-31.000
mean0.840-0.863=-0.023
σ0.047-0.030=0.017
min0.796-0.835=-0.039
max0.918-0.911=0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.831=0.004
σ0.031-0.022=0.010
min964.802-964.810=-0.008
max964.886-964.865=0.020
mean1619.000-1650.000=-31.000
σ0.000
min1619.000-1650.000=-31.000
max1619.000-1650.000=-31.000
mean0.835-0.764=0.071
σ0.026-0.044=-0.018
min0.794-0.716=0.078
max0.856-0.809=0.047
name=cdr_enhanced_4k_loc.art
mean885.512-885.513=-0.000
σ0.005-0.006=-0.001
min885.504
max885.516-885.519=-0.003
mean1619.000-1650.000=-31.000
σ0.000
min1619.000-1650.000=-31.000
max1619.000-1650.000=-31.000
mean0.726-0.705=0.020
σ0.017-0.032=-0.015
min0.706-0.666=0.039
max0.746-0.741=0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1619.000-1650.000=-31.000
σ0.000
min1619.000-1650.000=-31.000
max1619.000-1650.000=-31.000
mean3.493-4.088=-0.594
σ0.080-0.331=-0.251
min3.334-3.436=-0.102
max3.799-4.605=-0.807
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1619.000-1650.000=-31.000
σ0.000
min1619.000-1650.000=-31.000
max1619.000-1650.000=-31.000
mean3.493-4.302=-0.809
σ0.073-0.096=-0.023
min3.339-4.102=-0.764
max3.752-4.642=-0.890
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1619.000-1650.000=-31.000
σ0.000
min1619.000-1650.000=-31.000
max1619.000-1650.000=-31.000
mean0.534-0.742=-0.208
σ0.015-0.020=-0.005
min0.507-0.714=-0.207
max0.630-0.873=-0.244
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1619.000-1650.000=-31.000
σ0.000
min1619.000-1650.000=-31.000
max1619.000-1650.000=-31.000
mean0.501-0.703=-0.202
σ0.011-0.016=-0.005
min0.475-0.675=-0.201
max0.556-0.771=-0.215

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.473-295.629=-0.157
σ0.225-0.230=-0.005
min295.268-295.391=-0.124
max296.080-296.229=-0.148
mean2032.000-1948.000=84.000
σ0.000
min2032.000-1948.000=84.000
max2032.000-1948.000=84.000
mean0.540-0.541=-0.001
σ0.033-0.044=-0.010
min0.500-0.497=0.003
max0.577-0.609=-0.033

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.414-285.407=0.007
σ0.035-0.035=-0.001
min285.367-285.361=0.007
max285.451-285.442=0.008
mean1619.000-1650.000=-31.000
σ0.000
min1619.000-1650.000=-31.000
max1619.000-1650.000=-31.000
mean0.386-0.386=0.001
σ0.005-0.007=-0.002
min0.381-0.381=-0.000
max0.392-0.398=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.797-1295.791=0.005
σ0.107-0.100=0.007
min1295.678-1295.674=0.004
max1295.920-1295.897=0.022
mean1619.000-1650.000=-31.000
σ0.000
min1619.000-1650.000=-31.000
max1619.000-1650.000=-31.000
mean1.915-1.920=-0.005
σ0.124-0.054=0.070
min1.818-1.869=-0.051
max2.065-2.001=0.065
iters=5
new-facts=6402
prior-facts=1
mean1539.935-1539.924=0.012
σ6.848-6.898=-0.050
min1536.675-1536.615=0.060
max1552.179-1552.256=-0.077
mean1619.000-1650.000=-31.000
σ0.000
min1619.000-1650.000=-31.000
max1619.000-1650.000=-31.000
mean2.294-2.331=-0.037
σ0.148-0.232=-0.083
min2.110-2.105=0.005
max2.471-2.716=-0.244
iters=5
new-facts=6402
prior-facts=6402
mean1857.706-1857.725=-0.019
σ0.053-0.068=-0.015
min1857.648-1857.641=0.007
max1857.777-1857.797=-0.020
mean1770.600-1795.000=-24.400
σ177.464-149.268=28.195
min1619.000-1650.000=-31.000
max2032.000-1948.000=84.000
mean3.091-3.223=-0.133
σ0.291-0.399=-0.108
min2.867-2.879=-0.012
max3.542-3.847=-0.306

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.328-1.336=-0.008
σ0.313-0.264=0.049
min1.104-1.105=-0.001
max1.866-1.791=0.075

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.741=0.000
σ580.934-580.934=0.000
min155.272-155.272=0.000
max1317.142-1317.142=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1619.000-1650.000=-31.000
σ0.000
min1619.000-1650.000=-31.000
max1619.000-1650.000=-31.000
mean0.535-0.541=-0.007
σ0.552-0.561=-0.009
min0.258-0.257=0.001
max1.362-1.382=-0.020
policies=20
mean1552.993-1552.988=0.006
σ0.337-0.344=-0.007
min1552.764-1552.758=0.006
max1553.494-1553.499=-0.005
mean920.000
σ0.000
min920.000
max920.000
mean1619.000-1650.000=-31.000
σ0.000
min1619.000-1650.000=-31.000
max1619.000-1650.000=-31.000
mean2.598-2.607=-0.009
σ0.019-0.037=-0.018
min2.582-2.570=0.012
max2.625-2.656=-0.031
policies=200
mean15538.039-15537.959=0.079
σ0.075-0.061=0.014
min15537.959-15537.875=0.084
max15538.129-15538.020=0.109
mean9200.000
σ0.000
min9200.000
max9200.000
mean1619.000-1650.000=-31.000
σ0.000
min1619.000-1650.000=-31.000
max1619.000-1650.000=-31.000
mean26.198-26.164=0.034
σ0.092-0.153=-0.061
min26.126-26.027=0.099
max26.331-26.380=-0.049