Compare commits

Home / Compare 8d02983a .. 756c95b8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.044-54.045=-0.000
σ0.367-0.370=-0.002
min53.901-53.901=-0.001
max55.089-55.096=-0.007
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.140-0.138=0.002
σ0.006-0.004=0.001
min0.132-0.132=-0.001
max0.150-0.143=0.007
cache=y
dps=1
iters=10
policies=100
mean43.384-43.384=-0.000
σ0.005-0.006=-0.001
min43.378-43.374=0.004
max43.392-43.396=-0.004
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.121-0.123=-0.002
σ0.005-0.004=0.001
min0.115-0.120=-0.005
max0.129-0.129=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.983-1006.976=0.007
σ0.884-0.928=-0.044
min1006.481-1006.512=-0.031
max1010.639-1010.833=-0.194
mean1045.100-1051.350=-6.250
σ306.886-311.026=-4.139
min555.000
max1660.000-1650.000=10.000
mean1.551-1.569=-0.017
σ0.113-0.129=-0.017
min1.366-1.477=-0.111
max1.838-2.016=-0.179

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.000
σ0.003-0.002=0.000
min0.882
max0.887
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean0.437-0.465=-0.028
σ0.154-0.175=-0.020
min0.345-0.353=-0.009
max0.711-0.771=-0.060
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.003=-0.000
min2.337
max2.342-2.344=-0.001
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean0.902-0.926=-0.024
σ0.092-0.166=-0.074
min0.849-0.833=0.016
max1.066-1.221=-0.155
name=heavy_item.art
mean1.524-1.524=-0.000
σ0.002-0.002=-0.000
min1.522
max1.526-1.526=-0.000
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean0.538-0.539=-0.001
σ0.044-0.042=0.003
min0.505-0.504=0.001
max0.615-0.607=0.008
name=nested_use.art
mean2.361-2.361=-0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean0.849-0.848=0.001
σ0.043-0.038=0.005
min0.811-0.812=-0.002
max0.919-0.910=0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.836-964.832=0.004
σ0.031-0.027=0.004
min964.810-964.802=0.008
max964.890-964.869=0.021
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean0.822-0.848=-0.027
σ0.022-0.024=-0.002
min0.794-0.806=-0.012
max0.854-0.864=-0.009
name=cdr_enhanced_4k_loc.art
mean885.514-885.513=0.000
σ0.006-0.006=0.000
min885.504
max885.519-885.518=0.001
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean0.713-0.716=-0.004
σ0.044-0.042=0.002
min0.635-0.645=-0.011
max0.740-0.745=-0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.721=-0.000
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean4.295-3.816=0.479
σ0.097-0.340=-0.243
min4.114-3.454=0.660
max4.618-4.528=0.091
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean4.241-4.276=-0.035
σ0.077-0.100=-0.023
min4.080-4.093=-0.013
max4.474-4.694=-0.220
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean0.749-0.758=-0.008
σ0.018-0.018=-0.000
min0.717-0.729=-0.012
max0.858-0.877=-0.019
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean0.710-0.713=-0.003
σ0.014-0.017=-0.003
min0.683-0.682=0.001
max0.775-0.810=-0.035

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.564-295.519=0.045
σ0.230-0.193=0.037
min295.384-295.358=0.025
max296.197-296.044=0.153
mean1905.000-1934.000=-29.000
σ0.000
min1905.000-1934.000=-29.000
max1905.000-1934.000=-29.000
mean0.572-0.601=-0.029
σ0.055-0.047=0.008
min0.504-0.513=-0.009
max0.674-0.706=-0.032

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.410-285.412=-0.002
σ0.041-0.040=0.001
min285.360-285.360=0.000
max285.452-285.452=0.000
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean0.388-0.394=-0.006
σ0.007-0.005=0.002
min0.383-0.391=-0.008
max0.396-0.403=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.799-1295.794=0.006
σ0.118-0.106=0.011
min1295.667-1295.666=0.001
max1295.937-1295.909=0.028
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean1.954-1.953=0.002
σ0.086-0.057=0.029
min1.850-1.888=-0.038
max2.079-2.020=0.059
iters=5
new-facts=6402
prior-facts=1
mean1538.664-1538.646=0.018
σ3.978-4.010=-0.033
min1536.639-1536.623=0.016
max1545.769-1545.810=-0.041
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean2.314-2.263=0.051
σ0.211-0.113=0.098
min2.039-2.104=-0.065
max2.623-2.420=0.203
iters=5
new-facts=6402
prior-facts=6402
mean1857.695-1857.715=-0.020
σ0.051-0.065=-0.014
min1857.645-1857.640=0.005
max1857.774-1857.784=-0.010
mean1774.400-1787.800=-13.400
σ123.832-142.310=-18.478
min1660.000-1650.000=10.000
max1905.000-1934.000=-29.000
mean2.978-3.206=-0.228
σ0.093-0.300=-0.206
min2.905-2.898=0.007
max3.141-3.651=-0.510

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.329-1.349=-0.020
σ0.299-0.129=0.170
min1.122-1.260=-0.139
max1.845-1.575=0.269

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.059-444.058=0.000
σ577.573-577.575=-0.002
min155.271-155.270=0.002
max1310.419-1310.421=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean0.540-0.546=-0.006
σ0.553-0.569=-0.016
min0.261-0.260=0.001
max1.369-1.400=-0.031
policies=20
mean1552.973-1552.971=0.002
σ0.332-0.342=-0.010
min1552.748-1552.736=0.012
max1553.466-1553.479=-0.012
mean920.000
σ0.000
min920.000
max920.000
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean2.592-2.602=-0.009
σ0.022-0.030=-0.008
min2.560-2.560=0.001
max2.612-2.630=-0.017
policies=200
mean15538.035-15538.002=0.034
σ0.107-0.184=-0.078
min15537.904-15537.818=0.086
max15538.164-15538.239=-0.075
mean9200.000
σ0.000
min9200.000
max9200.000
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean26.212-26.161=0.051
σ0.065-0.087=-0.022
min26.141-26.094=0.047
max26.299-26.289=0.010