Compare commits

Home / Compare 0388faf2 .. c206ea68

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.704-53.703=0.001
σ0.366-0.368=-0.001
min53.563-53.560=0.003
max54.745-54.748=-0.003
mean416.000-415.700=0.300
σ0.000-0.483=-0.483
min416.000-415.000=1.000
max416.000
mean0.138-0.138=0.001
σ0.003-0.004=-0.001
min0.135-0.131=0.004
max0.143-0.145=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.059-43.060=-0.001
σ0.005-0.006=-0.001
min43.053-43.053=0.000
max43.066-43.069=-0.003
mean416.000
σ0.000
min416.000
max416.000
mean0.120-0.123=-0.003
σ0.004-0.005=-0.002
min0.113-0.118=-0.004
max0.125-0.135=-0.010

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.104-1005.105=-0.001
σ0.895-0.899=-0.004
min1004.636-1004.644=-0.008
max1008.821-1008.839=-0.017
mean1055.500-1051.450=4.050
σ321.217-310.308=10.908
min554.000-561.000=-7.000
max1634.000-1649.000=-15.000
mean1.652-1.626=0.025
σ0.093-0.055=0.038
min1.578-1.551=0.027
max1.907-1.738=0.169

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.002-0.002=0.000
min0.881
max0.886
mean1634.000-1649.000=-15.000
σ0.000
min1634.000-1649.000=-15.000
max1634.000-1649.000=-15.000
mean0.411-0.418=-0.008
σ0.135-0.135=-0.000
min0.326-0.335=-0.010
max0.649-0.659=-0.010
name=error_case.art
mean2.333-2.335=-0.001
σ0.003-0.002=0.001
min2.332-2.333=-0.001
max2.337
mean1634.000-1649.000=-15.000
σ0.000
min1634.000-1649.000=-15.000
max1634.000-1649.000=-15.000
mean0.881-0.878=0.003
σ0.108-0.103=0.005
min0.803-0.816=-0.013
max1.063-1.054=0.009
name=heavy_item.art
mean1.521-1.521=0.000
σ0.002-0.001=0.001
min1.520
max1.524-1.523=0.001
mean1634.000-1649.000=-15.000
σ0.000
min1634.000-1649.000=-15.000
max1634.000-1649.000=-15.000
mean0.540-0.540=0.000
σ0.049-0.050=-0.001
min0.496-0.505=-0.009
max0.618-0.627=-0.009
name=nested_use.art
mean2.355-2.356=-0.001
σ0.002-0.003=-0.001
min2.355
max2.358-2.360=-0.001
mean1634.000-1649.000=-15.000
σ0.000
min1634.000-1649.000=-15.000
max1634.000-1649.000=-15.000
mean0.846-0.838=0.008
σ0.038-0.038=0.000
min0.812-0.813=-0.000
max0.912-0.905=0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.553-963.554=-0.001
σ0.031-0.027=0.005
min963.528-963.531=-0.003
max963.607-963.595=0.012
mean1634.000-1649.000=-15.000
σ0.000
min1634.000-1649.000=-15.000
max1634.000-1649.000=-15.000
mean0.846-0.843=0.003
σ0.029-0.020=0.009
min0.795-0.820=-0.025
max0.867-0.862=0.005
name=cdr_enhanced_4k_loc.art
mean884.856-884.857=-0.001
σ0.008-0.004=0.003
min884.848-884.851=-0.002
max884.867-884.861=0.006
mean1634.000-1649.000=-15.000
σ0.000
min1634.000-1649.000=-15.000
max1634.000-1649.000=-15.000
mean0.749-0.728=0.022
σ0.004-0.028=-0.025
min0.746-0.681=0.065
max0.755-0.748=0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.709-7.710=-0.000
mean1634.000-1649.000=-15.000
σ0.000
min1634.000-1649.000=-15.000
max1634.000-1649.000=-15.000
mean3.814-4.250=-0.436
σ0.379-0.075=0.304
min3.388-4.122=-0.734
max4.728-4.670=0.058
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1634.000-1649.000=-15.000
σ0.000
min1634.000-1649.000=-15.000
max1634.000-1649.000=-15.000
mean3.488-4.240=-0.753
σ0.077-0.072=0.005
min3.328-4.068=-0.740
max3.791-4.474=-0.683
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1634.000-1649.000=-15.000
σ0.000
min1634.000-1649.000=-15.000
max1634.000-1649.000=-15.000
mean0.591-0.735=-0.144
σ0.097-0.028=0.069
min0.507-0.684=-0.177
max0.853-0.872=-0.019
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1634.000-1649.000=-15.000
σ0.000
min1634.000-1649.000=-15.000
max1634.000-1649.000=-15.000
mean0.510-0.707=-0.197
σ0.024-0.016=0.009
min0.482-0.679=-0.198
max0.722-0.766=-0.044

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.366-294.215=0.151
σ0.234-0.248=-0.013
min294.195-294.091=0.103
max294.997-294.914=0.083
mean1937.000-1895.000=42.000
σ0.000
min1937.000-1895.000=42.000
max1937.000-1895.000=42.000
mean0.581-0.564=0.018
σ0.025-0.047=-0.022
min0.547-0.497=0.050
max0.632-0.642=-0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.496-281.494=0.002
σ0.040-0.041=-0.000
min281.446-281.438=0.008
max281.536-281.536=0.000
mean1634.000-1649.000=-15.000
σ0.000
min1634.000-1649.000=-15.000
max1634.000-1649.000=-15.000
mean0.395-0.397=-0.001
σ0.007-0.009=-0.002
min0.387-0.386=0.001
max0.402-0.405=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1291.484-1291.472=0.011
σ0.110-0.103=0.008
min1291.363-1291.361=0.002
max1291.622-1291.604=0.018
mean1634.000-1649.000=-15.000
σ0.000
min1634.000-1649.000=-15.000
max1634.000-1649.000=-15.000
mean1.912-1.918=-0.005
σ0.088-0.099=-0.011
min1.810-1.810=0.000
max2.001-2.029=-0.028
iters=5
new-facts=6402
prior-facts=1
mean1534.328-1534.349=-0.021
σ4.035-4.020=0.016
min1532.323-1532.319=0.004
max1541.539-1541.533=0.005
mean1634.000-1649.000=-15.000
σ0.000
min1634.000-1649.000=-15.000
max1634.000-1649.000=-15.000
mean2.247-2.187=0.060
σ0.200-0.173=0.028
min2.040-2.033=0.007
max2.476-2.460=0.016
iters=5
new-facts=6402
prior-facts=6402
mean1853.350-1853.357=-0.007
σ0.054-0.058=-0.004
min1853.304-1853.303=0.001
max1853.421-1853.441=-0.020
mean1781.800
σ151.726-118.422=33.304
min1634.000-1649.000=-15.000
max1937.000-1895.000=42.000
mean2.922-2.988=-0.066
σ0.105-0.089=0.016
min2.825-2.887=-0.062
max3.089-3.117=-0.028

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.489-1.301=0.188
σ0.313-0.247=0.066
min1.121-1.092=0.029
max1.965-1.710=0.254

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.428-442.429=-0.002
σ577.065-577.064=0.001
min153.894-153.896=-0.002
max1308.025-1308.026=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1634.000-1649.000=-15.000
σ0.000
min1634.000-1649.000=-15.000
max1634.000-1649.000=-15.000
mean0.541-0.542=-0.001
σ0.566-0.555=0.011
min0.257-0.260=-0.003
max1.390-1.373=0.016
policies=20
mean1539.207-1539.216=-0.009
σ0.318-0.320=-0.001
min1538.985-1538.995=-0.010
max1539.679-1539.690=-0.011
mean920.000
σ0.000
min920.000
max920.000
mean1634.000-1649.000=-15.000
σ0.000
min1634.000-1649.000=-15.000
max1634.000-1649.000=-15.000
mean2.577-2.573=0.004
σ0.016-0.020=-0.003
min2.555-2.545=0.010
max2.594-2.588=0.006
policies=200
mean15400.433-15400.493=-0.060
σ0.143-0.104=0.039
min15400.263-15400.412=-0.149
max15400.609-15400.634=-0.026
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000-1649.000=-15.000
σ0.000
min1634.000-1649.000=-15.000
max1634.000-1649.000=-15.000
mean26.127-26.054=0.073
σ0.062-0.045=0.017
min26.036-25.994=0.042
max26.172-26.100=0.072