Compare commits

Home / Compare 37ba03dd .. 8b1727ef

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.046-54.047=-0.001
σ0.368-0.370=-0.001
min53.907-53.902=0.005
max55.094-55.099=-0.005
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.142-0.144=-0.002
σ0.009-0.009=0.000
min0.133-0.137=-0.004
max0.156-0.159=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.384-43.383=0.001
σ0.006-0.007=-0.001
min43.377-43.374=0.003
max43.395-43.399=-0.004
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.123-0.122=0.001
σ0.004-0.004=0.001
min0.119-0.119=0.001
max0.130-0.129=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.978=0.001
σ0.876-0.923=-0.047
min1006.506-1006.512=-0.007
max1010.608-1010.816=-0.208
mean1050.350-1049.950=0.400
σ319.933-307.735=12.198
min574.000-575.000=-1.000
max1618.000-1649.000=-31.000
mean1.555-1.565=-0.010
σ0.087-0.112=-0.025
min1.484-1.488=-0.005
max1.875-1.998=-0.123

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1618.000-1649.000=-31.000
σ0.000
min1618.000-1649.000=-31.000
max1618.000-1649.000=-31.000
mean0.395-0.424=-0.029
σ0.134-0.128=0.006
min0.313-0.341=-0.028
max0.629-0.643=-0.013
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1618.000-1649.000=-31.000
σ0.000
min1618.000-1649.000=-31.000
max1618.000-1649.000=-31.000
mean0.861-0.873=-0.012
σ0.076-0.081=-0.005
min0.812-0.818=-0.006
max0.991-1.016=-0.024
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1618.000-1649.000=-31.000
σ0.000
min1618.000-1649.000=-31.000
max1618.000-1649.000=-31.000
mean0.508-0.527=-0.019
σ0.050-0.046=0.004
min0.457-0.483=-0.026
max0.587-0.601=-0.014
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1618.000-1649.000=-31.000
σ0.000
min1618.000-1649.000=-31.000
max1618.000-1649.000=-31.000
mean0.818-0.844=-0.025
σ0.042-0.035=0.007
min0.774-0.805=-0.031
max0.880-0.900=-0.020

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.839=-0.008
σ0.025-0.032=-0.007
min964.802-964.811=-0.009
max964.863-964.893=-0.030
mean1618.000-1649.000=-31.000
σ0.000
min1618.000-1649.000=-31.000
max1618.000-1649.000=-31.000
mean0.809-0.834=-0.026
σ0.031-0.039=-0.008
min0.773-0.770=0.003
max0.857-0.860=-0.003
name=cdr_enhanced_4k_loc.art
mean885.514-885.513=0.000
σ0.006-0.006=-0.000
min885.504
max885.519-885.518=0.001
mean1618.000-1649.000=-31.000
σ0.000
min1618.000-1649.000=-31.000
max1618.000-1649.000=-31.000
mean0.736-0.741=-0.005
σ0.010-0.003=0.006
min0.721-0.736=-0.014
max0.748-0.744=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.001
mean1618.000-1649.000=-31.000
σ0.000
min1618.000-1649.000=-31.000
max1618.000-1649.000=-31.000
mean4.222-4.255=-0.032
σ0.081-0.076=0.006
min4.091-4.135=-0.044
max4.545-4.509=0.036
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1618.000-1649.000=-31.000
σ0.000
min1618.000-1649.000=-31.000
max1618.000-1649.000=-31.000
mean4.194-4.238=-0.044
σ0.069-0.087=-0.018
min4.074-4.114=-0.040
max4.395-4.579=-0.184
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1618.000-1649.000=-31.000
σ0.000
min1618.000-1649.000=-31.000
max1618.000-1649.000=-31.000
mean0.742-0.623=0.119
σ0.036-0.108=-0.072
min0.544-0.506=0.038
max0.920-0.852=0.068
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1618.000-1649.000=-31.000
σ0.000
min1618.000-1649.000=-31.000
max1618.000-1649.000=-31.000
mean0.700-0.501=0.199
σ0.037-0.027=0.010
min0.514-0.295=0.219
max0.854-0.628=0.226

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.650-295.618=0.032
σ0.242-0.264=-0.022
min295.447-295.412=0.035
max296.315-296.346=-0.032
mean2013.000-1895.000=118.000
σ0.000
min2013.000-1895.000=118.000
max2013.000-1895.000=118.000
mean0.537-0.551=-0.014
σ0.034-0.050=-0.016
min0.498-0.503=-0.005
max0.577-0.666=-0.089

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.407-285.409=-0.002
σ0.039-0.034=0.005
min285.355-285.362=-0.007
max285.448-285.448=-0.001
mean1618.000-1649.000=-31.000
σ0.000
min1618.000-1649.000=-31.000
max1618.000-1649.000=-31.000
mean0.389-0.394=-0.005
σ0.006-0.011=-0.005
min0.383-0.386=-0.002
max0.396-0.411=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1295.791-1295.807=-0.015
σ0.101-0.122=-0.021
min1295.675-1295.678=-0.003
max1295.899-1295.972=-0.073
mean1618.000-1649.000=-31.000
σ0.000
min1618.000-1649.000=-31.000
max1618.000-1649.000=-31.000
mean1.871-1.897=-0.026
σ0.078-0.089=-0.010
min1.805-1.803=0.002
max1.962-1.998=-0.036
iters=5
new-facts=6402
prior-facts=1
mean1539.907-1539.917=-0.010
σ6.860-6.868=-0.009
min1536.616-1536.663=-0.047
max1552.172-1552.201=-0.029
mean1618.000-1649.000=-31.000
σ0.000
min1618.000-1649.000=-31.000
max1618.000-1649.000=-31.000
mean2.259-2.199=0.059
σ0.197-0.152=0.045
min2.103-2.066=0.038
max2.567-2.414=0.153
iters=5
new-facts=6402
prior-facts=6402
mean1857.733-1857.711=0.022
σ0.066-0.048=0.018
min1857.653-1857.663=-0.010
max1857.800-1857.777=0.023
mean1746.400-1768.400=-22.000
σ171.068-121.679=49.389
min1618.000-1649.000=-31.000
max2013.000-1895.000=118.000
mean2.876-3.114=-0.238
σ0.063-0.340=-0.277
min2.835-2.832=0.003
max2.987-3.705=-0.718

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.376-1.298=0.078
σ0.259-0.188=0.070
min1.109-1.101=0.008
max1.802-1.611=0.191

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.741=-0.001
σ580.935-580.934=0.000
min155.269-155.272=-0.002
max1317.142-1317.142=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1618.000-1649.000=-31.000
σ0.000
min1618.000-1649.000=-31.000
max1618.000-1649.000=-31.000
mean0.529-0.554=-0.025
σ0.536-0.588=-0.052
min0.258-0.257=0.001
max1.334-1.436=-0.103
policies=20
mean1552.995-1552.989=0.007
σ0.337-0.324=0.013
min1552.765-1552.767=-0.002
max1553.496-1553.470=0.026
mean920.000
σ0.000
min920.000
max920.000
mean1618.000-1649.000=-31.000
σ0.000
min1618.000-1649.000=-31.000
max1618.000-1649.000=-31.000
mean2.597-2.588=0.009
σ0.018-0.009=0.010
min2.572-2.575=-0.003
max2.613-2.593=0.020
policies=200
mean15537.944-15538.058=-0.114
σ0.118-0.081=0.038
min15537.834-15537.993=-0.158
max15538.102-15538.166=-0.064
mean9200.000
σ0.000
min9200.000
max9200.000
mean1618.000-1649.000=-31.000
σ0.000
min1618.000-1649.000=-31.000
max1618.000-1649.000=-31.000
mean26.384-26.261=0.123
σ0.226-0.077=0.149
min26.264-26.204=0.060
max26.722-26.373=0.349