Compare commits

Home / Compare 0682212a .. 2055897b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.046-54.056=-0.011
σ0.369-0.369=0.001
min53.892-53.922=-0.030
max55.096-55.106=-0.010
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.139-0.141=-0.003
σ0.004-0.007=-0.003
min0.135-0.133=0.002
max0.145-0.156=-0.012
cache=y
dps=1
iters=10
policies=100
mean43.385-43.394=-0.009
σ0.004-0.006=-0.002
min43.380-43.385=-0.005
max43.392-43.401=-0.009
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.121-0.122=-0.001
σ0.004-0.003=0.001
min0.114-0.119=-0.005
max0.130-0.128=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.980=-0.001
σ0.868-0.870=-0.002
min1006.480-1006.481=-0.001
max1010.569-1010.582=-0.013
mean1047.100-1048.250=-1.150
σ315.079-311.486=3.593
min577.000
max1650.000
mean1.557-1.542=0.015
σ0.062-0.096=-0.034
min1.500-1.460=0.040
max1.727-1.791=-0.064

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.000
σ0.003-0.002=0.000
min0.882
max0.887
mean1650.000
σ0.000
min1650.000
max1650.000
mean0.437-0.445=-0.009
σ0.191-0.181=0.009
min0.332-0.346=-0.014
max0.777-0.767=0.010
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1650.000
σ0.000
min1650.000
max1650.000
mean0.906-0.921=-0.015
σ0.153-0.155=-0.002
min0.822-0.830=-0.008
max1.178-1.197=-0.019
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1650.000
σ0.000
min1650.000
max1650.000
mean0.535-0.529=0.006
σ0.050-0.046=0.004
min0.497-0.494=0.002
max0.616-0.607=0.009
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1650.000
σ0.000
min1650.000
max1650.000
mean0.839-0.839=-0.000
σ0.036-0.038=-0.001
min0.803-0.802=0.001
max0.896-0.902=-0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.835=-0.003
σ0.025-0.030=-0.005
min964.802-964.811=-0.009
max964.861-964.886=-0.025
mean1650.000
σ0.000
min1650.000
max1650.000
mean0.823-0.785=0.037
σ0.031-0.058=-0.027
min0.786-0.708=0.078
max0.856-0.864=-0.009
name=cdr_enhanced_4k_loc.art
mean885.513-885.514=-0.001
σ0.005-0.009=-0.004
min885.504
max885.516-885.525=-0.009
mean1650.000
σ0.000
min1650.000
max1650.000
mean0.701-0.710=-0.009
σ0.037-0.064=-0.027
min0.643-0.598=0.045
max0.743-0.755=-0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1650.000
σ0.000
min1650.000
max1650.000
mean3.480-4.224=-0.744
σ0.105-0.070=0.035
min3.327-4.093=-0.766
max4.158-4.591=-0.433
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1650.000
σ0.000
min1650.000
max1650.000
mean3.779-4.231=-0.452
σ0.355-0.069=0.286
min3.310-4.106=-0.796
max4.323-4.511=-0.188
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1650.000
σ0.000
min1650.000
max1650.000
mean0.733-0.742=-0.008
σ0.019-0.025=-0.006
min0.697-0.575=0.121
max0.849-0.859=-0.010
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1650.000
σ0.000
min1650.000
max1650.000
mean0.693-0.704=-0.010
σ0.027-0.015=0.012
min0.521-0.676=-0.154
max0.793-0.802=-0.009

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.693-295.572=0.121
σ0.248-0.240=0.008
min295.425-295.411=0.014
max296.351-296.235=0.116
mean1888.000-2031.000=-143.000
σ0.000
min1888.000-2031.000=-143.000
max1888.000-2031.000=-143.000
mean0.565-0.545=0.020
σ0.045-0.029=0.017
min0.497-0.505=-0.008
max0.614-0.574=0.040

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.405-285.409=-0.004
σ0.041-0.031=0.010
min285.360-285.375=-0.015
max285.452-285.442=0.010
mean1650.000
σ0.000
min1650.000
max1650.000
mean0.384-0.386=-0.002
σ0.005-0.007=-0.002
min0.378-0.380=-0.002
max0.391-0.398=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.794-1295.807=-0.013
σ0.104-0.111=-0.007
min1295.681-1295.682=-0.001
max1295.923-1295.951=-0.027
mean1650.000
σ0.000
min1650.000
max1650.000
mean1.923-1.893=0.030
σ0.102-0.089=0.013
min1.810-1.805=0.005
max2.034-2.023=0.011
iters=5
new-facts=6402
prior-facts=1
mean1539.916-1539.915=0.000
σ6.854-6.882=-0.029
min1536.648-1536.608=0.040
max1552.173-1552.221=-0.049
mean1650.000
σ0.000
min1650.000
max1650.000
mean2.231-2.297=-0.066
σ0.301-0.235=0.066
min1.930-2.037=-0.107
max2.685-2.587=0.097
iters=5
new-facts=6402
prior-facts=6402
mean1857.709-1857.710=-0.002
σ0.054-0.048=0.006
min1857.648-1857.660=-0.012
max1857.778-1857.768=0.010
mean1771.000-1789.200=-18.200
σ118.030-165.069=-47.039
min1650.000
max1888.000-2031.000=-143.000
mean2.995-3.037=-0.042
σ0.101-0.252=-0.150
min2.860-2.839=0.021
max3.101-3.461=-0.360

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.422-1.305=0.117
σ0.290-0.216=0.074
min1.110-1.107=0.004
max1.815-1.628=0.186

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.740=-0.000
σ580.934-580.934=-0.001
min155.272-155.270=0.002
max1317.141-1317.142=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1650.000
σ0.000
min1650.000
max1650.000
mean0.525-0.524=0.001
σ0.538-0.537=0.001
min0.256-0.254=0.002
max1.332-1.330=0.002
policies=20
mean1552.978-1552.987=-0.008
σ0.321-0.328=-0.007
min1552.755-1552.761=-0.006
max1553.455-1553.474=-0.019
mean920.000
σ0.000
min920.000
max920.000
mean1650.000
σ0.000
min1650.000
max1650.000
mean2.579-2.587=-0.008
σ0.043-0.015=0.027
min2.551-2.572=-0.022
max2.641-2.606=0.035
policies=200
mean15537.863-15537.993=-0.130
σ0.133-0.070=0.062
min15537.773-15537.897=-0.124
max15538.060-15538.064=-0.004
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000
σ0.000
min1650.000
max1650.000
mean26.074-26.155=-0.081
σ0.075-0.190=-0.116
min25.963-26.021=-0.058
max26.122-26.433=-0.311